2021-10-08T19:01:04.948 INFO:root:teuthology version: 1.1.0-6f40c4ca 2021-10-08T19:01:04.950 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} --name sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi --archive /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428696 --owner scheduled_sage@teuthology -- /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428696/orig.config.yaml 2021-10-08T19:01:04.986 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-08T19:01:05.051 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428696 branch: master description: orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} email: null first_in_suite: false job_id: '6428696' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: master ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: cephadm-package install: ceph: sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf extra_packages: - cephadm selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: qa-nvme-loop sha1: 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 owner: scheduled_sage@teuthology priority: 75 repo: https://github.com/ceph/ceph roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf sleep_before_teardown: 0 suite: orch:cephadm suite_branch: qa-nvme-loop suite_path: /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 targets: smithi112.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC65YgJKazcDTTLagh9r9Iv2w8NxWMQTLq+9GyQLaXDWvpNqdireaugJgbCY2KAzN3HDemE09qd1FlEs1CA680INUIDEmRKsDZCwsqseXTc+cg/v90on7AanyLP6U1xvHkP7SPx2gS8aBCAy1d4NQs9VLxOWpnrVuU0YF5AltOOgjVW5brTmMzmGXsXGMEMVGBx+SiaHA+XP1uIh8WBPaAkbThN6QcBxJZSZmHs62d8hC275sXnyrkBdoShBQJCr7m2sTxLWN9oDLwjLzbEELURwAQsIKA58CZA0nfMUU8OrvgOg0JyH/UeSk7lS0cgFt18zVgh5wJsbvmiKhiIBGYktI9eR+QPAXbSyZgU1jI7Pdk4ZhviaLoGS8HJhygS2mpBs4cvvaJGpNdnlJ4x7cKfmXmkQ47FsbByxIqqpe5P9Ntrqk6/xr9NYy92WU/Cqi7IC2qNkGYpoJ2uc/+/Dc1rcAXHxifnWSKnfpgDjJ3TQSHTCEbBP4V6FhrbY2RmQSc= smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5BLMFh4gvWCiA0mFjvudnkON4LOfT29g136HkEJccJSQsk3oVGkKpE5VjDt0N+JmWKfe2J7Gez3MkWNtHJ0NRcyJDI5ZAjW5UGy/3Dt0B4M8FneDHoao9Emh1jvbB3mpeR3W5BGomd3qNz2SiVjmIEgEvSnhMceHCZdA82cccJe9FRhOpSaxL2+lZi93PoSSghCayDZb2Mq+NPYLGv/dextT4i6PX7ii3W8i1pj+1C+9wUHPsJxWeLnVYA2/I6+hMGbUcKfdp1pvDphq907anisjkoTRbd0JYW5NE2P0OaVIvLbjQtVaXtSRKe5CWHCuoxIc9weGKItlU7ssnFhEsLZQ5To7J35uC6RHDVYekh22XPQzkRW17Q4eWAJBTxe8QPe/c8R1bitIn5YRYm9yHG8trvkfuLPXIt1vK3r9RtOqdgZ/FHKBY/+24Qphz7Or8jHhPP7iqY7SwNDSLi87U7C2x8/FsBB37m4Vsh8LCZcr3HFwQjFcChG3wbffqjxc= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology_branch: master teuthology_sha1: 6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b timestamp: 2021-10-08_18:44:18 tube: smithi user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.18925 2021-10-08T19:01:05.052 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa; will attempt to use it 2021-10-08T19:01:05.053 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_6d1d7181c8e91145ded12e11fc2a9c8ce31671f6/qa/tasks 2021-10-08T19:01:05.053 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-10-08T19:01:05.055 INFO:teuthology.task.internal:Checking packages... 2021-10-08T19:01:05.075 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '103b6cc3554193fcd0852d9c647cef19e99920cf' 2021-10-08T19:01:05.075 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-10-08T19:01:05.076 INFO:teuthology.packaging:ref: None 2021-10-08T19:01:05.076 INFO:teuthology.packaging:tag: None 2021-10-08T19:01:05.076 INFO:teuthology.packaging:branch: master 2021-10-08T19:01:05.077 INFO:teuthology.packaging:sha1: 103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:01:05.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=master 2021-10-08T19:01:05.312 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-8109.gd66a7ec3 2021-10-08T19:01:05.312 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-10-08T19:01:05.321 INFO:teuthology.task.internal:no buildpackages task found 2021-10-08T19:01:05.321 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-10-08T19:01:05.368 INFO:teuthology.task.internal:Saving configuration 2021-10-08T19:01:05.380 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-10-08T19:01:05.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-08T19:01:05.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428696', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-08 18:56:06.643521', 'locked_by': 'scheduled_sage@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqp8mFMO24aKNAjIzEAe0uF/jORuUgS8wtD9az3LfRJA6uk6v2wNW9pHqn2a5G+obIH1ZtEcmgc2o48iU3JTK8='} 2021-10-08T19:01:05.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sage-2021-10-08_18:44:18-orch:cephadm-master-distro-basic-smithi/6428696', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-08 18:56:06.643542', 'locked_by': 'scheduled_sage@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDxANXeZg8B5xbv3Gzh7b0PNcvWju40qFtzpYMtRfxclUW07o5cxoFueaX/Yvi6O8msPwANmX11vMxlky8SNP5A='} 2021-10-08T19:01:05.439 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-10-08T19:01:05.448 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2021-10-08T19:01:05.448 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-10-08T19:01:05.448 INFO:teuthology.run_tasks:Running task console_log... 2021-10-08T19:01:05.540 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fccc196ee18>, signals=[15]) 2021-10-08T19:01:05.542 INFO:teuthology.run_tasks:Running task internal.connect... 2021-10-08T19:01:05.551 INFO:teuthology.task.internal:Opening connections... 2021-10-08T19:01:05.552 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2021-10-08T19:01:05.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:01:05.629 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2021-10-08T19:01:05.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:01:05.699 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-10-08T19:01:05.711 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2021-10-08T19:01:05.728 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2021-10-08T19:01:05.729 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2021-10-08T19:01:05.783 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2021-10-08T19:01:05.783 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.4 (Ootpa)" 2021-10-08T19:01:05.784 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2021-10-08T19:01:05.784 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2021-10-08T19:01:05.784 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.4" 2021-10-08T19:01:05.785 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2021-10-08T19:01:05.785 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-10-08T19:01:05.785 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2021-10-08T19:01:05.785 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-10-08T19:01:05.786 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2021-10-08T19:01:05.786 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-10-08T19:01:05.786 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-10-08T19:01:05.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:01:05.786 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-10-08T19:01:05.787 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-10-08T19:01:05.787 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-10-08T19:01:05.787 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-10-08T19:01:05.788 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2021-10-08T19:01:05.806 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2021-10-08T19:01:05.822 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2021-10-08T19:01:05.823 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2021-10-08T19:01:05.880 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2021-10-08T19:01:05.880 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.4 (Ootpa)" 2021-10-08T19:01:05.880 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2021-10-08T19:01:05.880 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2021-10-08T19:01:05.881 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.4" 2021-10-08T19:01:05.881 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2021-10-08T19:01:05.881 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-10-08T19:01:05.881 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2021-10-08T19:01:05.882 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-10-08T19:01:05.882 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2021-10-08T19:01:05.882 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-10-08T19:01:05.882 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-10-08T19:01:05.883 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:01:05.883 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-10-08T19:01:05.883 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-10-08T19:01:05.883 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-10-08T19:01:05.883 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-10-08T19:01:05.884 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2021-10-08T19:01:05.903 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-10-08T19:01:05.918 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-10-08T19:01:05.967 INFO:teuthology.task.internal:Checking for old test directory... 2021-10-08T19:01:05.968 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2021-10-08T19:01:05.971 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2021-10-08T19:01:05.986 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-10-08T19:01:06.003 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-10-08T19:01:06.003 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2021-10-08T19:01:06.026 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2021-10-08T19:01:06.043 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-10-08T19:01:06.101 INFO:teuthology.run_tasks:Running task kernel... 2021-10-08T19:01:06.121 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-10-08T19:01:06.122 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.foo.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}, 'ceph.iscsi.iscsi.a': {'kdb': True, 'sha1': 'distro'}} 2021-10-08T19:01:06.122 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-10-08T19:01:06.122 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2021-10-08T19:01:06.138 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-305.el8.x86_64 2021-10-08T19:01:06.139 INFO:teuthology.task.kernel:Running kernel on smithi112: 4.18.0-305.el8.x86_64 2021-10-08T19:01:06.140 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2021-10-08T19:01:07.367 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:01:07.368 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2021-10-08T19:01:07.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:01:07.440 INFO:teuthology.orchestra.run.smithi112.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-10-08T19:01:07.440 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:01:09.367 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 12 MB/s | 10 MB 00:00 2021-10-08T19:01:11.435 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-10-08T19:01:12.000 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-305.el8.x86_64 is already installed. 2021-10-08T19:01:12.118 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:01:12.119 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:01:12.120 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:01:12.251 DEBUG:teuthology.orchestra.run.smithi112:> echo no | sudo yum reinstall kernel || true 2021-10-08T19:01:12.567 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:01:12.567 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2021-10-08T19:01:12.609 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:01:12.610 INFO:teuthology.orchestra.run.smithi112.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-10-08T19:01:12.610 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:01:12.789 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:01 ago on Fri 08 Oct 2021 07:01:11 PM UTC. 2021-10-08T19:01:12.901 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2021-10-08T19:01:12.935 INFO:teuthology.orchestra.run.smithi112.stderr:Error: No packages marked for reinstall. 2021-10-08T19:01:12.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum reinstall -y kernel || true 2021-10-08T19:01:13.288 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:01:13.288 INFO:teuthology.orchestra.run.smithi112.stdout:Unable to read consumer identity 2021-10-08T19:01:13.327 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:01:13.327 INFO:teuthology.orchestra.run.smithi112.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-10-08T19:01:13.328 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:01:13.499 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:02 ago on Fri 08 Oct 2021 07:01:11 PM UTC. 2021-10-08T19:01:13.624 INFO:teuthology.orchestra.run.smithi112.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2021-10-08T19:01:13.647 INFO:teuthology.orchestra.run.smithi112.stderr:Error: No packages marked for reinstall. 2021-10-08T19:01:13.689 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel --last | head -n 1 2021-10-08T19:01:13.760 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-4.18.0-305.el8.x86_64 Thu 20 May 2021 08:07:00 PM UTC 2021-10-08T19:01:13.761 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.el8.x86_64 2021-10-08T19:01:13.762 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-10-08T19:01:13.762 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2021-10-08T19:01:13.780 INFO:teuthology.orchestra.run.smithi142.stdout:4.18.0-305.el8.x86_64 2021-10-08T19:01:13.780 INFO:teuthology.task.kernel:Running kernel on smithi142: 4.18.0-305.el8.x86_64 2021-10-08T19:01:13.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2021-10-08T19:01:15.164 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:01:15.165 INFO:teuthology.orchestra.run.smithi142.stdout:Unable to read consumer identity 2021-10-08T19:01:15.250 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:01:15.251 INFO:teuthology.orchestra.run.smithi142.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-10-08T19:01:15.251 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:01:17.048 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 16 MB/s | 10 MB 00:00 2021-10-08T19:01:19.140 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-10-08T19:01:19.666 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-4.18.0-305.el8.x86_64 is already installed. 2021-10-08T19:01:19.770 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:01:19.771 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:01:19.772 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:01:19.902 DEBUG:teuthology.orchestra.run.smithi142:> echo no | sudo yum reinstall kernel || true 2021-10-08T19:01:20.215 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:01:20.216 INFO:teuthology.orchestra.run.smithi142.stdout:Unable to read consumer identity 2021-10-08T19:01:20.264 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:01:20.264 INFO:teuthology.orchestra.run.smithi142.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-10-08T19:01:20.265 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:01:20.444 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:01 ago on Fri 08 Oct 2021 07:01:19 PM UTC. 2021-10-08T19:01:20.553 INFO:teuthology.orchestra.run.smithi142.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2021-10-08T19:01:20.591 INFO:teuthology.orchestra.run.smithi142.stderr:Error: No packages marked for reinstall. 2021-10-08T19:01:20.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum reinstall -y kernel || true 2021-10-08T19:01:20.947 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:01:20.948 INFO:teuthology.orchestra.run.smithi142.stdout:Unable to read consumer identity 2021-10-08T19:01:20.992 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:01:20.993 INFO:teuthology.orchestra.run.smithi142.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-10-08T19:01:20.993 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:01:21.167 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:02 ago on Fri 08 Oct 2021 07:01:19 PM UTC. 2021-10-08T19:01:21.302 INFO:teuthology.orchestra.run.smithi142.stdout:Installed package kernel-4.18.0-305.el8.x86_64 (from anaconda) not available. 2021-10-08T19:01:21.326 INFO:teuthology.orchestra.run.smithi142.stderr:Error: No packages marked for reinstall. 2021-10-08T19:01:21.370 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel --last | head -n 1 2021-10-08T19:01:21.440 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-4.18.0-305.el8.x86_64 Thu 20 May 2021 08:07:00 PM UTC 2021-10-08T19:01:21.442 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.el8.x86_64 2021-10-08T19:01:21.442 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-10-08T19:01:21.442 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-10-08T19:01:21.443 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-08T19:01:21.502 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2021-10-08T19:01:21.518 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-10-08T19:01:21.519 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-08T19:01:21.576 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2021-10-08T19:01:21.590 INFO:teuthology.run_tasks:Running task internal.base... 2021-10-08T19:01:21.604 INFO:teuthology.task.internal:Creating test directory... 2021-10-08T19:01:21.605 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-08T19:01:21.608 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-08T19:01:21.623 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-10-08T19:01:21.642 INFO:teuthology.run_tasks:Running task internal.archive... 2021-10-08T19:01:21.667 INFO:teuthology.task.internal:Creating archive directory... 2021-10-08T19:01:21.669 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-08T19:01:21.672 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-08T19:01:21.697 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-10-08T19:01:21.722 INFO:teuthology.task.internal:Enabling coredump saving... 2021-10-08T19:01:21.723 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-08T19:01:21.735 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-08T19:01:21.770 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:01:21.770 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:01:21.781 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:01:21.783 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-08T19:01:21.783 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-10-08T19:01:21.798 INFO:teuthology.task.internal:Configuring sudo... 2021-10-08T19:01:21.800 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-08T19:01:21.826 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-08T19:01:21.852 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-10-08T19:01:21.867 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-10-08T19:01:21.868 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-08T19:01:21.893 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-08T19:01:21.909 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:01:21.983 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:01:22.046 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:01:22.122 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:01:22.167 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:01:22.168 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-08T19:01:22.231 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:01:22.269 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-08T19:01:22.337 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:01:22.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-08T19:01:22.423 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:01:22.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-08T19:01:22.488 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2021-10-08T19:01:22.490 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2021-10-08T19:01:22.526 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-10-08T19:01:22.593 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-10-08T19:01:22.825 INFO:teuthology.run_tasks:Running task internal.timer... 2021-10-08T19:01:22.844 INFO:teuthology.task.internal:Starting timer... 2021-10-08T19:01:22.844 INFO:teuthology.run_tasks:Running task pcp... 2021-10-08T19:01:23.070 INFO:teuthology.run_tasks:Running task selinux... 2021-10-08T19:01:23.086 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-10-08T19:01:23.087 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2021-10-08T19:01:23.143 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: [ OK ] 2021-10-08T19:01:23.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2021-10-08T19:01:23.227 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: [ OK ] 2021-10-08T19:01:23.229 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-10-08T19:01:23.229 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2021-10-08T19:01:23.250 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2021-10-08T19:01:23.250 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2021-10-08T19:01:23.274 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2021-10-08T19:01:23.274 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2021-10-08T19:01:23.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-10-08T19:01:23.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-08T19:01:23.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-10-08T19:01:23.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-08T19:01:23.341 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-10-08T19:01:23.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2021-10-08T19:01:23.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2021-10-08T19:01:23.408 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-10-08T19:01:23.419 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-10-08T19:01:23.420 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-10-08T19:01:23.441 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-10-08T19:01:23.443 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-10-08T19:01:23.831 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-10-08T19:01:24.643 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-10-08T19:01:27.612 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-10-08T19:01:27.636 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:27 +0000 (0:00:00.040) 0:00:00.041 ******** 2021-10-08T19:01:27.649 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:27 +0000 (0:00:00.012) 0:00:00.053 ******** 2021-10-08T19:01:29.088 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi112.front.sepia.ceph.com] 2021-10-08T19:01:29.140 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:29 +0000 (0:00:01.492) 0:00:01.545 ******** 2021-10-08T19:01:29.230 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2021-10-08T19:01:29.286 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:29 +0000 (0:00:00.144) 0:00:01.689 ******** 2021-10-08T19:01:29.416 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:01:29.440 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:29 +0000 (0:00:00.155) 0:00:01.845 ******** 2021-10-08T19:01:29.479 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:01:29.504 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:29 +0000 (0:00:00.063) 0:00:01.909 ******** 2021-10-08T19:01:29.831 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi112.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-08T19:01:29.852 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:29 +0000 (0:00:00.347) 0:00:02.256 ******** 2021-10-08T19:01:29.861 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-08T19:01:29.884 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:29 +0000 (0:00:00.032) 0:00:02.288 ******** 2021-10-08T19:01:29.921 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-10-08T19:01:29.923 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:29.945 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:29 +0000 (0:00:00.060) 0:00:02.349 ******** 2021-10-08T19:01:29.953 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:29.975 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:29 +0000 (0:00:00.030) 0:00:02.379 ******** 2021-10-08T19:01:30.212 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:01:30.232 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:30 +0000 (0:00:00.257) 0:00:02.637 ******** 2021-10-08T19:01:30.252 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:30 +0000 (0:00:00.020) 0:00:02.657 ******** 2021-10-08T19:01:31.049 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-10-08T19:01:31.052 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633719690.2997465-9998-163883239735407/source", "state": "file", "uid": 0} 2021-10-08T19:01:31.072 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:31 +0000 (0:00:00.818) 0:00:03.475 ******** 2021-10-08T19:01:31.078 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633719690.281742-9996-259979839098942/source", "state": "file", "uid": 0} 2021-10-08T19:01:31.102 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:31 +0000 (0:00:00.031) 0:00:03.507 ******** 2021-10-08T19:01:31.473 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2021-10-08T19:01:31.475 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1 2021-10-08T19:01:31.477 INFO:teuthology.task.ansible.out:cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P 2021-10-08T19:01:31.478 INFO:teuthology.task.ansible.out:2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-08T19:01:31.570 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched PLAY [testnodes] *************************************************************** 2021-10-08T19:01:31.589 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-08T19:01:31.591 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:31 +0000 (0:00:00.486) 0:00:03.994 ******** 2021-10-08T19:01:32.122 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] 2021-10-08T19:01:32.149 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2021-10-08T19:01:32.157 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Friday 08 October 2021 19:01:32 +0000 (0:00:00.567) 0:00:04.561 ******** 2021-10-08T19:01:32.183 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-08T19:01:32.193 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-08T19:01:32.198 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-08T19:01:32.380 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:32 +0000 (0:00:00.223) 0:00:04.784 ******** 2021-10-08T19:01:32.406 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:32 +0000 (0:00:00.021) 0:00:04.806 ******** 2021-10-08T19:01:33.013 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi112.front.sepia.ceph.com] 2021-10-08T19:01:33.046 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2021-10-08T19:01:33.075 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Friday 08 October 2021 19:01:33 +0000 (0:00:00.673) 0:00:05.480 ******** 2021-10-08T19:01:33.128 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:33 +0000 (0:00:00.052) 0:00:05.532 ******** 2021-10-08T19:01:33.798 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-10-08T19:01:33.800 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.195575", "end": "2021-10-08 19:01:33.772533", "rc": 0, "start": "2021-10-08 19:01:33.576958", "stderr": "", "stderr_lines": [], "stdout": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "stdout_lines": ["ee931718ec906fcbc1b8afc120f625a06f1ece1a"]} 2021-10-08T19:01:33.821 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:33 +0000 (0:00:00.693) 0:00:06.226 ******** 2021-10-08T19:01:33.830 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.189312", "end": "2021-10-08 19:01:33.782892", "rc": 0, "start": "2021-10-08 19:01:33.593580", "stderr": "", "stderr_lines": [], "stdout": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "stdout_lines": ["ee931718ec906fcbc1b8afc120f625a06f1ece1a"]} 2021-10-08T19:01:33.858 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:33 +0000 (0:00:00.032) 0:00:06.258 ******** 2021-10-08T19:01:34.031 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-10-08T19:01:34.033 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016477", "end": "2021-10-08 19:01:34.017135", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:01:34.000658", "stderr": "", "stderr_lines": [], "stdout": "b2a91f5f527dcc382f8ed49697328a42af627ee8", "stdout_lines": ["b2a91f5f527dcc382f8ed49697328a42af627ee8"]} 2021-10-08T19:01:34.055 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.200) 0:00:06.459 ******** 2021-10-08T19:01:34.071 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014032", "end": "2021-10-08 19:01:34.044435", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:01:34.030403", "stderr": "", "stderr_lines": [], "stdout": "b2a91f5f527dcc382f8ed49697328a42af627ee8", "stdout_lines": ["b2a91f5f527dcc382f8ed49697328a42af627ee8"]} 2021-10-08T19:01:34.097 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.042) 0:00:06.502 ******** 2021-10-08T19:01:34.126 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-10-08T19:01:34.128 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.150 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.052) 0:00:06.554 ******** 2021-10-08T19:01:34.178 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.204 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.053) 0:00:06.607 ******** 2021-10-08T19:01:34.221 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-10-08T19:01:34.223 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.245 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.041) 0:00:06.649 ******** 2021-10-08T19:01:34.273 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.299 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.054) 0:00:06.704 ******** 2021-10-08T19:01:34.316 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-10-08T19:01:34.319 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.341 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.042) 0:00:06.746 ******** 2021-10-08T19:01:34.371 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.397 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.054) 0:00:06.800 ******** 2021-10-08T19:01:34.413 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-10-08T19:01:34.415 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.439 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.042) 0:00:06.842 ******** 2021-10-08T19:01:34.469 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.498 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.060) 0:00:06.902 ******** 2021-10-08T19:01:34.516 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-10-08T19:01:34.518 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.541 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.042) 0:00:06.945 ******** 2021-10-08T19:01:34.571 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:01:34.594 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.052) 0:00:06.998 ******** 2021-10-08T19:01:34.781 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:01:34.805 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.211) 0:00:07.210 ******** 2021-10-08T19:01:34.847 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:01:34.871 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:01:34 +0000 (0:00:00.065) 0:00:07.275 ******** 2021-10-08T19:01:34.872 INFO:teuthology.task.ansible.out: 2021-10-08T19:01:35.093 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-08T19:01:35.160 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-08T19:01:35.297 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-08T19:01:35.352 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-08T19:01:35.491 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-08T19:01:35.554 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-08T19:01:35.683 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-08T19:01:35.755 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-08T19:01:35.883 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-08T19:01:35.948 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-08T19:01:36.086 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-08T19:01:36.150 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-08T19:01:36.278 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-08T19:01:36.345 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-08T19:01:36.482 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-08T19:01:36.541 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-08T19:01:36.669 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-08T19:01:36.743 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-08T19:01:36.872 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-08T19:01:36.936 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-08T19:01:37.072 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-08T19:01:37.149 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-08T19:01:37.264 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-08T19:01:37.339 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-08T19:01:37.454 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-08T19:01:37.540 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-08T19:01:37.659 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-08T19:01:37.733 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-08T19:01:37.849 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-08T19:01:37.939 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-08T19:01:38.049 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-08T19:01:38.195 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-08T19:01:38.276 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-08T19:01:38.418 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-08T19:01:38.475 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-08T19:01:38.620 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-08T19:01:38.673 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-08T19:01:38.820 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-08T19:01:38.864 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-08T19:01:39.031 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-08T19:01:39.063 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-08T19:01:39.211 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-08T19:01:39.254 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-08T19:01:39.406 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-08T19:01:39.451 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-08T19:01:39.610 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-08T19:01:39.646 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-08T19:01:39.801 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-08T19:01:39.844 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-08T19:01:39.993 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-08T19:01:40.045 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-08T19:01:40.187 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-08T19:01:40.252 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-08T19:01:40.392 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-08T19:01:40.446 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-08T19:01:40.597 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-10-08T19:01:40.652 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-08T19:01:40.793 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-10-08T19:01:40.846 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-08T19:01:40.993 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-08T19:01:41.046 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-08T19:01:41.197 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-08T19:01:41.242 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-08T19:01:41.391 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-08T19:01:41.438 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-08T19:01:41.598 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-08T19:01:41.644 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-10-08T19:01:41.791 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-10-08T19:01:41.834 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:01:41.985 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:01:42.029 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-08T19:01:42.191 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-08T19:01:42.234 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-08T19:01:42.384 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-08T19:01:42.439 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-08T19:01:42.588 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-08T19:01:42.632 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-08T19:01:42.779 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-08T19:01:42.833 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-08T19:01:42.972 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-08T19:01:43.028 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-08T19:01:43.176 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-08T19:01:43.244 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-08T19:01:43.379 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-08T19:01:43.422 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:01:43.592 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:01:43.640 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-08T19:01:43.793 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-08T19:01:43.874 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-08T19:01:43.988 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-08T19:01:44.060 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-08T19:01:44.181 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-08T19:01:44.269 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-08T19:01:44.389 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-08T19:01:44.462 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-08T19:01:44.590 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-08T19:01:44.665 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-08T19:01:44.785 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-08T19:01:44.860 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-08T19:01:44.996 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-08T19:01:45.071 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-08T19:01:45.198 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-08T19:01:45.265 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-08T19:01:45.391 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-08T19:01:45.471 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-08T19:01:45.598 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-08T19:01:45.678 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-08T19:01:45.797 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-08T19:01:45.887 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-08T19:01:46.004 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-08T19:01:46.079 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-08T19:01:46.195 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-08T19:01:46.282 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-08T19:01:46.388 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-08T19:01:46.472 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-08T19:01:46.591 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-08T19:01:46.666 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-08T19:01:46.794 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-08T19:01:46.870 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:01:46.987 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-08T19:01:47.077 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-08T19:01:47.185 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-08T19:01:47.269 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-08T19:01:47.387 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-08T19:01:47.479 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-08T19:01:47.589 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-08T19:01:47.684 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-08T19:01:47.780 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-08T19:01:47.875 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-08T19:01:47.972 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-08T19:01:48.074 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-08T19:01:48.168 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-08T19:01:48.276 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-08T19:01:48.377 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-08T19:01:48.479 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-08T19:01:48.584 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-08T19:01:48.674 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-08T19:01:48.792 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-08T19:01:48.864 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-08T19:01:48.993 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-08T19:01:49.058 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-08T19:01:49.198 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-08T19:01:49.262 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-08T19:01:49.396 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-08T19:01:49.459 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-08T19:01:49.599 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-08T19:01:49.657 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-08T19:01:49.801 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-08T19:01:49.859 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-08T19:01:50.001 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-08T19:01:50.060 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-08T19:01:50.185 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-08T19:01:50.252 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-08T19:01:50.380 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-08T19:01:50.462 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-08T19:01:50.576 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-08T19:01:50.651 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-08T19:01:50.782 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-08T19:01:50.849 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-08T19:01:50.990 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-08T19:01:51.045 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-10-08T19:01:51.183 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-10-08T19:01:51.246 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-08T19:01:51.387 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-08T19:01:51.441 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-08T19:01:51.579 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-08T19:01:51.644 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-08T19:01:51.788 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-08T19:01:51.843 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-08T19:01:51.995 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-08T19:01:52.057 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-08T19:01:52.191 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-08T19:01:52.257 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-08T19:01:52.407 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-08T19:01:52.456 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-08T19:01:52.612 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-08T19:01:52.673 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-08T19:01:52.809 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-08T19:01:52.879 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-08T19:01:53.014 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-08T19:01:53.110 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-08T19:01:53.228 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-08T19:01:53.303 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-08T19:01:53.430 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-08T19:01:53.507 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-08T19:01:53.617 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-08T19:01:53.728 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-08T19:01:53.835 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-08T19:01:53.926 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-08T19:01:54.030 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-08T19:01:54.127 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:01:54.232 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-08T19:01:54.337 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-08T19:01:54.437 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-08T19:01:54.546 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-08T19:01:54.646 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-08T19:01:54.763 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-08T19:01:54.865 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-08T19:01:54.965 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-08T19:01:55.056 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-08T19:01:55.165 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-08T19:01:55.263 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-08T19:01:55.360 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-08T19:01:55.470 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-08T19:01:55.569 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-08T19:01:55.665 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-08T19:01:55.765 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-08T19:01:55.866 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-08T19:01:55.969 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-08T19:01:56.057 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-08T19:01:56.157 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-08T19:01:56.261 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-08T19:01:56.357 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-08T19:01:56.457 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-08T19:01:56.563 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-08T19:01:56.669 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-08T19:01:56.750 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-08T19:01:56.876 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-08T19:01:56.974 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-08T19:01:57.090 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-08T19:01:57.189 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-08T19:01:57.307 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-08T19:01:57.399 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-08T19:01:57.510 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-08T19:01:57.611 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-08T19:01:57.712 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-08T19:01:57.829 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-08T19:01:57.911 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-08T19:01:58.045 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-08T19:01:58.110 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-08T19:01:58.239 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-08T19:01:58.329 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-08T19:01:58.445 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-08T19:01:58.516 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-08T19:01:58.687 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-08T19:01:58.779 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-08T19:01:58.925 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-08T19:01:59.016 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-08T19:01:59.133 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-08T19:01:59.227 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-08T19:01:59.335 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-08T19:01:59.416 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-08T19:01:59.540 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-08T19:01:59.613 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-08T19:01:59.746 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-08T19:01:59.808 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-08T19:01:59.936 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-08T19:02:00.022 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-08T19:02:00.135 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-08T19:02:00.227 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-08T19:02:00.347 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-08T19:02:00.423 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-08T19:02:00.557 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-10-08T19:02:00.622 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-10-08T19:02:00.765 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-08T19:02:00.839 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-08T19:02:00.949 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-08T19:02:01.051 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-08T19:02:01.146 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-08T19:02:01.268 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-08T19:02:01.350 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-08T19:02:01.490 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-08T19:02:01.566 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-08T19:02:01.683 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-08T19:02:01.773 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-08T19:02:01.880 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-08T19:02:03.345 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-10-08T19:02:03.471 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-10-08T19:02:05.015 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-10-08T19:02:05.347 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-10-08T19:02:06.533 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-10-08T19:02:06.827 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-10-08T19:02:08.032 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-10-08T19:02:08.317 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-10-08T19:02:09.502 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-10-08T19:02:09.755 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-10-08T19:02:11.025 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-10-08T19:02:11.270 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-10-08T19:02:12.486 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-10-08T19:02:12.801 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-10-08T19:02:13.973 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-10-08T19:02:14.327 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-10-08T19:02:15.532 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-10-08T19:02:15.898 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-10-08T19:02:17.058 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-10-08T19:02:17.433 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-10-08T19:02:18.569 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-10-08T19:02:18.954 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-10-08T19:02:20.185 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-10-08T19:02:20.564 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-10-08T19:02:21.684 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-10-08T19:02:22.069 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-10-08T19:02:23.279 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-10-08T19:02:23.618 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-10-08T19:02:24.885 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-10-08T19:02:25.149 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-10-08T19:02:26.517 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "name": "melissali", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10117} 2021-10-08T19:02:26.687 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "name": "melissali", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10117} 2021-10-08T19:02:28.113 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10118, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10118} 2021-10-08T19:02:28.281 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10118, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10118} 2021-10-08T19:02:29.680 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10119, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10119} 2021-10-08T19:02:29.847 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10119, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10119} 2021-10-08T19:02:31.323 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10120, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10120} 2021-10-08T19:02:31.514 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10120, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10120} 2021-10-08T19:02:32.953 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10121, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10121} 2021-10-08T19:02:33.104 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:02:33 +0000 (0:00:58.232) 0:01:05.508 ******** 2021-10-08T19:02:33.124 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10121, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10121} 2021-10-08T19:02:33.261 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-08T19:02:33.286 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:02:33 +0000 (0:00:00.182) 0:01:05.690 ******** 2021-10-08T19:02:33.310 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:02:33 +0000 (0:00:00.024) 0:01:05.714 ******** 2021-10-08T19:02:33.375 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-10-08T19:02:33.377 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-10-08T19:02:33.379 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-10-08T19:02:33.381 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-10-08T19:02:33.382 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-10-08T19:02:33.384 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-10-08T19:02:33.387 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-10-08T19:02:33.388 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95 2021-10-08T19:02:33.389 INFO:teuthology.task.ansible.out:579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-08T19:02:33.390 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-10-08T19:02:33.392 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-10-08T19:02:33.394 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-10-08T19:02:33.395 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, 2021-10-08T19:02:33.396 INFO:teuthology.task.ansible.out:{"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-10-08T19:02:33.398 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878 2021-10-08T19:02:33.400 INFO:teuthology.task.ansible.out:bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": 2021-10-08T19:02:33.402 INFO:teuthology.task.ansible.out: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-08T19:02:33.425 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:02:33 +0000 (0:00:00.114) 0:01:05.829 ******** 2021-10-08T19:02:33.450 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:02:33 +0000 (0:00:00.023) 0:01:05.853 ******** 2021-10-08T19:02:33.722 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-10-08T19:02:33.731 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-10-08T19:02:33.734 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-10-08T19:02:33.736 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-10-08T19:02:33.740 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-10-08T19:02:33.744 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-10-08T19:02:33.750 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-08T19:02:33.752 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-10-08T19:02:33.754 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-10-08T19:02:33.755 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-10-08T19:02:33.757 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432a 2021-10-08T19:02:33.757 INFO:teuthology.task.ansible.out:ac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-10-08T19:02:33.759 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878 2021-10-08T19:02:33.760 INFO:teuthology.task.ansible.out:bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": 2021-10-08T19:02:33.762 INFO:teuthology.task.ansible.out: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-08T19:02:33.786 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:02:33 +0000 (0:00:00.337) 0:01:06.191 ******** 2021-10-08T19:02:34.466 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-10-08T19:02:34.469 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"after": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "attempts": 1, "before": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "changed": false, "remote_url_changed": false} 2021-10-08T19:02:34.489 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:02:34 +0000 (0:00:00.703) 0:01:06.894 ******** 2021-10-08T19:02:34.512 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"after": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "attempts": 1, "before": "ee931718ec906fcbc1b8afc120f625a06f1ece1a", "changed": false, "remote_url_changed": false} 2021-10-08T19:02:34.543 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:02:34 +0000 (0:00:00.051) 0:01:06.945 ******** 2021-10-08T19:02:34.860 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-08T19:02:34.871 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-08T19:02:34.935 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-08T19:02:35.120 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-08T19:02:35.194 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-08T19:02:35.389 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-08T19:02:35.475 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-08T19:02:35.638 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-08T19:02:35.640 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-08T19:02:35.735 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-08T19:02:35.737 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-08T19:02:35.873 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-08T19:02:35.976 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-08T19:02:36.108 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-08T19:02:36.110 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-08T19:02:36.204 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-08T19:02:36.205 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-08T19:02:36.344 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-08T19:02:36.443 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-08T19:02:36.583 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-08T19:02:36.674 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-08T19:02:36.841 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-08T19:02:36.843 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:02:36.922 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-08T19:02:36.933 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:02:37.082 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-08T19:02:37.084 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-08T19:02:37.171 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-08T19:02:37.174 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-08T19:02:37.326 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-08T19:02:37.329 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-08T19:02:37.334 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVN 2021-10-08T19:02:37.336 INFO:teuthology.task.ansible.out:TUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:02:37.410 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-08T19:02:37.413 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-08T19:02:37.421 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:02:37.441 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:02:37.569 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-08T19:02:37.680 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-08T19:02:37.818 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-08T19:02:37.820 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-08T19:02:37.924 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-08T19:02:37.926 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-08T19:02:38.051 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-08T19:02:38.151 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-08T19:02:38.293 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-08T19:02:38.399 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-08T19:02:38.512 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-08T19:02:38.621 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-08T19:02:38.750 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-08T19:02:38.752 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-08T19:02:38.870 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-08T19:02:38.871 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-08T19:02:38.987 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-08T19:02:38.989 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-08T19:02:39.223 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-08T19:02:39.259 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-08T19:02:39.261 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-08T19:02:39.450 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-08T19:02:39.492 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-08T19:02:39.732 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-08T19:02:39.826 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-10-08T19:02:39.828 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-08T19:02:39.963 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-10-08T19:02:39.964 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-08T19:02:40.062 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-08T19:02:40.207 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-08T19:02:40.303 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-08T19:02:40.442 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-08T19:02:40.675 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-08T19:02:40.677 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-08T19:02:40.770 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-08T19:02:40.919 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-08T19:02:41.012 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-08T19:02:41.173 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-08T19:02:41.256 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-08T19:02:41.258 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-08T19:02:41.403 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-08T19:02:41.405 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-08T19:02:41.479 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-08T19:02:41.638 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-08T19:02:41.714 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-08T19:02:41.888 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-08T19:02:41.951 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-08T19:02:42.116 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-08T19:02:42.180 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-08T19:02:42.351 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-08T19:02:42.415 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:02:42.583 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:02:42.650 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-08T19:02:42.818 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-08T19:02:42.882 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-08T19:02:43.056 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-08T19:02:43.119 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-08T19:02:43.121 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-08T19:02:43.287 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-08T19:02:43.290 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-08T19:02:43.352 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-08T19:02:43.354 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-08T19:02:43.521 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-08T19:02:43.524 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-08T19:02:43.598 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-08T19:02:43.756 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-08T19:02:43.842 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-08T19:02:43.992 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-08T19:02:44.067 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-08T19:02:44.226 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-08T19:02:44.301 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-08T19:02:44.304 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:02:44.463 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-08T19:02:44.465 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:02:44.539 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-08T19:02:44.541 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-08T19:02:44.542 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-08T19:02:44.710 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-08T19:02:44.713 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-08T19:02:44.716 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-08T19:02:44.786 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-08T19:02:44.928 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-08T19:02:45.013 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-08T19:02:45.182 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-08T19:02:45.258 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-08T19:02:45.407 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-08T19:02:45.498 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-08T19:02:45.664 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-08T19:02:45.737 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-08T19:02:45.954 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-08T19:02:45.977 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-08T19:02:45.980 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-08T19:02:46.210 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-08T19:02:46.212 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-08T19:02:46.230 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-08T19:02:46.446 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-08T19:02:46.457 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-08T19:02:46.682 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-08T19:02:46.704 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-08T19:02:46.706 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-08T19:02:46.906 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-08T19:02:46.908 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-08T19:02:46.928 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-08T19:02:47.137 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-08T19:02:47.169 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-08T19:02:47.383 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-08T19:02:47.397 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-08T19:02:47.398 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-08T19:02:47.619 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-08T19:02:47.621 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-08T19:02:47.631 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-08T19:02:47.852 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-08T19:02:47.874 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-08T19:02:48.097 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-08T19:02:48.119 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-08T19:02:48.330 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-08T19:02:48.363 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:02:48.566 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-08T19:02:48.599 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-08T19:02:48.798 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-08T19:02:48.831 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-08T19:02:49.034 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-08T19:02:49.064 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-08T19:02:49.265 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-08T19:02:49.287 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-08T19:02:49.496 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-08T19:02:49.528 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-08T19:02:49.736 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-08T19:02:49.762 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-08T19:02:49.954 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-08T19:02:49.988 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-08T19:02:50.188 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-08T19:02:50.221 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-08T19:02:50.430 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-08T19:02:50.463 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-08T19:02:50.657 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-08T19:02:50.687 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-08T19:02:50.898 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-08T19:02:50.921 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-08T19:02:51.127 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-08T19:02:51.160 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-08T19:02:51.377 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-08T19:02:51.386 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-08T19:02:51.610 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-08T19:02:51.621 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-08T19:02:51.840 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-08T19:02:51.862 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-08T19:02:52.068 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-08T19:02:52.137 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-08T19:02:52.306 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-08T19:02:52.370 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-08T19:02:52.373 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-08T19:02:52.553 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-08T19:02:52.555 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-08T19:02:52.596 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-08T19:02:52.776 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-08T19:02:52.831 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-08T19:02:53.014 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-08T19:02:53.067 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-08T19:02:53.256 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-08T19:02:53.302 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-08T19:02:53.304 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-08T19:02:53.494 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-08T19:02:53.497 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-08T19:02:53.571 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-08T19:02:53.725 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-08T19:02:53.814 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-08T19:02:53.986 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-08T19:02:54.063 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-08T19:02:54.249 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-08T19:02:54.311 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-08T19:02:54.512 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-08T19:02:54.549 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-08T19:02:54.806 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-08T19:02:54.839 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-08T19:02:55.071 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-08T19:02:55.106 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-08T19:02:55.295 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-08T19:02:55.351 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-08T19:02:55.353 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-08T19:02:55.566 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-08T19:02:55.571 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-08T19:02:55.589 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-08T19:02:55.806 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-08T19:02:55.828 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-08T19:02:56.049 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-08T19:02:56.065 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-08T19:02:56.344 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-08T19:02:56.389 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-08T19:02:56.584 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-08T19:02:56.629 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-08T19:02:56.821 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-08T19:02:56.864 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-08T19:02:57.065 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-08T19:02:57.073 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:02:57.098 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-08T19:02:57.307 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-08T19:02:57.324 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-08T19:02:57.336 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-08T19:02:57.528 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-08T19:02:57.562 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-08T19:02:57.764 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-08T19:02:57.818 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-08T19:02:57.993 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-08T19:02:58.058 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-08T19:02:58.227 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-08T19:02:58.293 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-08T19:02:58.466 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-08T19:02:58.520 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-08T19:02:58.712 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-08T19:02:58.777 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-08T19:02:58.947 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-08T19:02:59.013 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-08T19:02:59.172 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-08T19:02:59.245 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-08T19:02:59.415 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-08T19:02:59.481 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-08T19:02:59.656 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-08T19:02:59.708 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-08T19:02:59.903 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-08T19:02:59.949 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-08T19:03:00.143 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-08T19:03:00.195 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-08T19:03:00.366 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-08T19:03:00.432 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-08T19:03:00.603 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-08T19:03:00.670 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-08T19:03:00.841 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-08T19:03:00.904 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-08T19:03:01.078 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-08T19:03:01.152 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-08T19:03:01.304 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-08T19:03:01.403 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-08T19:03:01.547 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-08T19:03:01.549 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-08T19:03:01.645 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-08T19:03:01.784 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-08T19:03:01.897 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-08T19:03:01.900 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-08T19:03:02.016 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-08T19:03:02.144 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-08T19:03:02.249 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-08T19:03:02.372 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-08T19:03:02.482 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-08T19:03:02.588 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-08T19:03:02.720 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-08T19:03:02.838 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-08T19:03:02.944 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-08T19:03:03.061 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-08T19:03:03.178 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-08T19:03:03.289 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-08T19:03:03.415 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-08T19:03:03.522 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-08T19:03:03.640 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-08T19:03:03.751 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-08T19:03:03.890 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-08T19:03:03.986 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-08T19:03:04.124 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-08T19:03:04.228 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-08T19:03:04.367 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-08T19:03:04.462 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-08T19:03:04.617 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-08T19:03:04.695 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-08T19:03:04.858 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-08T19:03:04.934 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-08T19:03:05.109 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-08T19:03:05.185 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-08T19:03:05.347 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-08T19:03:05.349 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-08T19:03:05.410 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-08T19:03:05.587 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-08T19:03:05.650 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-08T19:03:05.652 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-08T19:03:05.817 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-08T19:03:05.882 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-08T19:03:06.052 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-08T19:03:06.139 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-08T19:03:06.277 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-08T19:03:06.363 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-08T19:03:06.512 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-08T19:03:06.601 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-08T19:03:06.755 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-08T19:03:06.929 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-08T19:03:07.005 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-08T19:03:07.187 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-08T19:03:07.245 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-08T19:03:07.415 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-08T19:03:07.479 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-08T19:03:07.644 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-08T19:03:07.708 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-08T19:03:07.877 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-08T19:03:07.941 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-08T19:03:08.113 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-08T19:03:08.178 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-08T19:03:08.347 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-08T19:03:08.410 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-08T19:03:08.582 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-08T19:03:08.642 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-08T19:03:08.821 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-08T19:03:08.874 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-08T19:03:09.064 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-08T19:03:09.107 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-08T19:03:09.312 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-08T19:03:09.345 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-08T19:03:09.538 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-08T19:03:09.582 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-08T19:03:09.772 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-08T19:03:09.826 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-08T19:03:10.004 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-08T19:03:10.067 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-08T19:03:10.247 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-08T19:03:10.292 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-08T19:03:10.482 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-08T19:03:10.525 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-08T19:03:10.755 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-08T19:03:10.777 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:10 +0000 (0:00:36.236) 0:01:43.182 ******** 2021-10-08T19:03:10.861 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-08T19:03:10.863 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:10.872 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:10.874 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:10.894 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:10.896 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:10.906 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:10.917 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:10.919 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:10.960 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-08T19:03:10.962 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-08T19:03:11.050 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:11 +0000 (0:00:00.272) 0:01:43.454 ******** 2021-10-08T19:03:11.142 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-08T19:03:11.145 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.154 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.166 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.168 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-10-08T19:03:11.169 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'aemer 2021-10-08T19:03:11.171 INFO:teuthology.task.ansible.out:son', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.179 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.181 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.191 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.202 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.406 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-08T19:03:11.438 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-08T19:03:11.440 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.450 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.630 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-08T19:03:11.641 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.653 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.664 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.675 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.678 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e75 2021-10-08T19:03:11.679 INFO:teuthology.task.ansible.out:4434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.687 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.698 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.701 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.712 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.714 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.723 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.733 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.737 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.745 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.756 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.758 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.768 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.790 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.792 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.802 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.813 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.815 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.825 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.889 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smi 2021-10-08T19:03:11.891 INFO:teuthology.task.ansible.out:thi112.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.896 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.898 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.908 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-08T19:03:11.910 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.921 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454 2021-10-08T19:03:11.923 INFO:teuthology.task.ansible.out:742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.932 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.934 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.934 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.945 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.948 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd13 2021-10-08T19:03:11.949 INFO:teuthology.task.ansible.out:5afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.959 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.961 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.971 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.973 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.974 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.975 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.986 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.988 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:11.999 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.000 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.011 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.013 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.023 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.024 INFO:teuthology.task.ansible.out: skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.025 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0 2021-10-08T19:03:12.026 INFO:teuthology.task.ansible.out:ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.036 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.038 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.049 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.051 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.061 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.063 INFO:teuthology.task.ansible.out: 2021-10-08T19:03:12.063 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.063 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.064 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.064 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.077 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.079 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.095 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.103 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.104 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.105 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.115 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.117 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.117 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a89 2021-10-08T19:03:12.119 INFO:teuthology.task.ansible.out:9130"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.129 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.130 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.140 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.142 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.153 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.154 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.155 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.166 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.168 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.178 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.180 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.182 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.192 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.194 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.205 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.206 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.217 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.218 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.229 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.231 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.231 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.243 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.254 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.255 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.266 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.268 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.279 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.281 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.281 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.292 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.294 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.305 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.306 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.306 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.318 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.320 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.331 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.333 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.344 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.346 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.356 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.359 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.370 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.371 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.371 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.372 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.385 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "o 2021-10-08T19:03:12.387 INFO:teuthology.task.ansible.out:vpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.396 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.398 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.409 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.410 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.422 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.423 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.434 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.436 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.447 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.450 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.458 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.459 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.470 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.472 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.482 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.484 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.494 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.496 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.506 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.507 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.518 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.519 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.530 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.532 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.542 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.543 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.544 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.556 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.567 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.569 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.579 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.581 INFO:teuthology.task.ansible.out: skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.582 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.582 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.595 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.598 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.607 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.610 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.620 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.620 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.621 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.632 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.634 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.664 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.666 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.689 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:12 +0000 (0:00:01.639) 0:01:45.094 ******** 2021-10-08T19:03:12.699 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.699 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.701 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.713 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.715 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.724 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.725 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.726 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.738 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.748 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.750 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.760 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.761 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.785 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:12 +0000 (0:00:00.095) 0:01:45.189 ******** 2021-10-08T19:03:12.798 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.800 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.810 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.812 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.822 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.833 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.834 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.845 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.856 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.858 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.867 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.868 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.880 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:12.925 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:12 +0000 (0:00:00.140) 0:01:45.329 ******** 2021-10-08T19:03:12.997 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-10-08T19:03:12.999 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:13.024 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:13 +0000 (0:00:00.099) 0:01:45.429 ******** 2021-10-08T19:03:13.068 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-10-08T19:03:13.069 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-08T19:03:13.269 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-08T19:03:13.318 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-08T19:03:13.454 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-08T19:03:13.517 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-08T19:03:13.643 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-08T19:03:13.707 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-08T19:03:13.834 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-08T19:03:13.898 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-08T19:03:14.029 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-08T19:03:14.093 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-08T19:03:14.220 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-08T19:03:14.284 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-08T19:03:14.421 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-08T19:03:14.485 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-08T19:03:14.614 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-08T19:03:14.667 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-08T19:03:14.804 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-08T19:03:14.869 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-08T19:03:15.005 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-08T19:03:15.058 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-08T19:03:15.188 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-08T19:03:15.252 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-08T19:03:15.382 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-08T19:03:15.446 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-08T19:03:15.573 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-08T19:03:15.637 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-08T19:03:15.763 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-08T19:03:15.827 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-08T19:03:15.956 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-08T19:03:16.021 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-08T19:03:16.148 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-08T19:03:16.224 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-08T19:03:16.343 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-08T19:03:16.417 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-08T19:03:16.534 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-08T19:03:16.609 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-08T19:03:16.725 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-08T19:03:16.800 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-08T19:03:16.917 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-08T19:03:16.994 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-08T19:03:17.115 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-08T19:03:17.234 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-08T19:03:17.315 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-08T19:03:17.432 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-08T19:03:17.507 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-08T19:03:17.624 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-08T19:03:17.712 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-08T19:03:17.819 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-08T19:03:17.904 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-08T19:03:18.020 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-08T19:03:18.094 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-08T19:03:18.209 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-08T19:03:18.295 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-08T19:03:18.402 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-08T19:03:18.487 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-08T19:03:18.591 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-08T19:03:18.677 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-08T19:03:18.787 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-08T19:03:18.881 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-08T19:03:18.977 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-08T19:03:19.075 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-08T19:03:19.171 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-08T19:03:19.268 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-08T19:03:19.376 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-08T19:03:19.463 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-08T19:03:19.570 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-08T19:03:19.670 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-08T19:03:19.765 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-08T19:03:19.873 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-08T19:03:19.957 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-08T19:03:20.062 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-08T19:03:20.148 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-08T19:03:20.271 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-08T19:03:20.346 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-08T19:03:20.452 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-08T19:03:20.549 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-08T19:03:20.753 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-08T19:03:22.036 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-10-08T19:03:22.300 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-10-08T19:03:23.534 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-10-08T19:03:23.885 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-10-08T19:03:25.073 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-10-08T19:03:25.429 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-10-08T19:03:26.599 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-10-08T19:03:26.980 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-10-08T19:03:28.357 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-10-08T19:03:28.516 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-10-08T19:03:29.814 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-10-08T19:03:30.014 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-08T19:03:30.040 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-10-08T19:03:30.217 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-08T19:03:30.239 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-08T19:03:30.409 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-08T19:03:30.453 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-08T19:03:30.613 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-08T19:03:30.645 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-08T19:03:30.792 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-08T19:03:30.835 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-08T19:03:30.991 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-08T19:03:31.034 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-08T19:03:31.183 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-08T19:03:31.226 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-08T19:03:31.368 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-08T19:03:31.421 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-08T19:03:31.558 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-08T19:03:31.613 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-08T19:03:31.749 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-08T19:03:31.810 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:31 +0000 (0:00:18.785) 0:02:04.215 ******** 2021-10-08T19:03:31.818 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-08T19:03:31.991 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-08T19:03:32.049 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:32 +0000 (0:00:00.238) 0:02:04.453 ******** 2021-10-08T19:03:32.356 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-10-08T19:03:32.360 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "checksum": "12c5dc5e271ed86fec0116e9b72d51cbad447485", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e85382e2ab97f552f968a3d84b6a725a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633719811.9078572-1532-153176069493038/source", "state": "file", "uid": 0} 2021-10-08T19:03:32.388 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:32 +0000 (0:00:00.338) 0:02:04.792 ******** 2021-10-08T19:03:32.471 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi112.front.sepia.ceph.com] => { "msg": "Host smithi112.front.sepia.ceph.com is running RedHat 8.4 (Ootpa)" } 2021-10-08T19:03:32.498 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:32 +0000 (0:00:00.109) 0:02:04.901 ******** 2021-10-08T19:03:32.507 INFO:teuthology.task.ansible.out: 2021-10-08T19:03:32.608 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2021-10-08T19:03:32.650 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:32 +0000 (0:00:00.152) 0:02:05.054 ******** 2021-10-08T19:03:32.747 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-10-08T19:03:32.748 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:32.772 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:32 +0000 (0:00:00.121) 0:02:05.176 ******** 2021-10-08T19:03:32.780 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-10-08T19:03:32.782 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "checksum": "12c5dc5e271ed86fec0116e9b72d51cbad447485", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e85382e2ab97f552f968a3d84b6a725a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1633719812.159523-1575-267664909801085/source", "state": "file", "uid": 0} 2021-10-08T19:03:32.807 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:32 +0000 (0:00:00.034) 0:02:05.211 ******** 2021-10-08T19:03:32.887 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-10-08T19:03:32.889 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => { "msg": "Host smithi142.front.sepia.ceph.com is running RedHat 8.4 (Ootpa)" } 2021-10-08T19:03:32.912 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:32 +0000 (0:00:00.105) 0:02:05.317 ******** 2021-10-08T19:03:32.995 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2021-10-08T19:03:33.023 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.110) 0:02:05.427 ******** 2021-10-08T19:03:33.085 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-10-08T19:03:33.086 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.063647", "end": "2021-10-08 19:03:33.061753", "rc": 0, "start": "2021-10-08 19:03:32.998106", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-08T19:03:33.110 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.087) 0:02:05.515 ******** 2021-10-08T19:03:33.125 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-10-08T19:03:33.127 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.153 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.042) 0:02:05.557 ******** 2021-10-08T19:03:33.184 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.218 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.065) 0:02:05.623 ******** 2021-10-08T19:03:33.296 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-10-08T19:03:33.298 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.321 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.102) 0:02:05.725 ******** 2021-10-08T19:03:33.405 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.432 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.110) 0:02:05.836 ******** 2021-10-08T19:03:33.494 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-10-08T19:03:33.496 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.067496", "end": "2021-10-08 19:03:33.477534", "rc": 0, "start": "2021-10-08 19:03:33.410038", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-08T19:03:33.520 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.087) 0:02:05.924 ******** 2021-10-08T19:03:33.536 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-10-08T19:03:33.538 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.566 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.040) 0:02:05.965 ******** 2021-10-08T19:03:33.598 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-10-08T19:03:33.600 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.625 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.063) 0:02:06.028 ******** 2021-10-08T19:03:33.642 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-10-08T19:03:33.643 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.665 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.041) 0:02:06.070 ******** 2021-10-08T19:03:33.693 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-10-08T19:03:33.695 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.721 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.054) 0:02:06.125 ******** 2021-10-08T19:03:33.749 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-10-08T19:03:33.752 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-10-08T19:03:33.776 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.054) 0:02:06.179 ******** 2021-10-08T19:03:33.793 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-10-08T19:03:33.796 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.820 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.044) 0:02:06.224 ******** 2021-10-08T19:03:33.861 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-08T19:03:33.862 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:03:33.864 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:03:33.887 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.067) 0:02:06.292 ******** 2021-10-08T19:03:33.894 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-10-08T19:03:33.896 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:33.921 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.033) 0:02:06.325 ******** 2021-10-08T19:03:33.961 INFO:teuthology.task.ansible.out: 2021-10-08T19:03:33.963 INFO:teuthology.task.ansible.out:TASK [common : Set have_entitlements] ****************************************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-10-08T19:03:33.986 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:33 +0000 (0:00:00.065) 0:02:06.391 ******** 2021-10-08T19:03:34.004 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-10-08T19:03:34.006 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:34.031 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:34 +0000 (0:00:00.044) 0:02:06.436 ******** 2021-10-08T19:03:34.122 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-10-08T19:03:34.124 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-10-08T19:03:34.145 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:34 +0000 (0:00:00.113) 0:02:06.549 ******** 2021-10-08T19:03:34.251 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-08T19:03:34.253 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:03:34.277 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:34 +0000 (0:00:00.132) 0:02:06.682 ******** 2021-10-08T19:03:34.358 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-10-08T19:03:34.360 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-10-08T19:03:34.385 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:34 +0000 (0:00:00.107) 0:02:06.789 ******** 2021-10-08T19:03:35.242 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-10-08T19:03:35.244 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1633719815.1019568-o0pp8f_k/katello-ca-consumer-latest.noarchi7nwq__o.rpm"]} 2021-10-08T19:03:35.266 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:35 +0000 (0:00:00.881) 0:02:07.671 ******** 2021-10-08T19:03:35.398 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1633719815.2528753-d85xw3i4/katello-ca-consumer-latest.noarch6_4trh4z.rpm"]} 2021-10-08T19:03:35.422 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:35 +0000 (0:00:00.155) 0:02:07.826 ******** 2021-10-08T19:03:36.021 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-10-08T19:03:36.023 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "532cb5b70a3f71ce180c165205647e8909d4e8a0", "dest": "/etc/yum/vars/releasever", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/yum/vars/releasever", "secontext": "system_u:object_r:etc_t:s0", "size": 3, "state": "file", "uid": 0} ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "532cb5b70a3f71ce180c165205647e8909d4e8a0", "dest": "/etc/yum/vars/releasever", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/yum/vars/releasever", "secontext": "system_u:object_r:etc_t:s0", "size": 3, "state": "file", "uid": 0} 2021-10-08T19:03:36.046 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:36 +0000 (0:00:00.624) 0:02:08.451 ******** 2021-10-08T19:03:36.071 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:36 +0000 (0:00:00.024) 0:02:08.475 ******** 2021-10-08T19:03:36.699 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-10-08T19:03:36.701 INFO:teuthology.task.ansible.out:fatal: [smithi112.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-10-08T19:03:36.722 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:36 +0000 (0:00:00.651) 0:02:09.126 ******** 2021-10-08T19:03:36.740 INFO:teuthology.task.ansible.out:fatal: [smithi142.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:03:36.741 INFO:teuthology.task.ansible.out:...ignoring 2021-10-08T19:03:36.764 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:36 +0000 (0:00:00.042) 0:02:09.169 ******** 2021-10-08T19:03:36.802 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-10-08T19:03:36.804 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-10-08T19:03:36.828 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:36 +0000 (0:00:00.063) 0:02:09.232 ******** 2021-10-08T19:03:36.845 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-10-08T19:03:36.868 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:36 +0000 (0:00:00.040) 0:02:09.273 ******** 2021-10-08T19:03:53.676 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-10-08T19:03:53.678 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:03:53.702 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:53 +0000 (0:00:16.832) 0:02:26.106 ******** 2021-10-08T19:03:53.793 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-10-08T19:03:53.817 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:53 +0000 (0:00:00.115) 0:02:26.221 ******** 2021-10-08T19:03:54.475 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-10-08T19:03:54.477 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.421156", "end": "2021-10-08 19:03:54.450636", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:03:54.029480", "stderr": "", "stderr_lines": [], "stdout": "7.8\n7.9\n7Server\n8\n8.2\n8.3\n8.4", "stdout_lines": ["7.8", "7.9", "7Server", "8", "8.2", "8.3", "8.4"]} 2021-10-08T19:03:54.499 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:54 +0000 (0:00:00.681) 0:02:26.903 ******** 2021-10-08T19:03:54.570 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-10-08T19:03:54.572 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:54.593 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:54 +0000 (0:00:00.094) 0:02:26.998 ******** 2021-10-08T19:03:54.677 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-10-08T19:03:54.678 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:54.700 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:54 +0000 (0:00:00.106) 0:02:27.105 ******** 2021-10-08T19:03:54.772 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-10-08T19:03:54.775 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:03:54.807 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:54 +0000 (0:00:00.106) 0:02:27.211 ******** 2021-10-08T19:03:54.900 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-08T19:03:54.902 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:54.923 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:54 +0000 (0:00:00.116) 0:02:27.327 ******** 2021-10-08T19:03:55.025 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:03:55.054 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:55 +0000 (0:00:00.131) 0:02:27.459 ******** 2021-10-08T19:03:55.145 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-10-08T19:03:55.147 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-10-08T19:03:55.168 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:55 +0000 (0:00:00.113) 0:02:27.573 ******** 2021-10-08T19:03:55.844 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-10-08T19:03:55.846 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.431901", "end": "2021-10-08 19:03:55.827579", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:03:55.395678", "stderr": "", "stderr_lines": [], "stdout": "7.8\n7.9\n7Server\n8\n8.2\n8.3\n8.4", "stdout_lines": ["7.8", "7.9", "7Server", "8", "8.2", "8.3", "8.4"]} 2021-10-08T19:03:55.867 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:55 +0000 (0:00:00.698) 0:02:28.271 ******** 2021-10-08T19:03:55.945 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-10-08T19:03:55.947 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:55.970 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:55 +0000 (0:00:00.103) 0:02:28.374 ******** 2021-10-08T19:03:56.038 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-10-08T19:03:56.040 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:56.061 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:56 +0000 (0:00:00.091) 0:02:28.466 ******** 2021-10-08T19:03:56.120 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-10-08T19:03:56.122 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-08T19:03:56.143 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:56 +0000 (0:00:00.080) 0:02:28.547 ******** 2021-10-08T19:03:56.220 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:56.243 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:56 +0000 (0:00:00.100) 0:02:28.647 ******** 2021-10-08T19:03:57.837 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-08T19:03:57.839 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.678276", "end": "2021-10-08 19:03:57.818981", "rc": 0, "start": "2021-10-08 19:03:55.140705", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2021-10-08T19:03:57.867 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:57 +0000 (0:00:01.624) 0:02:30.272 ******** 2021-10-08T19:03:57.958 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-10-08T19:03:57.960 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2021-10-08T19:03:57.980 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:57 +0000 (0:00:00.113) 0:02:30.385 ******** 2021-10-08T19:03:58.050 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-10-08T19:03:58.052 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:58.072 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:58 +0000 (0:00:00.091) 0:02:30.477 ******** 2021-10-08T19:03:58.153 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-10-08T19:03:58.154 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2021-10-08T19:03:58.174 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:58 +0000 (0:00:00.102) 0:02:30.579 ******** 2021-10-08T19:03:58.266 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-10-08T19:03:58.267 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-10-08T19:03:58.292 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:58 +0000 (0:00:00.116) 0:02:30.696 ******** 2021-10-08T19:03:59.029 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-08T19:03:59.031 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.546061", "end": "2021-10-08 19:03:59.013544", "rc": 0, "start": "2021-10-08 19:03:56.467483", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2021-10-08T19:03:59.054 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:59 +0000 (0:00:00.762) 0:02:31.458 ******** 2021-10-08T19:03:59.135 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-10-08T19:03:59.137 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2021-10-08T19:03:59.158 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:59 +0000 (0:00:00.104) 0:02:31.562 ******** 2021-10-08T19:03:59.227 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:03:59.249 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:59 +0000 (0:00:00.090) 0:02:31.653 ******** 2021-10-08T19:03:59.328 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2021-10-08T19:03:59.351 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:59 +0000 (0:00:00.102) 0:02:31.756 ******** 2021-10-08T19:03:59.431 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-10-08T19:03:59.433 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-10-08T19:03:59.453 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:03:59 +0000 (0:00:00.102) 0:02:31.858 ******** 2021-10-08T19:04:00.529 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-10-08T19:04:00.531 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:04:00.551 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:00 +0000 (0:00:01.098) 0:02:32.956 ******** 2021-10-08T19:04:01.693 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:04:01.719 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:01 +0000 (0:00:01.167) 0:02:34.123 ******** 2021-10-08T19:04:04.108 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-10-08T19:04:04.110 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.303793", "end": "2021-10-08 19:04:04.084798", "rc": 0, "start": "2021-10-08 19:04:00.781005", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2021-10-08T19:04:04.133 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:04 +0000 (0:00:02.413) 0:02:36.537 ******** 2021-10-08T19:04:04.372 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-08T19:04:04.373 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-10-08T19:04:04.394 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:04 +0000 (0:00:00.261) 0:02:36.799 ******** 2021-10-08T19:04:04.634 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:04:04.655 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:04 +0000 (0:00:00.260) 0:02:37.060 ******** 2021-10-08T19:04:05.172 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-10-08T19:04:05.174 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-10-08T19:04:05.384 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-10-08T19:04:05.386 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.433186", "end": "2021-10-08 19:04:05.371454", "rc": 0, "start": "2021-10-08 19:04:01.938268", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2021-10-08T19:04:05.408 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:05 +0000 (0:00:00.752) 0:02:37.812 ******** 2021-10-08T19:04:05.626 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-10-08T19:04:05.629 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-10-08T19:04:05.651 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:05 +0000 (0:00:00.243) 0:02:38.056 ******** 2021-10-08T19:04:05.659 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-08T19:04:05.660 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-10-08T19:04:05.686 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:05 +0000 (0:00:00.035) 0:02:38.091 ******** 2021-10-08T19:04:05.955 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-10-08T19:04:05.957 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:04:05.979 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:05 +0000 (0:00:00.292) 0:02:38.384 ******** 2021-10-08T19:04:06.176 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-08T19:04:06.178 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-10-08T19:04:06.503 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-10-08T19:04:06.505 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-10-08T19:04:06.620 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-08T19:04:06.622 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-10-08T19:04:06.648 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:06 +0000 (0:00:00.669) 0:02:39.053 ******** 2021-10-08T19:04:06.740 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:06.763 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:06 +0000 (0:00:00.114) 0:02:39.167 ******** 2021-10-08T19:04:06.832 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:06.854 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:06 +0000 (0:00:00.091) 0:02:39.259 ******** 2021-10-08T19:04:06.924 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:06.950 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:06 +0000 (0:00:00.095) 0:02:39.355 ******** 2021-10-08T19:04:06.960 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-10-08T19:04:06.962 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-10-08T19:04:06.994 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:06 +0000 (0:00:00.044) 0:02:39.399 ******** 2021-10-08T19:04:07.025 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-10-08T19:04:07.026 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:07.054 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:07 +0000 (0:00:00.059) 0:02:39.459 ******** 2021-10-08T19:04:07.140 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-08T19:04:07.142 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:07.142 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:07.155 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:07.179 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:07 +0000 (0:00:00.124) 0:02:39.583 ******** 2021-10-08T19:04:07.249 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-08T19:04:07.251 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:07.273 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:07 +0000 (0:00:00.093) 0:02:39.677 ******** 2021-10-08T19:04:07.347 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:07.369 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:07 +0000 (0:00:00.097) 0:02:39.774 ******** 2021-10-08T19:04:07.441 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:07.463 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:07 +0000 (0:00:00.093) 0:02:39.867 ******** 2021-10-08T19:04:07.531 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi142.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-10-08T19:04:07.556 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:07 +0000 (0:00:00.091) 0:02:39.959 ******** 2021-10-08T19:04:07.627 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:07.648 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:07 +0000 (0:00:00.093) 0:02:40.053 ******** 2021-10-08T19:04:07.996 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-08T19:04:07.998 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-10-08T19:04:08.021 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.372) 0:02:40.426 ******** 2021-10-08T19:04:08.102 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.127 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.104) 0:02:40.530 ******** 2021-10-08T19:04:08.195 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-08T19:04:08.196 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.217 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.091) 0:02:40.622 ******** 2021-10-08T19:04:08.298 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-10-08T19:04:08.300 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.322 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.104) 0:02:40.727 ******** 2021-10-08T19:04:08.404 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.437 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.115) 0:02:40.842 ******** 2021-10-08T19:04:08.519 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-08T19:04:08.521 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.678090", "end": "2021-10-08 19:04:08.500344", "rc": 0, "start": "2021-10-08 19:04:07.822254", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Mask sleep units] *********************************************** skipping: [smithi142.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.523 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.545 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.108) 0:02:40.950 ******** 2021-10-08T19:04:08.554 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.555 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.581 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.035) 0:02:40.985 ******** 2021-10-08T19:04:08.655 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.681 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.099) 0:02:41.085 ******** 2021-10-08T19:04:08.750 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-10-08T19:04:08.752 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.773 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.092) 0:02:41.177 ******** 2021-10-08T19:04:08.844 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.866 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.093) 0:02:41.271 ******** 2021-10-08T19:04:08.948 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:08.970 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:08 +0000 (0:00:00.104) 0:02:41.375 ******** 2021-10-08T19:04:09.039 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-10-08T19:04:09.041 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:09.062 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:09 +0000 (0:00:00.091) 0:02:41.467 ******** 2021-10-08T19:04:09.521 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-08T19:04:09.522 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.263312", "end": "2021-10-08 19:04:09.500338", "rc": 0, "start": "2021-10-08 19:04:09.237026", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:04:09.544 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:09 +0000 (0:00:00.482) 0:02:41.949 ******** 2021-10-08T19:04:23.017 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:04:23.040 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:13.496) 0:02:55.445 ******** 2021-10-08T19:04:23.112 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:23.135 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:00.094) 0:02:55.540 ******** 2021-10-08T19:04:23.205 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-10-08T19:04:23.207 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:23.228 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:00.092) 0:02:55.632 ******** 2021-10-08T19:04:23.297 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-08T19:04:23.298 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:23.319 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:00.090) 0:02:55.723 ******** 2021-10-08T19:04:23.387 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-10-08T19:04:23.389 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:23.410 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:00.091) 0:02:55.815 ******** 2021-10-08T19:04:23.680 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-10-08T19:04:23.682 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:04:23.704 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:00.293) 0:02:56.109 ******** 2021-10-08T19:04:23.773 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-10-08T19:04:23.864 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:04:23 +0000 (0:00:00.092) 0:02:56.201 ******** 2021-10-08T19:04:23.872 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-10-08T19:04:23.875 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:23.895 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:00.098) 0:02:56.299 ******** 2021-10-08T19:04:23.901 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-10-08T19:04:23.903 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-10-08T19:04:23.927 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:00.031) 0:02:56.331 ******** 2021-10-08T19:04:23.965 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-08T19:04:23.967 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:23.990 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:23 +0000 (0:00:00.063) 0:02:56.394 ******** 2021-10-08T19:04:24.059 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-10-08T19:04:24.060 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:24.081 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:24 +0000 (0:00:00.090) 0:02:56.485 ******** 2021-10-08T19:04:24.571 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-10-08T19:04:24.573 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-10-08T19:04:24.595 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:24 +0000 (0:00:00.513) 0:02:56.999 ******** 2021-10-08T19:04:26.865 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-10-08T19:04:26.867 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:04:26.889 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:26 +0000 (0:00:02.294) 0:02:59.294 ******** 2021-10-08T19:04:27.408 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-08T19:04:27.409 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-10-08T19:04:27.503 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-10-08T19:04:27.505 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:04:27.530 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:27 +0000 (0:00:00.640) 0:02:59.934 ******** 2021-10-08T19:04:27.853 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-08T19:04:27.856 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-10-08T19:04:28.049 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-10-08T19:04:28.291 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-10-08T19:04:28.318 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:28 +0000 (0:00:00.788) 0:03:00.723 ******** 2021-10-08T19:04:28.487 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-10-08T19:04:28.509 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-08T19:04:28.511 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:04:28.532 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:28 +0000 (0:00:00.213) 0:03:00.936 ******** 2021-10-08T19:04:28.919 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-08T19:04:28.920 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-10-08T19:04:28.945 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:28 +0000 (0:00:00.412) 0:03:01.349 ******** 2021-10-08T19:04:29.026 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-08T19:04:29.028 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-10-08T19:04:29.132 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-08T19:04:29.135 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:04:29.155 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:29 +0000 (0:00:00.210) 0:03:01.560 ******** 2021-10-08T19:04:29.433 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-08T19:04:29.435 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-10-08T19:04:29.647 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-10-08T19:04:29.856 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-10-08T19:04:29.883 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:29 +0000 (0:00:00.727) 0:03:02.288 ******** 2021-10-08T19:04:29.966 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-08T19:04:29.968 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:29.989 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:29 +0000 (0:00:00.105) 0:03:02.393 ******** 2021-10-08T19:04:30.065 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi142.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-10-08T19:04:30.073 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-10-08T19:04:30.075 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-10-08T19:04:30.096 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:30 +0000 (0:00:00.107) 0:03:02.501 ******** 2021-10-08T19:04:30.327 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-10-08T19:04:30.329 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:04:30.351 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:30 +0000 (0:00:00.255) 0:03:02.756 ******** 2021-10-08T19:04:30.441 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-08T19:04:30.443 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:30.453 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:30.464 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:30.485 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:30.486 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-08T19:04:30.487 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-10-08T19:04:30.513 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:30 +0000 (0:00:00.161) 0:03:02.918 ******** 2021-10-08T19:04:30.537 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:30 +0000 (0:00:00.024) 0:03:02.942 ******** 2021-10-08T19:04:30.608 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-08T19:04:30.609 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:30.632 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:30 +0000 (0:00:00.094) 0:03:03.037 ******** 2021-10-08T19:04:30.713 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-10-08T19:04:30.715 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-10-08T19:04:30.737 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:30 +0000 (0:00:00.104) 0:03:03.141 ******** 2021-10-08T19:04:30.973 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-10-08T19:04:30.975 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-10-08T19:04:30.999 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:30 +0000 (0:00:00.261) 0:03:03.403 ******** 2021-10-08T19:04:31.081 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-08T19:04:31.082 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:31.092 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:31.114 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:31.125 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:31.148 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:31 +0000 (0:00:00.149) 0:03:03.553 ******** 2021-10-08T19:04:33.698 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-10-08T19:04:33.700 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:04:33.721 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:33 +0000 (0:00:02.572) 0:03:06.126 ******** 2021-10-08T19:04:33.792 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-10-08T19:04:33.793 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:33.824 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:33 +0000 (0:00:00.102) 0:03:06.228 ******** 2021-10-08T19:04:34.171 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-10-08T19:04:34.173 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:04:34.194 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:34 +0000 (0:00:00.369) 0:03:06.598 ******** 2021-10-08T19:04:34.273 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-10-08T19:04:34.275 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:34.297 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:34 +0000 (0:00:00.103) 0:03:06.702 ******** 2021-10-08T19:04:34.324 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-10-08T19:04:34.326 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-10-08T19:04:34.349 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:34 +0000 (0:00:00.051) 0:03:06.753 ******** 2021-10-08T19:04:34.789 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-10-08T19:04:34.815 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:34 +0000 (0:00:00.466) 0:03:07.220 ******** 2021-10-08T19:04:34.844 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-10-08T19:04:34.846 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-10-08T19:04:34.869 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:34 +0000 (0:00:00.054) 0:03:07.274 ******** 2021-10-08T19:04:34.952 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-08T19:04:34.954 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:34.964 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:34.986 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:34 +0000 (0:00:00.116) 0:03:07.390 ******** 2021-10-08T19:04:35.215 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-08T19:04:35.217 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:04:35.242 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:35 +0000 (0:00:00.254) 0:03:07.645 ******** 2021-10-08T19:04:35.311 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-10-08T19:04:35.313 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-10-08T19:04:35.340 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:35 +0000 (0:00:00.099) 0:03:07.744 ******** 2021-10-08T19:04:35.432 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-08T19:04:35.435 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-10-08T19:04:35.458 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:35 +0000 (0:00:00.118) 0:03:07.863 ******** 2021-10-08T19:04:35.538 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-10-08T19:04:35.541 INFO:teuthology.task.ansible.out:fatal: [smithi112.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-10-08T19:04:35.562 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:35 +0000 (0:00:00.103) 0:03:07.966 ******** 2021-10-08T19:04:35.631 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-08T19:04:35.633 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:35.654 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:35 +0000 (0:00:00.092) 0:03:08.059 ******** 2021-10-08T19:04:35.713 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-08T19:04:35.715 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:04:35.737 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:35 +0000 (0:00:00.082) 0:03:08.142 ******** 2021-10-08T19:04:36.005 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi142.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-10-08T19:04:36.031 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:36 +0000 (0:00:00.294) 0:03:08.436 ******** 2021-10-08T19:04:36.102 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-08T19:04:36.105 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:04:36.125 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:36 +0000 (0:00:00.093) 0:03:08.530 ******** 2021-10-08T19:04:36.164 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-10-08T19:04:36.166 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-10-08T19:04:36.191 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:36 +0000 (0:00:00.065) 0:03:08.595 ******** 2021-10-08T19:04:36.630 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-10-08T19:04:36.654 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:36 +0000 (0:00:00.463) 0:03:09.059 ******** 2021-10-08T19:04:36.884 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-08T19:04:36.885 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-10-08 19:00:48 UTC", "ActiveEnterTimestampMonotonic": "22020857", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target var-run.mount systemd-tmpfiles-setup.service basic.target systemd-journald.socket time-sync.target local-fs.target system.slice -.mount nss-lookup.target tmp.mount network-online.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-10-08 19:00:48 UTC", "AssertTimestampMonotonic": "22000133", "Before": "multi-user.target getty@tty1.service plymouth-quit.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-10-08 19:00:48 UTC", "ConditionT 2021-10-08T19:04:36.887 INFO:teuthology.task.ansible.out:imestampMonotonic": "22000132", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1267", "ExecMainStartTimestamp": "Fri 2021-10-08 19:00:48 UTC", "ExecMainStartTimestampMonotonic": "22020765", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Fri 2021-10-08 19:00:48 UTC] ; stop_time=[n/a] ; pid=1267 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "985", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-10-08 19:00:48 UTC", "InactiveExitTimestampMonotonic": "22020857", "In 2021-10-08T19:04:36.888 INFO:teuthology.task.ansible.out:vocationID": "c7fc4075a1c34c33a7cbddc7f8a3bb60", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127239", "LimitNPROCSoft": "127239", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127239", "LimitSIGPENDINGSoft": "127239", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1267", "MemoryAccounting": "yes", "MemoryCurrent": "667648", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGr 2021-10-08T19:04:36.890 INFO:teuthology.task.ansible.out:oups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-10-08 19:00:48 UTC", "StateChangeTimestampMonotonic": "22020857", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203583", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "989", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-10-08 19:00:48 UTC", "WatchdogTimestampMonotonic": "22020855", "WatchdogUSec": "0"}} 2021-10-08T19:04:36.911 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:36 +0000 (0:00:00.256) 0:03:09.316 ******** 2021-10-08T19:04:37.003 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-10-08 19:00:29 UTC", "ActiveEnterTimestampMonotonic": "21982688", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target var-run.mount tmp.mount -.mount system.slice basic.target systemd-tmpfiles-setup.service network-online.target time-sync.target systemd-journald.socket sysinit.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-10-08 19:00:29 UTC", "AssertTimestampMonotonic": "21978922", "Before": "xdm.service getty@tty1.service shutdown.target multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-10-08 19:00:29 UTC", "ConditionT 2021-10-08T19:04:37.005 INFO:teuthology.task.ansible.out:imestampMonotonic": "21978922", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1232", "ExecMainStartTimestamp": "Fri 2021-10-08 19:00:29 UTC", "ExecMainStartTimestampMonotonic": "21982657", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Fri 2021-10-08 19:00:29 UTC] ; stop_time=[n/a] ; pid=1232 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "985", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-10-08 19:00:29 UTC", "InactiveExitTimestampMonotonic": "21982688", "In 2021-10-08T19:04:37.007 INFO:teuthology.task.ansible.out:vocationID": "0ed1647fbd8346d7b85a1c2559be145d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127239", "LimitNPROCSoft": "127239", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127239", "LimitSIGPENDINGSoft": "127239", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1232", "MemoryAccounting": "yes", "MemoryCurrent": "671744", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGr 2021-10-08T19:04:37.009 INFO:teuthology.task.ansible.out:oups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-10-08 19:00:29 UTC", "StateChangeTimestampMonotonic": "21982688", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203583", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "989", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-10-08 19:00:29 UTC", "WatchdogTimestampMonotonic": "21982687", "WatchdogUSec": "0"}} 2021-10-08T19:04:37.027 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:37 +0000 (0:00:00.116) 0:03:09.432 ******** 2021-10-08T19:04:37.139 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-10-08T19:04:37.140 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001850", "end": "2021-10-08 19:04:37.122246", "rc": 0, "start": "2021-10-08 19:04:37.120396", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-10-08T19:04:37.162 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:37 +0000 (0:00:00.134) 0:03:09.567 ******** 2021-10-08T19:04:37.254 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001842", "end": "2021-10-08 19:04:37.238624", "rc": 0, "start": "2021-10-08 19:04:37.236782", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-10-08T19:04:37.280 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:37 +0000 (0:00:00.118) 0:03:09.685 ******** 2021-10-08T19:04:40.124 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:04:40.147 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:40 +0000 (0:00:02.866) 0:03:12.552 ******** 2021-10-08T19:04:40.294 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:04:40.318 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:04:40 +0000 (0:00:00.171) 0:03:12.723 ******** 2021-10-08T19:05:32.362 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.2.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.2.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8.noarch", "Removed: selinux-policy-3.14.3-67.el8.noarch"]} 2021-10-08T19:05:32.385 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:32 +0000 (0:00:52.067) 0:04:04.790 ******** 2021-10-08T19:05:32.480 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.2.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.2.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8.noarch", "Removed: selinux-policy-3.14.3-67.el8.noarch"]} 2021-10-08T19:05:32.504 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:32 +0000 (0:00:00.118) 0:04:04.909 ******** 2021-10-08T19:05:33.135 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-10-08T19:05:33.137 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-10-08T19:05:33.159 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:33 +0000 (0:00:00.655) 0:04:05.564 ******** 2021-10-08T19:05:33.182 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:33 +0000 (0:00:00.022) 0:04:05.586 ******** 2021-10-08T19:05:48.531 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-10-08T19:05:48.533 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:15.144405", "end": "2021-10-08 19:05:48.511311", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:05:33.366906", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-10-08T19:05:48.555 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:48 +0000 (0:00:15.373) 0:04:20.960 ******** 2021-10-08T19:05:48.605 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:15.192619", "end": "2021-10-08 19:05:48.585660", "failed_when_result": false, "rc": 0, "start": "2021-10-08 19:05:33.393041", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-10-08T19:05:48.630 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:48 +0000 (0:00:00.074) 0:04:21.034 ******** 2021-10-08T19:05:49.062 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-10-08T19:05:49.064 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-10-08T19:05:49.086 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:49 +0000 (0:00:00.456) 0:04:21.490 ******** 2021-10-08T19:05:49.125 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-10-08T19:05:49.149 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:49 +0000 (0:00:00.063) 0:04:21.554 ******** 2021-10-08T19:05:49.322 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-10-08T19:05:49.323 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.009569", "end": "2021-10-08 19:05:49.302020", "rc": 0, "start": "2021-10-08 19:05:49.292451", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:05:49.345 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:49 +0000 (0:00:00.196) 0:04:21.750 ******** 2021-10-08T19:05:49.383 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010517", "end": "2021-10-08 19:05:49.367045", "rc": 0, "start": "2021-10-08 19:05:49.356528", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:05:49.407 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:49 +0000 (0:00:00.061) 0:04:21.812 ******** 2021-10-08T19:05:49.579 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-10-08T19:05:49.581 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011689", "end": "2021-10-08 19:05:49.564371", "rc": 0, "start": "2021-10-08 19:05:49.552682", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:05:49.602 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:49 +0000 (0:00:00.194) 0:04:22.006 ******** 2021-10-08T19:05:49.640 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.009296", "end": "2021-10-08 19:05:49.622972", "rc": 0, "start": "2021-10-08 19:05:49.613676", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:05:49.663 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:05:49 +0000 (0:00:00.061) 0:04:22.068 ******** 2021-10-08T19:06:04.829 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-10-08T19:06:04.830 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:15.006356", "end": "2021-10-08 19:06:04.812658", "rc": 0, "start": "2021-10-08 19:05:49.806302", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:06:04.852 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:04 +0000 (0:00:15.188) 0:04:37.257 ******** 2021-10-08T19:06:05.029 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:15.143850", "end": "2021-10-08 19:06:05.010413", "rc": 0, "start": "2021-10-08 19:05:49.866563", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:06:05.064 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.211) 0:04:37.468 ******** 2021-10-08T19:06:05.093 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-10-08T19:06:05.118 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.054) 0:04:37.523 ******** 2021-10-08T19:06:05.200 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-10-08T19:06:05.202 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-10-08T19:06:05.223 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.104) 0:04:37.628 ******** 2021-10-08T19:06:05.293 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:06:05.315 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.092) 0:04:37.720 ******** 2021-10-08T19:06:05.334 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-08T19:06:05.336 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-10-08T19:06:05.359 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.043) 0:04:37.764 ******** 2021-10-08T19:06:05.387 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-08T19:06:05.388 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "redhat-lsb", "firewalld", "wget", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "make", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2021-10-08T19:06:05.415 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.055) 0:04:37.819 ******** 2021-10-08T19:06:05.432 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-10-08T19:06:05.434 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-10-08T19:06:05.457 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.042) 0:04:37.862 ******** 2021-10-08T19:06:05.496 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-10-08T19:06:05.499 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:06:05.522 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.064) 0:04:37.926 ******** 2021-10-08T19:06:05.540 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-10-08T19:06:05.542 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:06:05.565 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.042) 0:04:37.969 ******** 2021-10-08T19:06:05.646 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-08T19:06:05.648 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "redhat-lsb", "firewalld", "wget", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "make", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2021-10-08T19:06:05.670 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.105) 0:04:38.075 ******** 2021-10-08T19:06:05.708 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-10-08T19:06:05.710 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:06:05.732 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.061) 0:04:38.136 ******** 2021-10-08T19:06:05.759 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-10-08T19:06:05.761 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-08T19:06:05.783 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.051) 0:04:38.188 ******** 2021-10-08T19:06:05.968 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-08T19:06:05.969 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-10-08T19:06:05.990 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:05 +0000 (0:00:00.206) 0:04:38.395 ******** 2021-10-08T19:06:06.010 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:06 +0000 (0:00:00.020) 0:04:38.415 ******** 2021-10-08T19:06:06.070 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-10-08T19:06:06.072 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:06.102 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:06 +0000 (0:00:00.092) 0:04:38.507 ******** 2021-10-08T19:06:06.172 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-08T19:06:06.343 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:06:06 +0000 (0:00:00.094) 0:04:38.602 ******** TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} Friday 08 October 2021 19:06:06 +0000 (0:00:00.065) 0:04:38.667 ******** TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:06.349 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:06 +0000 (0:00:00.086) 0:04:38.754 ******** 2021-10-08T19:06:06.420 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-08T19:06:06.422 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:06.452 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:06 +0000 (0:00:00.103) 0:04:38.857 ******** 2021-10-08T19:06:06.483 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi112.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-10-08T19:06:06.516 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:06 +0000 (0:00:00.064) 0:04:38.921 ******** 2021-10-08T19:06:06.714 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-10-08T19:06:06.737 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:06 +0000 (0:00:00.220) 0:04:39.142 ******** 2021-10-08T19:06:07.088 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-08T19:06:07.089 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-10-08T19:06:07.111 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:07 +0000 (0:00:00.373) 0:04:39.515 ******** 2021-10-08T19:06:07.213 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi112"}, "changed": false} 2021-10-08T19:06:07.235 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:07 +0000 (0:00:00.124) 0:04:39.640 ******** 2021-10-08T19:06:07.295 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-08T19:06:07.296 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-10-08T19:06:07.318 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:07 +0000 (0:00:00.083) 0:04:39.723 ******** 2021-10-08T19:06:07.388 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-10-08T19:06:07.389 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi142"}, "changed": false} 2021-10-08T19:06:07.411 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:07 +0000 (0:00:00.092) 0:04:39.815 ******** 2021-10-08T19:06:08.071 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-10-08T19:06:08.073 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi142", "ansible_hostname": "smithi142", "ansible_nodename": "smithi142"}, "changed": false, "name": "smithi142"} 2021-10-08T19:06:08.094 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:08 +0000 (0:00:00.683) 0:04:40.498 ******** 2021-10-08T19:06:08.101 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi112.front.sepia.ceph.com", "ansible_hostname": "smithi112", "ansible_nodename": "smithi112"}, "changed": false, "name": "smithi112"} 2021-10-08T19:06:08.128 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:08 +0000 (0:00:00.032) 0:04:40.531 ******** 2021-10-08T19:06:08.595 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-10-08T19:06:08.597 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-10-08T19:06:08.619 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:08 +0000 (0:00:00.492) 0:04:41.024 ******** 2021-10-08T19:06:08.627 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-10-08T19:06:08.651 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:08 +0000 (0:00:00.031) 0:04:41.056 ******** 2021-10-08T19:06:09.133 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-10-08T19:06:09.135 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-10-08T19:06:09.157 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:09 +0000 (0:00:00.505) 0:04:41.561 ******** 2021-10-08T19:06:09.178 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:09 +0000 (0:00:00.021) 0:04:41.582 ******** 2021-10-08T19:06:09.737 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-10-08T19:06:09.739 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-08T19:06:09.761 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:09 +0000 (0:00:00.582) 0:04:42.165 ******** 2021-10-08T19:06:09.781 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-08T19:06:09.807 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:09 +0000 (0:00:00.046) 0:04:42.212 ******** 2021-10-08T19:06:10.269 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-10-08T19:06:10.270 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-10-08T19:06:10.293 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:10 +0000 (0:00:00.485) 0:04:42.698 ******** 2021-10-08T19:06:10.321 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-10-08T19:06:10.346 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:10 +0000 (0:00:00.053) 0:04:42.751 ******** 2021-10-08T19:06:10.543 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-08T19:06:10.545 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:06:10.568 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:10 +0000 (0:00:00.221) 0:04:42.972 ******** 2021-10-08T19:06:10.585 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:06:10.609 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:10 +0000 (0:00:00.040) 0:04:43.013 ******** 2021-10-08T19:06:10.794 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-08T19:06:10.796 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-10-08T19:06:10.818 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:10 +0000 (0:00:00.209) 0:04:43.223 ******** 2021-10-08T19:06:10.837 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-10-08T19:06:10.864 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:10 +0000 (0:00:00.045) 0:04:43.269 ******** 2021-10-08T19:06:11.080 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-08T19:06:11.082 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-08T19:06:11.105 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:11 +0000 (0:00:00.241) 0:04:43.510 ******** 2021-10-08T19:06:11.123 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-08T19:06:11.149 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:11 +0000 (0:00:00.043) 0:04:43.554 ******** 2021-10-08T19:06:11.606 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-08T19:06:11.607 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-10-08T19:06:11.628 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:11 +0000 (0:00:00.479) 0:04:44.033 ******** 2021-10-08T19:06:11.667 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-10-08T19:06:11.694 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:11 +0000 (0:00:00.063) 0:04:44.097 ******** 2021-10-08T19:06:12.128 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-10-08T19:06:12.130 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-10-08T19:06:12.151 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:12 +0000 (0:00:00.458) 0:04:44.555 ******** 2021-10-08T19:06:12.200 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-10-08T19:06:12.224 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:12 +0000 (0:00:00.073) 0:04:44.629 ******** 2021-10-08T19:06:14.478 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-08T19:06:14.480 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.093326", "end": "2021-10-08 19:06:14.452260", "rc": 0, "start": "2021-10-08 19:06:12.358934", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:06:14.501 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:02.276) 0:04:46.905 ******** 2021-10-08T19:06:14.520 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.066765", "end": "2021-10-08 19:06:14.499172", "rc": 0, "start": "2021-10-08 19:06:12.432407", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:06:14.544 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.042) 0:04:46.948 ******** 2021-10-08T19:06:14.572 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-10-08T19:06:14.574 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:14.596 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.052) 0:04:47.001 ******** 2021-10-08T19:06:14.615 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:14.639 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.043) 0:04:47.044 ******** 2021-10-08T19:06:14.668 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:06:14.671 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:14.693 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.053) 0:04:47.097 ******** 2021-10-08T19:06:14.711 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:14.740 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.047) 0:04:47.145 ******** 2021-10-08T19:06:14.779 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-10-08T19:06:14.780 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-08T19:06:14.806 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.066) 0:04:47.211 ******** 2021-10-08T19:06:14.827 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-08T19:06:14.852 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.045) 0:04:47.257 ******** 2021-10-08T19:06:14.880 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-10-08T19:06:14.882 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:14.906 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.053) 0:04:47.310 ******** 2021-10-08T19:06:14.934 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:14.958 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:14 +0000 (0:00:00.052) 0:04:47.362 ******** 2021-10-08T19:06:15.432 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-08T19:06:15.434 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-10-08T19:06:15.458 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:15 +0000 (0:00:00.500) 0:04:47.863 ******** 2021-10-08T19:06:15.497 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-10-08T19:06:15.523 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:15 +0000 (0:00:00.064) 0:04:47.927 ******** 2021-10-08T19:06:15.530 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-08T19:06:15.556 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:15 +0000 (0:00:00.032) 0:04:47.960 ******** 2021-10-08T19:06:15.620 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:15 +0000 (0:00:00.064) 0:04:48.024 ******** 2021-10-08T19:06:16.457 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-10-08T19:06:16.459 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.658408", "end": "2021-10-08 19:06:16.437229", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-10-08 19:06:15.778821", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use 2021-10-08T19:06:16.461 INFO:teuthology.task.ansible.out: command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-10-08T19:06:16.482 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.862) 0:04:48.887 ******** 2021-10-08T19:06:16.511 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.654669", "end": "2021-10-08 19:06:16.493359", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-10-08 19:06:15.838690", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-10-08T19:06:16.535 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.053) 0:04:48.940 ******** 2021-10-08T19:06:16.552 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-10-08T19:06:16.554 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.575 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.040) 0:04:48.980 ******** 2021-10-08T19:06:16.604 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.628 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.052) 0:04:49.033 ******** 2021-10-08T19:06:16.656 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-10-08T19:06:16.658 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.681 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.052) 0:04:49.085 ******** 2021-10-08T19:06:16.710 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.712 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.736 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.054) 0:04:49.140 ******** 2021-10-08T19:06:16.754 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-10-08T19:06:16.756 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.778 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.042) 0:04:49.183 ******** 2021-10-08T19:06:16.818 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.842 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.063) 0:04:49.246 ******** 2021-10-08T19:06:16.859 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:06:16.861 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.883 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.041) 0:04:49.288 ******** 2021-10-08T19:06:16.912 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.937 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.053) 0:04:49.341 ******** 2021-10-08T19:06:16.966 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-10-08T19:06:16.968 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:16.991 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:16 +0000 (0:00:00.054) 0:04:49.396 ******** 2021-10-08T19:06:17.022 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:17.045 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:17 +0000 (0:00:00.054) 0:04:49.450 ******** 2021-10-08T19:06:17.084 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-10-08T19:06:17.086 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:17.110 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:17 +0000 (0:00:00.064) 0:04:49.515 ******** 2021-10-08T19:06:17.129 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:17.153 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:17 +0000 (0:00:00.042) 0:04:49.557 ******** 2021-10-08T19:06:17.359 INFO:teuthology.task.ansible.out: 2021-10-08T19:06:17.361 INFO:teuthology.task.ansible.out:TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi112.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006919", "end": "2021-10-08 19:06:17.342507", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:06:17.335588", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-10-08T19:06:17.384 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:17 +0000 (0:00:00.231) 0:04:49.789 ******** 2021-10-08T19:06:17.403 INFO:teuthology.task.ansible.out:fatal: [smithi142.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006833", "end": "2021-10-08 19:06:17.386492", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:06:17.379659", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-10-08T19:06:17.431 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:17 +0000 (0:00:00.046) 0:04:49.836 ******** 2021-10-08T19:06:17.460 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-08T19:06:17.463 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:17.486 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:17 +0000 (0:00:00.054) 0:04:49.891 ******** 2021-10-08T19:06:17.515 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:06:17.540 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:17 +0000 (0:00:00.053) 0:04:49.944 ******** 2021-10-08T19:06:47.204 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-08T19:06:47.206 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+10368+630e803b.x86_64"]} 2021-10-08T19:06:47.229 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:47 +0000 (0:00:29.689) 0:05:19.633 ******** 2021-10-08T19:06:47.436 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+10368+630e803b.x86_64"]} 2021-10-08T19:06:47.465 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:06:47 +0000 (0:00:00.235) 0:05:19.869 ******** 2021-10-08T19:07:14.920 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-10-08T19:07:14.945 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:14 +0000 (0:00:27.479) 0:05:47.349 ******** 2021-10-08T19:07:15.238 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-10-08T19:07:15.263 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:15 +0000 (0:00:00.318) 0:05:47.667 ******** 2021-10-08T19:07:46.656 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:07:46.658 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-img-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64", "Installed: qemu-kvm-core-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64", "Removed: qemu-img-15:4.2.0-48.module+el8.4.0+10368+630e803b.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module+el8.4.0+10368+630e803b.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module+el8.4.0+10368+630e803b.x86_64"]} 2021-10-08T19:07:46.682 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:46 +0000 (0:00:31.419) 0:06:19.087 ******** 2021-10-08T19:07:47.176 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64", "Installed: qemu-kvm-core-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64", "Installed: qemu-img-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Removed: qemu-img-15:4.2.0-48.module+el8.4.0+10368+630e803b.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module+el8.4.0+10368+630e803b.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module+el8.4.0+10368+630e803b.x86_64"]} 2021-10-08T19:07:47.200 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:07:47 +0000 (0:00:00.517) 0:06:19.604 ******** 2021-10-08T19:08:00.405 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-10-08T19:08:00.407 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:08:00.429 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:00 +0000 (0:00:13.229) 0:06:32.834 ******** 2021-10-08T19:08:01.121 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:08:01.146 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:01 +0000 (0:00:00.716) 0:06:33.550 ******** 2021-10-08T19:08:03.436 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-08T19:08:03.438 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:08:03.460 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:03 +0000 (0:00:02.314) 0:06:35.865 ******** 2021-10-08T19:08:03.531 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-08T19:08:03.532 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:03.555 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:03 +0000 (0:00:00.094) 0:06:35.959 ******** 2021-10-08T19:08:04.096 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-10-08T19:08:04.097 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.socket system.slice polkit.service dbus.service sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service nftables.service ipset.service ebtables.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", 2021-10-08T19:08:04.099 INFO:teuthology.task.ansible.out:"Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": " 2021-10-08T19:08:04.101 INFO:teuthology.task.ansible.out:0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127239", "LimitNPROCSoft": "127239", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127239", "LimitSIGPENDINGSoft": "127239", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null 2021-10-08T19:08:04.103 INFO:teuthology.task.ansible.out:", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203583", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-08T19:08:04.121 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:04 +0000 (0:00:00.565) 0:06:36.525 ******** 2021-10-08T19:08:04.139 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-08T19:08:04.141 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:08:04.163 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:04 +0000 (0:00:00.042) 0:06:36.567 ******** 2021-10-08T19:08:04.240 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:04.264 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:04 +0000 (0:00:00.098) 0:06:36.666 ******** 2021-10-08T19:08:04.447 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-10-08T19:08:04.449 INFO:teuthology.task.ansible.out:fatal: [smithi112.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-10-08T19:08:04.473 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:04 +0000 (0:00:00.211) 0:06:36.878 ******** 2021-10-08T19:08:04.608 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-10-08T19:08:04.610 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target system.slice dbus.socket sysinit.target polkit.service dbus.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service ebtables.service ip6tables.service iptables.service nftables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", 2021-10-08T19:08:04.612 INFO:teuthology.task.ansible.out:"Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": " 2021-10-08T19:08:04.614 INFO:teuthology.task.ansible.out:0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127239", "LimitNPROCSoft": "127239", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127239", "LimitSIGPENDINGSoft": "127239", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null 2021-10-08T19:08:04.617 INFO:teuthology.task.ansible.out:", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203583", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-08T19:08:04.632 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:04 +0000 (0:00:00.158) 0:06:37.037 ******** 2021-10-08T19:08:04.986 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-10-08T19:08:04.988 INFO:teuthology.task.ansible.out:fatal: [smithi142.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-10-08T19:08:05.014 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.381) 0:06:37.418 ******** 2021-10-08T19:08:05.129 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-08T19:08:05.131 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-10-08T19:08:05.153 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.138) 0:06:37.557 ******** 2021-10-08T19:08:05.223 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-10-08T19:08:05.225 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:05.246 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.093) 0:06:37.651 ******** 2021-10-08T19:08:05.318 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:05.339 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.093) 0:06:37.744 ******** 2021-10-08T19:08:05.346 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-08T19:08:05.348 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-10-08T19:08:05.371 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.031) 0:06:37.776 ******** 2021-10-08T19:08:05.399 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-10-08T19:08:05.401 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:05.424 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.052) 0:06:37.828 ******** 2021-10-08T19:08:05.442 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-10-08T19:08:05.444 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:05.466 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.042) 0:06:37.871 ******** 2021-10-08T19:08:05.495 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-10-08T19:08:05.497 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:05.520 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.054) 0:06:37.925 ******** 2021-10-08T19:08:05.543 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:05.566 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.044) 0:06:37.970 ******** 2021-10-08T19:08:05.750 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:05.774 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.208) 0:06:38.178 ******** 2021-10-08T19:08:05.802 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:05.823 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:05 +0000 (0:00:00.048) 0:06:38.227 ******** 2021-10-08T19:08:06.022 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.052 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.230) 0:06:38.457 ******** 2021-10-08T19:08:06.102 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.130 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.076) 0:06:38.534 ******** 2021-10-08T19:08:06.321 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-08T19:08:06.358 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.229) 0:06:38.763 ******** 2021-10-08T19:08:06.366 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-10-08T19:08:06.367 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.389 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.030) 0:06:38.794 ******** 2021-10-08T19:08:06.720 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-10-08T19:08:06.721 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.722 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.743 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.353) 0:06:39.148 ******** 2021-10-08T19:08:06.763 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.020) 0:06:39.168 ******** 2021-10-08T19:08:06.823 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.847 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.083) 0:06:39.251 ******** 2021-10-08T19:08:06.855 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-08T19:08:06.882 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.035) 0:06:39.287 ******** 2021-10-08T19:08:06.921 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.923 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.947 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.065) 0:06:39.352 ******** 2021-10-08T19:08:06.955 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:06.980 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:06 +0000 (0:00:00.031) 0:06:39.384 ******** 2021-10-08T19:08:07.018 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-10-08T19:08:07.020 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.042 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.062) 0:06:39.446 ******** 2021-10-08T19:08:07.059 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-08T19:08:07.062 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.090 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.048) 0:06:39.494 ******** 2021-10-08T19:08:07.122 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-08T19:08:07.145 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.055) 0:06:39.550 ******** 2021-10-08T19:08:07.175 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi142.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.177 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.207 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.058) 0:06:39.608 ******** 2021-10-08T19:08:07.225 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-10-08T19:08:07.227 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.270 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.059) 0:06:39.667 ******** 2021-10-08T19:08:07.296 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.321 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.057) 0:06:39.725 ******** 2021-10-08T19:08:07.349 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.378 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.056) 0:06:39.781 ******** 2021-10-08T19:08:07.418 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-08T19:08:07.440 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.062) 0:06:39.844 ******** 2021-10-08T19:08:07.460 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.492 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.051) 0:06:39.896 ******** 2021-10-08T19:08:07.493 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:07.523 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.561 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.066) 0:06:39.962 ******** 2021-10-08T19:08:07.607 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.641 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.081) 0:06:40.044 ******** 2021-10-08T19:08:07.664 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.697 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.057) 0:06:40.102 ******** 2021-10-08T19:08:07.728 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-10-08T19:08:07.730 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.754 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.056) 0:06:40.159 ******** 2021-10-08T19:08:07.784 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-10-08T19:08:07.786 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.810 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.055) 0:06:40.214 ******** 2021-10-08T19:08:07.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:08:07.842 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.865 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.055) 0:06:40.270 ******** 2021-10-08T19:08:07.895 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-08T19:08:07.898 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.931 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.065) 0:06:40.335 ******** 2021-10-08T19:08:07.951 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:07.978 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:07 +0000 (0:00:00.046) 0:06:40.382 ******** 2021-10-08T19:08:07.979 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:08.020 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.045 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.067) 0:06:40.450 ******** 2021-10-08T19:08:08.062 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-10-08T19:08:08.064 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.087 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.042) 0:06:40.492 ******** 2021-10-08T19:08:08.108 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:08:08.109 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.133 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.046) 0:06:40.538 ******** 2021-10-08T19:08:08.164 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.199 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.065) 0:06:40.604 ******** 2021-10-08T19:08:08.221 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-08T19:08:08.223 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.249 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.049) 0:06:40.653 ******** 2021-10-08T19:08:08.267 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-10-08T19:08:08.270 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.291 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.042) 0:06:40.696 ******** 2021-10-08T19:08:08.322 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-10-08T19:08:08.324 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.347 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.055) 0:06:40.751 ******** 2021-10-08T19:08:08.365 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-10-08T19:08:08.367 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.391 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.043) 0:06:40.795 ******** 2021-10-08T19:08:08.423 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.452 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.061) 0:06:40.856 ******** 2021-10-08T19:08:08.470 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-08T19:08:08.472 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.497 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.043) 0:06:40.900 ******** 2021-10-08T19:08:08.526 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-10-08T19:08:08.528 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.550 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.054) 0:06:40.955 ******** 2021-10-08T19:08:08.568 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-08T19:08:08.569 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.592 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.042) 0:06:40.997 ******** 2021-10-08T19:08:08.632 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-10-08T19:08:08.634 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.656 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.063) 0:06:41.061 ******** 2021-10-08T19:08:08.674 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-08T19:08:08.676 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.701 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.044) 0:06:41.105 ******** 2021-10-08T19:08:08.740 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-08T19:08:08.742 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.766 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.065) 0:06:41.171 ******** 2021-10-08T19:08:08.786 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.814 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.048) 0:06:41.219 ******** 2021-10-08T19:08:08.845 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.871 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.056) 0:06:41.276 ******** 2021-10-08T19:08:08.894 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.917 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.044) 0:06:41.320 ******** 2021-10-08T19:08:08.954 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-08T19:08:08.956 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:08.981 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:08 +0000 (0:00:00.065) 0:06:41.385 ******** 2021-10-08T19:08:08.988 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-08T19:08:08.990 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.015 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.034) 0:06:41.420 ******** 2021-10-08T19:08:09.057 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-08T19:08:09.059 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.084 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.068) 0:06:41.488 ******** 2021-10-08T19:08:09.103 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-08T19:08:09.105 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.129 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.044) 0:06:41.533 ******** 2021-10-08T19:08:09.158 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-08T19:08:09.160 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.187 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.057) 0:06:41.591 ******** 2021-10-08T19:08:09.227 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-08T19:08:09.228 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.252 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.064) 0:06:41.655 ******** 2021-10-08T19:08:09.269 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.293 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.041) 0:06:41.697 ******** 2021-10-08T19:08:09.321 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-10-08T19:08:09.323 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.349 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.056) 0:06:41.754 ******** 2021-10-08T19:08:09.381 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.429 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.079) 0:06:41.833 ******** 2021-10-08T19:08:09.449 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.478 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.049) 0:06:41.882 ******** 2021-10-08T19:08:09.499 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-08T19:08:09.508 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.530 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.051) 0:06:41.933 ******** 2021-10-08T19:08:09.562 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-08T19:08:09.564 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.600 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.071) 0:06:42.004 ******** 2021-10-08T19:08:09.615 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.617 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:09.652 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.050) 0:06:42.055 ******** 2021-10-08T19:08:09.704 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.729 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.078) 0:06:42.134 ******** 2021-10-08T19:08:09.748 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.775 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.044) 0:06:42.178 ******** 2021-10-08T19:08:09.806 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.828 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.054) 0:06:42.233 ******** 2021-10-08T19:08:09.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-08T19:08:09.849 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.874 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.045) 0:06:42.278 ******** 2021-10-08T19:08:09.903 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.929 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.054) 0:06:42.333 ******** 2021-10-08T19:08:09.963 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:09.983 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:09 +0000 (0:00:00.055) 0:06:42.388 ******** 2021-10-08T19:08:10.013 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:08:10.015 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.051 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.066) 0:06:42.455 ******** 2021-10-08T19:08:10.073 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.098 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.045) 0:06:42.500 ******** 2021-10-08T19:08:10.137 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-08T19:08:10.140 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.170 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.073) 0:06:42.574 ******** 2021-10-08T19:08:10.195 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.219 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.049) 0:06:42.623 ******** 2021-10-08T19:08:10.284 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.308 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.089) 0:06:42.713 ******** 2021-10-08T19:08:10.317 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-08T19:08:10.318 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.342 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.033) 0:06:42.747 ******** 2021-10-08T19:08:10.382 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-08T19:08:10.384 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.414 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.072) 0:06:42.819 ******** 2021-10-08T19:08:10.422 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.450 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.034) 0:06:42.854 ******** 2021-10-08T19:08:10.493 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.522 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.072) 0:06:42.926 ******** 2021-10-08T19:08:10.542 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-08T19:08:10.544 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.569 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.047) 0:06:42.974 ******** 2021-10-08T19:08:10.599 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-08T19:08:10.601 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.625 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.056) 0:06:43.030 ******** 2021-10-08T19:08:10.645 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-08T19:08:10.647 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.670 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.044) 0:06:43.075 ******** 2021-10-08T19:08:10.710 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-08T19:08:10.714 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.738 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.067) 0:06:43.142 ******** 2021-10-08T19:08:10.740 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:10.757 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-08T19:08:10.760 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.783 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.044) 0:06:43.187 ******** 2021-10-08T19:08:10.811 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-08T19:08:10.813 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.837 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.054) 0:06:43.241 ******** 2021-10-08T19:08:10.857 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-08T19:08:10.858 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.885 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.045) 0:06:43.287 ******** 2021-10-08T19:08:10.924 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-08T19:08:10.926 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.950 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.067) 0:06:43.354 ******** 2021-10-08T19:08:10.959 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-08T19:08:10.961 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:10.984 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:10 +0000 (0:00:00.034) 0:06:43.389 ******** 2021-10-08T19:08:11.027 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.052 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.068) 0:06:43.457 ******** 2021-10-08T19:08:11.071 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.101 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.048) 0:06:43.506 ******** 2021-10-08T19:08:11.131 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.158 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.056) 0:06:43.562 ******** 2021-10-08T19:08:11.177 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.202 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.044) 0:06:43.606 ******** 2021-10-08T19:08:11.232 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.257 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.055) 0:06:43.662 ******** 2021-10-08T19:08:11.275 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-08T19:08:11.277 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.300 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.042) 0:06:43.704 ******** 2021-10-08T19:08:11.328 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.352 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.051) 0:06:43.756 ******** 2021-10-08T19:08:11.381 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-08T19:08:11.383 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.406 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.053) 0:06:43.810 ******** 2021-10-08T19:08:11.424 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.450 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.044) 0:06:43.855 ******** 2021-10-08T19:08:11.480 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-08T19:08:11.482 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.505 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.055) 0:06:43.910 ******** 2021-10-08T19:08:11.524 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.548 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.042) 0:06:43.953 ******** 2021-10-08T19:08:11.576 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-08T19:08:11.578 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.599 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.051) 0:06:44.004 ******** 2021-10-08T19:08:11.616 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-10-08T19:08:11.618 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.641 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.041) 0:06:44.045 ******** 2021-10-08T19:08:11.684 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-08T19:08:11.686 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.710 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.067) 0:06:44.113 ******** 2021-10-08T19:08:11.726 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-08T19:08:11.728 INFO:teuthology.task.ansible.out: skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.755 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.046) 0:06:44.160 ******** 2021-10-08T19:08:11.794 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-08T19:08:11.796 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.821 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.065) 0:06:44.225 ******** 2021-10-08T19:08:11.839 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-08T19:08:11.841 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.863 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.041) 0:06:44.267 ******** 2021-10-08T19:08:11.890 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-10-08T19:08:11.892 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.916 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.053) 0:06:44.321 ******** 2021-10-08T19:08:11.934 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-08T19:08:11.936 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:11.958 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:11 +0000 (0:00:00.041) 0:06:44.362 ******** 2021-10-08T19:08:11.985 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-08T19:08:11.987 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.012 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.053) 0:06:44.416 ******** 2021-10-08T19:08:12.030 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-08T19:08:12.032 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.056 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.043) 0:06:44.460 ******** 2021-10-08T19:08:12.084 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-08T19:08:12.087 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.115 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.060) 0:06:44.520 ******** 2021-10-08T19:08:12.134 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-10-08T19:08:12.135 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.160 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.041) 0:06:44.562 ******** 2021-10-08T19:08:12.195 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:12.197 INFO:teuthology.task.ansible.out:TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.221 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.063) 0:06:44.626 ******** 2021-10-08T19:08:12.239 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.263 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.041) 0:06:44.667 ******** 2021-10-08T19:08:12.301 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-08T19:08:12.306 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.325 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.062) 0:06:44.730 ******** 2021-10-08T19:08:12.343 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-08T19:08:12.345 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.368 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.043) 0:06:44.773 ******** 2021-10-08T19:08:12.396 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-10-08T19:08:12.398 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.422 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.053) 0:06:44.827 ******** 2021-10-08T19:08:12.441 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-10-08T19:08:12.444 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.468 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.045) 0:06:44.872 ******** 2021-10-08T19:08:12.469 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:12.496 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-10-08T19:08:12.498 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.520 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.052) 0:06:44.925 ******** 2021-10-08T19:08:12.549 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-10-08T19:08:12.551 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.573 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.052) 0:06:44.978 ******** 2021-10-08T19:08:12.601 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-08T19:08:12.603 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.626 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.053) 0:06:45.031 ******** 2021-10-08T19:08:12.655 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-08T19:08:12.658 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.680 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.053) 0:06:45.084 ******** 2021-10-08T19:08:12.697 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-10-08T19:08:12.699 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.723 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.043) 0:06:45.128 ******** 2021-10-08T19:08:12.752 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-08T19:08:12.754 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.775 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.052) 0:06:45.180 ******** 2021-10-08T19:08:12.794 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-10-08T19:08:12.795 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.822 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.046) 0:06:45.227 ******** 2021-10-08T19:08:12.853 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-10-08T19:08:12.856 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.877 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.054) 0:06:45.282 ******** 2021-10-08T19:08:12.907 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:12.933 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.056) 0:06:45.338 ******** 2021-10-08T19:08:12.962 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-08T19:08:12.986 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:12 +0000 (0:00:00.052) 0:06:45.390 ******** 2021-10-08T19:08:13.003 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-08T19:08:13.005 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.028 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.042) 0:06:45.432 ******** 2021-10-08T19:08:13.070 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-08T19:08:13.072 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.083 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi112.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.093 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.095 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.118 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.090) 0:06:45.523 ******** 2021-10-08T19:08:13.125 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi112.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.127 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.155 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.037) 0:06:45.560 ******** 2021-10-08T19:08:13.197 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:08:13.199 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-08T19:08:13.223 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.067) 0:06:45.627 ******** 2021-10-08T19:08:13.320 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-08T19:08:13.321 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.331 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-10-08T19:08:13.333 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.343 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.345 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.357 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.383 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.159) 0:06:45.787 ******** 2021-10-08T19:08:13.400 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-10-08T19:08:13.402 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003491", "end": "2021-10-08 19:08:13.373193", "rc": 0, "start": "2021-10-08 19:08:13.369702", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock"]} 2021-10-08T19:08:13.429 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.046) 0:06:45.833 ******** 2021-10-08T19:08:13.512 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.538 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.108) 0:06:45.942 ******** 2021-10-08T19:08:13.619 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-08T19:08:13.621 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003745", "end": "2021-10-08 19:08:13.601205", "rc": 0, "start": "2021-10-08 19:08:13.597460", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/bin/teuthology-lock"]} 2021-10-08T19:08:13.649 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.111) 0:06:46.053 ******** 2021-10-08T19:08:13.674 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.025) 0:06:46.079 ******** 2021-10-08T19:08:13.730 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-10-08T19:08:13.734 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.754 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.079) 0:06:46.158 ******** 2021-10-08T19:08:13.760 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-10-08T19:08:13.762 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.788 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.034) 0:06:46.192 ******** 2021-10-08T19:08:13.825 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-10-08T19:08:13.828 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.851 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.061) 0:06:46.254 ******** 2021-10-08T19:08:13.868 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-08T19:08:13.871 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.893 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.043) 0:06:46.297 ******** 2021-10-08T19:08:13.963 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-10-08T19:08:13.965 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:13.989 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:13 +0000 (0:00:00.094) 0:06:46.392 ******** 2021-10-08T19:08:14.068 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:14.092 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:14 +0000 (0:00:00.104) 0:06:46.496 ******** 2021-10-08T19:08:16.834 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-10-08T19:08:16.836 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:08:16.858 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:16 +0000 (0:00:02.766) 0:06:49.263 ******** 2021-10-08T19:08:16.949 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-08T19:08:16.951 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930320510976, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227129031, 'block_used': 12966077, 'inode_total': 61054976, 'inode_available': 60985436, 'inode_used': 69540, 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227129031, "block_size": 4096, "block_total": 240095108, "block_used": 12966077, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985436, "inode_total": 61054976, "inode_used": 69540, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930320510976, "size_total": 983429562368, "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}} 2021-10-08T19:08:16.974 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:16 +0000 (0:00:00.115) 0:06:49.378 ******** 2021-10-08T19:08:17.097 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-10-08T19:08:17.099 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:08:17.122 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:17 +0000 (0:00:00.148) 0:06:49.526 ******** 2021-10-08T19:08:17.206 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-10-08T19:08:17.207 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005006", "end": "2021-10-08 19:08:17.191150", "rc": 0, "start": "2021-10-08 19:08:17.186144", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:17.229 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:17 +0000 (0:00:00.106) 0:06:49.633 ******** 2021-10-08T19:08:17.238 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-08T19:08:17.240 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930320515072, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227129032, 'block_used': 12966076, 'inode_total': 61054976, 'inode_available': 60985436, 'inode_used': 69540, 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227129032, "block_size": 4096, "block_total": 240095108, "block_used": 12966076, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985436, "inode_total": 61054976, "inode_used": 69540, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930320515072, "size_total": 983429562368, "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}} 2021-10-08T19:08:17.265 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:17 +0000 (0:00:00.034) 0:06:49.668 ******** 2021-10-08T19:08:17.305 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-10-08T19:08:17.307 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930320510976, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227129031, 'block_used': 12966077, 'inode_total': 61054976, 'inode_available': 60985436, 'inode_used': 69540, 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227129031, "block_size": 4096, "block_total": 240095108, "block_used": 12966077, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985436, "inode_total": 61054976, "inode_used": 69540, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930320510976, "size_total": 983429562368, "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:17.330 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:17 +0000 (0:00:00.066) 0:06:49.734 ******** 2021-10-08T19:08:17.400 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-08T19:08:17.425 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:17 +0000 (0:00:00.094) 0:06:49.829 ******** 2021-10-08T19:08:17.495 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-10-08T19:08:17.497 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005252", "end": "2021-10-08 19:08:17.479539", "rc": 0, "start": "2021-10-08 19:08:17.474287", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:17.522 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:17 +0000 (0:00:00.097) 0:06:49.927 ******** 2021-10-08T19:08:17.614 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi142.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930320515072, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227129032, 'block_used': 12966076, 'inode_total': 61054976, 'inode_available': 60985436, 'inode_used': 69540, 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227129032, "block_size": 4096, "block_total": 240095108, "block_used": 12966076, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985436, "inode_total": 61054976, "inode_used": 69540, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930320515072, "size_total": 983429562368, "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:17.638 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:17 +0000 (0:00:00.115) 0:06:50.043 ******** 2021-10-08T19:08:17.712 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-08T19:08:17.736 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:17 +0000 (0:00:00.097) 0:06:50.140 ******** 2021-10-08T19:08:18.849 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-08T19:08:18.851 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjlZYY6Z6YK2zCt28U4IoYhEajfhgRURwj'], 'uuids': ['d91077e5-32cd-419b-b601-e44bf781a47b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.157971", "end": "2021-10-08 19:08:18.819718", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjlZYY6Z6YK2zCt28U4IoYhEajfhgRURwj"], "labels": [], "masters": [], "uuids": ["d91077e5-32cd-419b-b601-e44bf781a47b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:17.661747", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:19.136 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuB5eVJ9eBknQ28uQ9frr8iQG7wf81teSDi'], 'uuids': ['5c618469-36f9-46bb-a5f1-665158dd6005'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.128240", "end": "2021-10-08 19:08:19.109521", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuB5eVJ9eBknQ28uQ9frr8iQG7wf81teSDi"], "labels": [], "masters": [], "uuids": ["5c618469-36f9-46bb-a5f1-665158dd6005"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:17.981281", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:20.119 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-ib5Fsa-KlND-tGKp-h7eX-ma7D-fK12-q2hqu3', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NV400BGN', 'nvme-nvme.8086-504846543632303430304e5634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.070845", "end": "2021-10-08 19:08:20.080370", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ib5Fsa-KlND-tGKp-h7eX-ma7D-fK12-q2hqu3", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NV400BGN", "nvme-nvme.8086-504846543632303430304e5634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:19.009525", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-10-08T19:08:20.121 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:20.397 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Mn4FIx-XQAY-Wbot-yxLn-kayi-Pksn-LnnNrJ', 'nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN', 'nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.060403", "end": "2021-10-08 19:08:20.367835", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Mn4FIx-XQAY-Wbot-yxLn-kayi-Pksn-LnnNrJ", "nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN", "nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:19.307432", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-10-08T19:08:20.398 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:21.362 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjJRdqzVeWfdOpk0l6jwQ2uC4qSjpXbxPr'], 'uuids': ['29ff725a-83a7-40df-812d-8d683b269917'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.067484", "end": "2021-10-08 19:08:21.335038", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjJRdqzVeWfdOpk0l6jwQ2uC4qSjpXbxPr"], "labels": [], "masters": [], "uuids": ["29ff725a-83a7-40df-812d-8d683b269917"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:20.267554", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:21.658 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBbhfCJpPuEkSoWFJZ2y2Ga7wPp2ShQmeF'], 'uuids': ['71a560b3-be44-4067-a149-e5e3423bf16b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.074380", "end": "2021-10-08 19:08:21.632006", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBbhfCJpPuEkSoWFJZ2y2Ga7wPp2ShQmeF"], "labels": [], "masters": [], "uuids": ["71a560b3-be44-4067-a149-e5e3423bf16b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:20.557626", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:22.621 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjBpWdfJqXdC2QiC8Pl0KrjBqWrnQkSHN3'], 'uuids': ['7e744cbf-e805-4ebe-9182-6d59bf364f05'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.066680", "end": "2021-10-08 19:08:22.593315", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjBpWdfJqXdC2QiC8Pl0KrjBqWrnQkSHN3"], "labels": [], "masters": [], "uuids": ["7e744cbf-e805-4ebe-9182-6d59bf364f05"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:21.526635", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:22.919 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBe2fXLi1l9xtNMqlFsyV9Ib0vhgsrCI7A'], 'uuids': ['430c54b1-a0fc-4bdf-87a0-970513c1ed6c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.061235", "end": "2021-10-08 19:08:22.893292", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBe2fXLi1l9xtNMqlFsyV9Ib0vhgsrCI7A"], "labels": [], "masters": [], "uuids": ["430c54b1-a0fc-4bdf-87a0-970513c1ed6c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:21.832057", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:23.869 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHj2dkONi2gDzaEYQXOF1jss5BWs9FusV67'], 'uuids': ['58fcff8a-95a4-4752-8004-91f7caeb1782'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.053359", "end": "2021-10-08 19:08:23.835816", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHj2dkONi2gDzaEYQXOF1jss5BWs9FusV67"], "labels": [], "masters": [], "uuids": ["58fcff8a-95a4-4752-8004-91f7caeb1782"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:22.782457", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi112.front.sepia.ceph.com] => 2021-10-08T19:08:23.871 INFO:teuthology.task.ansible.out:(item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QZGS', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS', 'scsi-35000c50091e2ee9d', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS', 'wwn-0x5000c50091e2ee9d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QZGS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e2ee9d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QZGS-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS-part1', 'scsi-35000c50091e2ee9d-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS-part1', 'wwn-0x5000c50091e2ee9d-part1'], 'uuids': ['bc802139-74bd-43cf-840d-e30da2bb57f8'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QZGS", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS", "scsi-35000c50091e2ee9d", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS", "wwn-0x5000c50091e2ee9d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QZGS-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS-part1", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS-part1", "scsi-35000c50091e2ee9d-part1 2021-10-08T19:08:23.877 INFO:teuthology.task.ansible.out:", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS-part1", "wwn-0x5000c50091e2ee9d-part1"], "labels": [], "masters": [], "uuids": ["bc802139-74bd-43cf-840d-e30da2bb57f8"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QZGS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2ee9d"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:24.177 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBbTGLV5oWPEFiE8la0Qk4YOsnZNs5m4hp'], 'uuids': ['2be2a52a-a26d-48b7-b1e9-a61d87c67650'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.066473", "end": "2021-10-08 19:08:24.150499", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBbTGLV5oWPEFiE8la0Qk4YOsnZNs5m4hp"], "labels": [], "masters": [], "uuids": ["2be2a52a-a26d-48b7-b1e9-a61d87c67650"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:23.084026", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:24.189 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFVQ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFVQ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFVQ', 'scsi-35000c5009292426c', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFVQ', 'wwn-0x5000c5009292426c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFVQ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009292426c', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFVQ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFVQ-part1', 'scsi-35000c5009292426c-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFVQ-part1', 'wwn-0x5000c5009292426c-part1'], 'uuids': ['bc802139-74bd-43cf-840d-e30da2bb57f8'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFVQ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFVQ", "scsi-35000c5009292426c", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFVQ", "wwn-0x5000c5009292426c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFVQ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:08:24.191 INFO:teuthology.task.ansible.out:Z1W5XFVQ-part1", "scsi-35000c5009292426c-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFVQ-part1", "wwn-0x5000c5009292426c-part1"], "labels": [], "masters": [], "uuids": ["bc802139-74bd-43cf-840d-e30da2bb57f8"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFVQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009292426c"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:25.108 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjJytsOuL3OpOXS08BTkVlpaLFej02AAXd'], 'uuids': ['755784cc-a57b-4fbb-8ace-b1cab27fbc5d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.046990", "end": "2021-10-08 19:08:25.076038", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjJytsOuL3OpOXS08BTkVlpaLFej02AAXd"], "labels": [], "masters": [], "uuids": ["755784cc-a57b-4fbb-8ace-b1cab27fbc5d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:24.029048", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:25.142 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:25 +0000 (0:00:07.405) 0:06:57.546 ******** 2021-10-08T19:08:25.439 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBlbhVnVGALnv0Ebl1lqmEG0YwzTam7TZa'], 'uuids': ['500954a2-051a-40af-991f-b67953e916b7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.054489", "end": "2021-10-08 19:08:25.402517", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBlbhVnVGALnv0Ebl1lqmEG0YwzTam7TZa"], "labels": [], "masters": [], "uuids": ["500954a2-051a-40af-991f-b67953e916b7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:24.348028", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-08T19:08:25.468 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:25 +0000 (0:00:00.325) 0:06:57.872 ******** 2021-10-08T19:08:25.591 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-08T19:08:25.592 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjlZYY6Z6YK2zCt28U4IoYhEajfhgRURwj'], 'uuids': ['d91077e5-32cd-419b-b601-e44bf781a47b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158923", "end": "2021-10-08 19:08:25.555261", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjlZYY6Z6YK2zCt28U4IoYhEajfhgRURwj"], "labels": [], "masters": [], "uuids": ["d91077e5-32cd-419b-b601-e44bf781a47b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:25.396338", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156042 s, 739 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156042 s, 739 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:25.810 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-ib5Fsa-KlND-tGKp-h7eX-ma7D-fK12-q2hqu3', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NV400BGN', 'nvme-nvme.8086-504846543632303430304e5634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.040065", "end": "2021-10-08 19:08:25.780954", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ib5Fsa-KlND-tGKp-h7eX-ma7D-fK12-q2hqu3", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NV400BGN", "nvme-nvme.8086-504846543632303430304e5634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:25.740889", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0374502 s, 3.1 GB/s", "std 2021-10-08T19:08:25.812 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0374502 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:25.879 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuB5eVJ9eBknQ28uQ9frr8iQG7wf81teSDi'], 'uuids': ['5c618469-36f9-46bb-a5f1-665158dd6005'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.145395", "end": "2021-10-08 19:08:25.855395", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuB5eVJ9eBknQ28uQ9frr8iQG7wf81teSDi"], "labels": [], "masters": [], "uuids": ["5c618469-36f9-46bb-a5f1-665158dd6005"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:25.710000", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142608 s, 809 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142608 s, 809 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:26.100 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Mn4FIx-XQAY-Wbot-yxLn-kayi-Pksn-LnnNrJ', 'nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN', 'nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.040629", "end": "2021-10-08 19:08:26.077156", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Mn4FIx-XQAY-Wbot-yxLn-kayi-Pksn-LnnNrJ", "nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN", "nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:26.036527", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.037903 s, 3.0 GB/s", "stde 2021-10-08T19:08:26.102 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.037903 s, 3.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:26.131 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjJRdqzVeWfdOpk0l6jwQ2uC4qSjpXbxPr'], 'uuids': ['29ff725a-83a7-40df-812d-8d683b269917'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144516", "end": "2021-10-08 19:08:26.105192", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjJRdqzVeWfdOpk0l6jwQ2uC4qSjpXbxPr"], "labels": [], "masters": [], "uuids": ["29ff725a-83a7-40df-812d-8d683b269917"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:25.960676", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14195 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14195 s, 813 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:26.431 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBbhfCJpPuEkSoWFJZ2y2Ga7wPp2ShQmeF'], 'uuids': ['71a560b3-be44-4067-a149-e5e3423bf16b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.146496", "end": "2021-10-08 19:08:26.402855", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBbhfCJpPuEkSoWFJZ2y2Ga7wPp2ShQmeF"], "labels": [], "masters": [], "uuids": ["71a560b3-be44-4067-a149-e5e3423bf16b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:26.256359", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143806 s, 802 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143806 s, 802 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:26.444 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjBpWdfJqXdC2QiC8Pl0KrjBqWrnQkSHN3'], 'uuids': ['7e744cbf-e805-4ebe-9182-6d59bf364f05'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144512", "end": "2021-10-08 19:08:26.418337", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjBpWdfJqXdC2QiC8Pl0KrjBqWrnQkSHN3"], "labels": [], "masters": [], "uuids": ["7e744cbf-e805-4ebe-9182-6d59bf364f05"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:26.273825", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141933 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141933 s, 813 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:26.742 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBe2fXLi1l9xtNMqlFsyV9Ib0vhgsrCI7A'], 'uuids': ['430c54b1-a0fc-4bdf-87a0-970513c1ed6c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.146659", "end": "2021-10-08 19:08:26.721979", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBe2fXLi1l9xtNMqlFsyV9Ib0vhgsrCI7A"], "labels": [], "masters": [], "uuids": ["430c54b1-a0fc-4bdf-87a0-970513c1ed6c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:26.575320", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143911 s, 801 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143911 s, 801 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:26.764 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHj2dkONi2gDzaEYQXOF1jss5BWs9FusV67'], 'uuids': ['58fcff8a-95a4-4752-8004-91f7caeb1782'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.145297", "end": "2021-10-08 19:08:26.739757", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHj2dkONi2gDzaEYQXOF1jss5BWs9FusV67"], "labels": [], "masters": [], "uuids": ["58fcff8a-95a4-4752-8004-91f7caeb1782"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:26.594460", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142722 s, 808 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142722 s, 808 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:26.767 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QZGS', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS', 'scsi-35000c50091e2ee9d', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS', 'wwn-0x5000c50091e2ee9d'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QZGS', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e2ee9d', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QZGS-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS-part1', 'scsi-35000c50091e2ee9d-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS-part1', 'wwn-0x5000c50091e2ee9d-part1'], 'uuids': ['bc802139-74bd-43cf-840d-e30da2bb57f8'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QZGS", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QZGS", "scsi-35000c50091e2ee9d", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS", "wwn-0x5000c50091e2ee9d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QZGS-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QZGS-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:08:26.769 INFO:teuthology.task.ansible.out:Z1W5QZGS-part1", "scsi-35000c50091e2ee9d-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QZGS-part1", "wwn-0x5000c50091e2ee9d-part1"], "labels": [], "masters": [], "uuids": ["bc802139-74bd-43cf-840d-e30da2bb57f8"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QZGS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2ee9d"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:27.073 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBbTGLV5oWPEFiE8la0Qk4YOsnZNs5m4hp'], 'uuids': ['2be2a52a-a26d-48b7-b1e9-a61d87c67650'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.153206", "end": "2021-10-08 19:08:27.052211", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBbTGLV5oWPEFiE8la0Qk4YOsnZNs5m4hp"], "labels": [], "masters": [], "uuids": ["2be2a52a-a26d-48b7-b1e9-a61d87c67650"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:26.899005", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150512 s, 766 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150512 s, 766 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:27.084 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFVQ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFVQ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFVQ', 'scsi-35000c5009292426c', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFVQ', 'wwn-0x5000c5009292426c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFVQ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009292426c', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFVQ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFVQ-part1', 'scsi-35000c5009292426c-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFVQ-part1', 'wwn-0x5000c5009292426c-part1'], 'uuids': ['bc802139-74bd-43cf-840d-e30da2bb57f8'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFVQ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFVQ", "scsi-35000c5009292426c", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFVQ", "wwn-0x5000c5009292426c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFVQ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-10-08T19:08:27.086 INFO:teuthology.task.ansible.out:Z1W5XFVQ-part1", "scsi-35000c5009292426c-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFVQ-part1", "wwn-0x5000c5009292426c-part1"], "labels": [], "masters": [], "uuids": ["bc802139-74bd-43cf-840d-e30da2bb57f8"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFVQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009292426c"}}, "skip_reason": "Conditional result was False"} changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjJytsOuL3OpOXS08BTkVlpaLFej02AAXd'], 'uuids': ['755784cc-a57b-4fbb-8ace-b1cab27fbc5d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.146695", "end": "2021-10-08 19:08:27.064197", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Gw1LLL688jaifODoD1EwbdDa8nYfkwHjJytsOuL3OpOXS08BTkVlpaLFej02AAXd"], "labels": [], "masters": [], "uuids": ["755784cc-a57b-4fbb-8ace-b1cab27fbc5d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:26.917502", "std 2021-10-08T19:08:27.087 INFO:teuthology.task.ansible.out:err": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143987 s, 801 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143987 s, 801 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:27.122 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:27 +0000 (0:00:01.651) 0:06:59.524 ******** 2021-10-08T19:08:27.398 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBlbhVnVGALnv0Ebl1lqmEG0YwzTam7TZa'], 'uuids': ['500954a2-051a-40af-991f-b67953e916b7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.144947", "end": "2021-10-08 19:08:27.377033", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-nGnXrIEagvZorBLsefVWa05dlpf4nIuBlbhVnVGALnv0Ebl1lqmEG0YwzTam7TZa"], "labels": [], "masters": [], "uuids": ["500954a2-051a-40af-991f-b67953e916b7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-08 19:08:27.232086", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142206 s, 811 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142206 s, 811 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:27.428 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:27 +0000 (0:00:00.308) 0:06:59.832 ******** 2021-10-08T19:08:27.435 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-08T19:08:27.436 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.071755", "end": "2021-10-08 19:08:27.352021", "rc": 0, "start": "2021-10-08 19:08:27.280266", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:27.461 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:27 +0000 (0:00:00.033) 0:06:59.866 ******** 2021-10-08T19:08:27.698 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-08T19:08:27.701 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051307", "end": "2021-10-08 19:08:27.679019", "rc": 0, "start": "2021-10-08 19:08:27.627712", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:27.722 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:27 +0000 (0:00:00.261) 0:07:00.127 ******** 2021-10-08T19:08:27.731 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-08T19:08:27.733 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.063925", "end": "2021-10-08 19:08:27.655476", "rc": 0, "start": "2021-10-08 19:08:27.591551", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:27.756 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:27 +0000 (0:00:00.033) 0:07:00.161 ******** 2021-10-08T19:08:27.795 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-08T19:08:27.862 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:27 +0000 (0:00:00.106) 0:07:00.267 ******** 2021-10-08T19:08:27.901 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:27.928 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:27 +0000 (0:00:00.064) 0:07:00.332 ******** 2021-10-08T19:08:27.955 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-10-08T19:08:27.956 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:27.978 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:27 +0000 (0:00:00.050) 0:07:00.382 ******** 2021-10-08T19:08:27.999 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-08T19:08:28.000 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051768", "end": "2021-10-08 19:08:27.971638", "rc": 0, "start": "2021-10-08 19:08:27.919870", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.025 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.047) 0:07:00.430 ******** 2021-10-08T19:08:28.052 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.022) 0:07:00.452 ******** 2021-10-08T19:08:28.067 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.089 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.041) 0:07:00.493 ******** 2021-10-08T19:08:28.096 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-08T19:08:28.128 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.037) 0:07:00.531 ******** 2021-10-08T19:08:28.167 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.196 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.068) 0:07:00.599 ******** 2021-10-08T19:08:28.223 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-10-08T19:08:28.225 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.256 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.061) 0:07:00.661 ******** 2021-10-08T19:08:28.278 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-08T19:08:28.298 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.041) 0:07:00.703 ******** 2021-10-08T19:08:28.309 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.337 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.038) 0:07:00.742 ******** 2021-10-08T19:08:28.347 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-08T19:08:28.349 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930320510976, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227129031, 'block_used': 12966077, 'inode_total': 61054976, 'inode_available': 60985436, 'inode_used': 69540, 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227129031, "block_size": 4096, "block_total": 240095108, "block_used": 12966077, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985436, "inode_total": 61054976, "inode_used": 69540, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930320510976, "size_total": 983429562368, "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.382 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.044) 0:07:00.786 ******** 2021-10-08T19:08:28.389 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-10-08T19:08:28.391 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.419 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.033) 0:07:00.820 ******** 2021-10-08T19:08:28.433 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.458 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.042) 0:07:00.862 ******** 2021-10-08T19:08:28.496 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:08:28.498 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.521 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.063) 0:07:00.926 ******** 2021-10-08T19:08:28.563 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:08:28.565 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.585 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.064) 0:07:00.990 ******** 2021-10-08T19:08:28.613 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-10-08T19:08:28.615 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.636 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.050) 0:07:01.041 ******** 2021-10-08T19:08:28.656 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.020) 0:07:01.061 ******** 2021-10-08T19:08:28.674 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-10-08T19:08:28.676 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.703 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.047) 0:07:01.108 ******** 2021-10-08T19:08:28.711 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-08T19:08:28.713 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930320515072, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227129032, 'block_used': 12966076, 'inode_total': 61054976, 'inode_available': 60985436, 'inode_used': 69540, 'uuid': 'bc802139-74bd-43cf-840d-e30da2bb57f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227129032, "block_size": 4096, "block_total": 240095108, "block_used": 12966076, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985436, "inode_total": 61054976, "inode_used": 69540, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930320515072, "size_total": 983429562368, "uuid": "bc802139-74bd-43cf-840d-e30da2bb57f8"}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.738 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.034) 0:07:01.142 ******** 2021-10-08T19:08:28.744 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-10-08T19:08:28.747 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.769 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.031) 0:07:01.174 ******** 2021-10-08T19:08:28.778 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-10-08T19:08:28.779 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.803 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.033) 0:07:01.208 ******** 2021-10-08T19:08:28.831 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:08:28.833 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.863 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.050) 0:07:01.258 ******** 2021-10-08T19:08:28.890 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.913 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.058) 0:07:01.317 ******** 2021-10-08T19:08:28.954 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-10-08T19:08:28.956 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:28.988 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:28 +0000 (0:00:00.074) 0:07:01.391 ******** 2021-10-08T19:08:29.032 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:29.056 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:29 +0000 (0:00:00.068) 0:07:01.460 ******** 2021-10-08T19:08:29.093 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:29.115 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:29 +0000 (0:00:00.060) 0:07:01.520 ******** 2021-10-08T19:08:29.282 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-08T19:08:29.307 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:29 +0000 (0:00:00.189) 0:07:01.710 ******** 2021-10-08T19:08:29.548 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-08T19:08:29.575 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:29 +0000 (0:00:00.269) 0:07:01.979 ******** 2021-10-08T19:08:29.764 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:29.965 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:30.114 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:30.304 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:30.496 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:30.671 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:30.828 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:31.012 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:31.172 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:31.194 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:31 +0000 (0:00:01.619) 0:07:03.599 ******** 2021-10-08T19:08:31.358 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-08T19:08:31.388 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:31 +0000 (0:00:00.190) 0:07:03.789 ******** 2021-10-08T19:08:31.409 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-08T19:08:31.432 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:31 +0000 (0:00:00.046) 0:07:03.836 ******** 2021-10-08T19:08:31.582 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-08T19:08:31.608 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:31 +0000 (0:00:00.176) 0:07:04.012 ******** 2021-10-08T19:08:31.648 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-08T19:08:31.650 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:08:31.825 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:08:31.826 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:08:32.006 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:08:32.014 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:08:32.187 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:08:32.189 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:08:32.199 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:32.226 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.617) 0:07:04.630 ******** 2021-10-08T19:08:32.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-10-08T19:08:32.258 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:32.284 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.056) 0:07:04.686 ******** 2021-10-08T19:08:32.323 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-10-08T19:08:32.332 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:32.347 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.063) 0:07:04.750 ******** 2021-10-08T19:08:32.370 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-08T19:08:32.375 INFO:teuthology.task.ansible.out: skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:32.403 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.057) 0:07:04.807 ******** 2021-10-08T19:08:32.432 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:32.457 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.053) 0:07:04.861 ******** 2021-10-08T19:08:32.486 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:32.509 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.052) 0:07:04.914 ******** 2021-10-08T19:08:32.565 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-10-08T19:08:32.566 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:08:32.591 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.082) 0:07:04.996 ******** 2021-10-08T19:08:32.631 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-10-08T19:08:32.633 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:32.659 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.065) 0:07:05.061 ******** 2021-10-08T19:08:32.720 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:08:32.747 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.089) 0:07:05.151 ******** 2021-10-08T19:08:32.781 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-10-08T19:08:32.784 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:32.805 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:32 +0000 (0:00:00.057) 0:07:05.209 ******** 2021-10-08T19:08:33.188 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi142.front.sepia.ceph.com] => {"changed": true} 2021-10-08T19:08:33.214 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:33 +0000 (0:00:00.407) 0:07:05.617 ******** 2021-10-08T19:08:33.646 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-08T19:08:33.670 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:33 +0000 (0:00:00.455) 0:07:06.072 ******** 2021-10-08T19:08:33.696 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-10-08T19:08:33.698 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:33.722 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:33 +0000 (0:00:00.054) 0:07:06.127 ******** 2021-10-08T19:08:33.750 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-10-08T19:08:33.752 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:33.774 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:33 +0000 (0:00:00.051) 0:07:06.178 ******** 2021-10-08T19:08:33.801 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:33.829 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:33 +0000 (0:00:00.051) 0:07:06.229 ******** 2021-10-08T19:08:33.867 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-10-08T19:08:33.873 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:33.907 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:33 +0000 (0:00:00.073) 0:07:06.303 ******** 2021-10-08T19:08:33.929 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:33.954 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:33 +0000 (0:00:00.053) 0:07:06.356 ******** 2021-10-08T19:08:33.981 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-10-08T19:08:33.983 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.008 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.056) 0:07:06.413 ******** 2021-10-08T19:08:34.040 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.064 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.055) 0:07:06.469 ******** 2021-10-08T19:08:34.102 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-10-08T19:08:34.105 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.127 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.062) 0:07:06.531 ******** 2021-10-08T19:08:34.170 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.198 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.071) 0:07:06.602 ******** 2021-10-08T19:08:34.207 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi112.front.sepia.ceph.com] => {"changed": true} 2021-10-08T19:08:34.238 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.037) 0:07:06.640 ******** 2021-10-08T19:08:34.250 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.283 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.046) 0:07:06.686 ******** 2021-10-08T19:08:34.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-10-08T19:08:34.332 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.354 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.071) 0:07:06.758 ******** 2021-10-08T19:08:34.395 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.418 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.063) 0:07:06.821 ******** 2021-10-08T19:08:34.445 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-10-08T19:08:34.447 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.468 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.051) 0:07:06.873 ******** 2021-10-08T19:08:34.507 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.530 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.061) 0:07:06.934 ******** 2021-10-08T19:08:34.558 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-08T19:08:34.564 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.581 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.051) 0:07:06.986 ******** 2021-10-08T19:08:34.604 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.022) 0:07:07.008 ******** 2021-10-08T19:08:34.621 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-10-08T19:08:34.623 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.647 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.042) 0:07:07.051 ******** 2021-10-08T19:08:34.678 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-10-08T19:08:34.679 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.702 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.055) 0:07:07.106 ******** 2021-10-08T19:08:34.735 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.763 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.058) 0:07:07.165 ******** 2021-10-08T19:08:34.791 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.813 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.052) 0:07:07.218 ******** 2021-10-08T19:08:34.846 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-10-08T19:08:34.849 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.870 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.057) 0:07:07.275 ******** 2021-10-08T19:08:34.899 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-10-08T19:08:34.901 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.922 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.050) 0:07:07.326 ******** 2021-10-08T19:08:34.951 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:34.981 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:34 +0000 (0:00:00.056) 0:07:07.383 ******** 2021-10-08T19:08:35.022 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.043 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.065) 0:07:07.448 ******** 2021-10-08T19:08:35.086 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.114 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.070) 0:07:07.519 ******** 2021-10-08T19:08:35.123 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-08T19:08:35.127 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-10-08T19:08:35.150 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.036) 0:07:07.555 ******** 2021-10-08T19:08:35.210 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 08 October 2021 19:08:35 +0000 (0:00:00.032) 0:07:07.588 ******** 2021-10-08T19:08:35.211 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.233 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.050) 0:07:07.638 ******** 2021-10-08T19:08:35.272 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.300 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.066) 0:07:07.705 ******** 2021-10-08T19:08:35.330 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.355 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.051) 0:07:07.756 ******** 2021-10-08T19:08:35.382 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.415 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.059) 0:07:07.816 ******** 2021-10-08T19:08:35.444 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.467 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.055) 0:07:07.872 ******** 2021-10-08T19:08:35.478 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-08T19:08:35.479 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-10-08 19:00:22 UTC", "ActiveEnterTimestampMonotonic": "14908906", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice tmp.mount systemd-journald.socket basic.target -.mount sysinit.target sntp.service ntpd.service ntpdate.service systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-10-08 19:00:21 UTC", "AssertTimestampMonotonic": "13579526", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-10-08 19:00:21 UTC", "ConditionTimestampMonotonic": "13579478", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-time 2021-10-08T19:08:35.481 INFO:teuthology.task.ansible.out:syncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "867", "ExecMainStartTimestamp": "Fri 2021-10-08 19:00:21 UTC", "ExecMainStartTimestampMonotonic": "13719610", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-10-08 19:00:21 UTC", "InactiveExitTimestampMonotonic": "13584984", "InvocationID": "b149214eb3454c2690daa0d87dff254d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinit 2021-10-08T19:08:35.482 INFO:teuthology.task.ansible.out:y", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127239", "LimitNPROCSoft": "127239", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127239", "LimitSIGPENDINGSoft": "127239", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "867", "MemoryAccounting": "yes", "MemoryCurrent": "1257472", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit. 2021-10-08T19:08:35.484 INFO:teuthology.task.ansible.out:target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-10-08 19:00:22 UTC", "StateChangeTimestampMonotonic": "14908906", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203583", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-10-08 19:00:21 UTC", "WatchdogTimestampMonotonic": "13719624", "WatchdogUSec": "0"}} 2021-10-08T19:08:35.507 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.038) 0:07:07.910 ******** 2021-10-08T19:08:35.535 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-08T19:08:35.556 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.050) 0:07:07.961 ******** 2021-10-08T19:08:35.597 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:08:35.598 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-08T19:08:35.621 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.063) 0:07:08.024 ******** 2021-10-08T19:08:35.648 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-10-08T19:08:35.649 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.680 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.059) 0:07:08.084 ******** 2021-10-08T19:08:35.710 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.733 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.053) 0:07:08.137 ******** 2021-10-08T19:08:35.760 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:35.791 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.057) 0:07:08.195 ******** 2021-10-08T19:08:35.948 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-08T19:08:35.950 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-10-08T19:08:35.980 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:35 +0000 (0:00:00.189) 0:07:08.385 ******** 2021-10-08T19:08:36.000 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-10-08T19:08:36.002 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-10-08T19:08:36.027 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.047) 0:07:08.432 ******** 2021-10-08T19:08:36.278 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-08T19:08:36.280 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-10-08 19:00:41 UTC", "ActiveEnterTimestampMonotonic": "15127261", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice sntp.service systemd-tmpfiles-setup.service sysinit.target basic.target ntpdate.service -.mount tmp.mount ntpd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-10-08 19:00:40 UTC", "AssertTimestampMonotonic": "13554520", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read cap_perfmon", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-10-08 19:00:40 UTC", "ConditionTimestampMonotonic": "13554487", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service 2021-10-08T19:08:36.282 INFO:teuthology.task.ansible.out: systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "882", "ExecMainStartTimestamp": "Fri 2021-10-08 19:00:41 UTC", "ExecMainStartTimestampMonotonic": "15006815", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-10-08 19:00:40 UTC", "InactiveExitTimestampMonotonic": "13558890", "InvocationID": "166d2fb7917f45dba93031e58669bd70", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinit 2021-10-08T19:08:36.284 INFO:teuthology.task.ansible.out:y", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127239", "LimitNPROCSoft": "127239", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127239", "LimitSIGPENDINGSoft": "127239", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "882", "MemoryAccounting": "yes", "MemoryCurrent": "1253376", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system 2021-10-08T19:08:36.286 INFO:teuthology.task.ansible.out:.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-10-08 19:00:41 UTC", "StateChangeTimestampMonotonic": "15127261", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203583", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-10-08 19:00:41 UTC", "WatchdogTimestampMonotonic": "15006863", "WatchdogUSec": "0"}} 2021-10-08T19:08:36.306 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.279) 0:07:08.711 ******** 2021-10-08T19:08:36.335 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-08T19:08:36.358 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.051) 0:07:08.763 ******** 2021-10-08T19:08:36.397 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:08:36.399 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-08T19:08:36.421 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.062) 0:07:08.825 ******** 2021-10-08T19:08:36.451 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:36.476 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.055) 0:07:08.881 ******** 2021-10-08T19:08:36.505 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-10-08T19:08:36.509 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:36.532 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.055) 0:07:08.936 ******** 2021-10-08T19:08:36.555 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.022) 0:07:08.959 ******** 2021-10-08T19:08:36.563 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:36.589 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.034) 0:07:08.994 ******** 2021-10-08T19:08:36.791 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-10-08T19:08:36.793 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-10-08T19:08:36.817 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:36 +0000 (0:00:00.227) 0:07:09.221 ******** 2021-10-08T19:08:37.305 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-10-08T19:08:37.328 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:37 +0000 (0:00:00.511) 0:07:09.733 ******** 2021-10-08T19:08:37.827 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-10-08T19:08:37.856 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:37 +0000 (0:00:00.526) 0:07:10.259 ******** 2021-10-08T19:08:37.884 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-10-08T19:08:37.886 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:37.915 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:37 +0000 (0:00:00.056) 0:07:10.316 ******** 2021-10-08T19:08:37.939 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-08T19:08:37.964 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:37 +0000 (0:00:00.052) 0:07:10.368 ******** 2021-10-08T19:08:38.145 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-10-08T19:08:38.168 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.203) 0:07:10.572 ******** 2021-10-08T19:08:38.197 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-08T19:08:38.199 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.223 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.053) 0:07:10.626 ******** 2021-10-08T19:08:38.250 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-10-08T19:08:38.252 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-08T19:08:38.273 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.051) 0:07:10.678 ******** 2021-10-08T19:08:38.316 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.339 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.066) 0:07:10.744 ******** 2021-10-08T19:08:38.367 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-10-08T19:08:38.369 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-10-08T19:08:38.392 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.052) 0:07:10.797 ******** 2021-10-08T19:08:38.421 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-10-08T19:08:38.423 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.444 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.051) 0:07:10.848 ******** 2021-10-08T19:08:38.472 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-08T19:08:38.474 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-08T19:08:38.495 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.051) 0:07:10.900 ******** 2021-10-08T19:08:38.537 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-08T19:08:38.561 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.066) 0:07:10.966 ******** 2021-10-08T19:08:38.563 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:38.676 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-08T19:08:38.677 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-10-08T19:08:38.702 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.138) 0:07:11.104 ******** 2021-10-08T19:08:38.728 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-08T19:08:38.730 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.751 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.051) 0:07:11.155 ******** 2021-10-08T19:08:38.759 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-08T19:08:38.761 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-08T19:08:38.784 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.033) 0:07:11.189 ******** 2021-10-08T19:08:38.791 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-10-08T19:08:38.793 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-08T19:08:38.822 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.032) 0:07:11.222 ******** 2021-10-08T19:08:38.825 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-08T19:08:38.827 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.851 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.033) 0:07:11.255 ******** 2021-10-08T19:08:38.858 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.884 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.032) 0:07:11.288 ******** 2021-10-08T19:08:38.893 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:38.894 INFO:teuthology.task.ansible.out:TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-10-08T19:08:38.896 INFO:teuthology.task.ansible.out: skipping: [smithi142.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.896 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.897 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.912 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.936 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:38 +0000 (0:00:00.052) 0:07:11.341 ******** 2021-10-08T19:08:38.985 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:38.986 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.004 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.007 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.042 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.105) 0:07:11.447 ******** 2021-10-08T19:08:39.070 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:08:39.073 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-08T19:08:39.095 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.052) 0:07:11.499 ******** 2021-10-08T19:08:39.119 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.023) 0:07:11.523 ******** 2021-10-08T19:08:39.149 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-08T19:08:39.151 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.173 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.054) 0:07:11.578 ******** 2021-10-08T19:08:39.201 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-10-08T19:08:39.203 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.236 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.062) 0:07:11.640 ******** 2021-10-08T19:08:39.274 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.293 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.056) 0:07:11.697 ******** 2021-10-08T19:08:39.300 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-08T19:08:39.302 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-08T19:08:39.326 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.033) 0:07:11.730 ******** 2021-10-08T19:08:39.334 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.360 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.034) 0:07:11.764 ******** 2021-10-08T19:08:39.366 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-08T19:08:39.368 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.392 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.032) 0:07:11.796 ******** 2021-10-08T19:08:39.400 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-08T19:08:39.402 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.429 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.036) 0:07:11.833 ******** 2021-10-08T19:08:39.438 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi112.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.449 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.452 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.473 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.044) 0:07:11.878 ******** 2021-10-08T19:08:39.481 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-10-08T19:08:39.484 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.509 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.034) 0:07:11.912 ******** 2021-10-08T19:08:39.515 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-08T19:08:39.517 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.518 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.537 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi112.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.555 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.046) 0:07:11.959 ******** 2021-10-08T19:08:39.563 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-08T19:08:39.565 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.588 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.033) 0:07:11.992 ******** 2021-10-08T19:08:39.595 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-08T19:08:39.598 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.625 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.037) 0:07:12.030 ******** 2021-10-08T19:08:39.657 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-08T19:08:39.658 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.679 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.053) 0:07:12.083 ******** 2021-10-08T19:08:39.710 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.732 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.053) 0:07:12.137 ******** 2021-10-08T19:08:39.760 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:39.762 INFO:teuthology.task.ansible.out:TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.783 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.050) 0:07:12.188 ******** 2021-10-08T19:08:39.800 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-08T19:08:39.802 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005190", "end": "2021-10-08 19:08:39.770055", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-08 19:08:39.764865", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:39.812 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.843 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.056) 0:07:12.244 ******** 2021-10-08T19:08:39.878 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.909 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.069) 0:07:12.313 ******** 2021-10-08T19:08:39.946 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-10-08T19:08:39.948 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:39.973 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:39 +0000 (0:00:00.063) 0:07:12.377 ******** 2021-10-08T19:08:39.979 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-08T19:08:39.981 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003075", "end": "2021-10-08 19:08:39.942858", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-08 19:08:39.939783", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:40.003 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:40.025 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:40 +0000 (0:00:00.052) 0:07:12.430 ******** 2021-10-08T19:08:40.147 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-08T19:08:40.149 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002906", "end": "2021-10-08 19:08:40.115888", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:08:40.112982", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:40.232 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005349", "end": "2021-10-08 19:08:40.202972", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-08 19:08:40.197623", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:40.316 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003184", "end": "2021-10-08 19:08:40.293334", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-08 19:08:40.290150", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:40.342 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:40 +0000 (0:00:00.316) 0:07:12.746 ******** 2021-10-08T19:08:40.371 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-08T19:08:40.394 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:40 +0000 (0:00:00.051) 0:07:12.798 ******** 2021-10-08T19:08:40.414 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-08T19:08:40.416 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003017", "end": "2021-10-08 19:08:40.381404", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-08 19:08:40.378387", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:40.426 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:40.579 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-08T19:08:40.581 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003030", "end": "2021-10-08 19:08:40.555352", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-08 19:08:40.552322", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:40.758 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003241", "end": "2021-10-08 19:08:40.728496", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-08 19:08:40.725255", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:08:40.781 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:40 +0000 (0:00:00.387) 0:07:13.186 ******** 2021-10-08T19:08:40.812 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-08T19:08:40.834 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:40 +0000 (0:00:00.052) 0:07:13.238 ******** 2021-10-08T19:08:40.835 INFO:teuthology.task.ansible.out: 2021-10-08T19:08:40.862 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:40.937 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-10-08T19:08:40.955 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:40 +0000 (0:00:00.119) 0:07:13.358 ******** 2021-10-08T19:08:40.974 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:40 +0000 (0:00:00.020) 0:07:13.378 ******** 2021-10-08T19:08:41.625 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-08T19:08:41.627 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2021-10-08T19:08:41.634 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] 2021-10-08T19:08:41.703 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:41 +0000 (0:00:00.729) 0:07:14.108 ******** 2021-10-08T19:08:41.732 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:41 +0000 (0:00:00.028) 0:07:14.136 ******** 2021-10-08T19:08:41.739 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-08T19:08:41.741 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:41.764 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:41 +0000 (0:00:00.032) 0:07:14.168 ******** 2021-10-08T19:08:41.771 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:08:41.796 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:41 +0000 (0:00:00.031) 0:07:14.200 ******** 2021-10-08T19:08:41.815 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-10-08T19:08:41.837 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:41 +0000 (0:00:00.041) 0:07:14.242 ******** 2021-10-08T19:08:41.845 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-10-08T19:08:41.876 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:41 +0000 (0:00:00.032) 0:07:14.275 ******** 2021-10-08T19:08:41.887 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-10-08T19:08:41.889 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-10-08T19:08:41.913 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:41 +0000 (0:00:00.042) 0:07:14.318 ******** 2021-10-08T19:08:41.937 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-10-08T19:08:41.963 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:08:41 +0000 (0:00:00.050) 0:07:14.368 ******** 2021-10-08T19:09:01.681 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-10-08T19:09:01.683 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-catatonit-3.2.3-0.11.module+el8.4.0+12050+ef972f71.x86_64", "Installed: podman-3.2.3-0.11.module+el8.4.0+12050+ef972f71.x86_64", "Installed: podman-docker-3.2.3-0.11.module+el8.4.0+12050+ef972f71.noarch", "Removed: podman-3.0.1-6.module+el8.4.0+10607+f4da7515.x86_64", "Removed: podman-catatonit-3.0.1-6.module+el8.4.0+10607+f4da7515.x86_64", "Removed: podman-docker-3.0.1-6.module+el8.4.0+10607+f4da7515.noarch"]} 2021-10-08T19:09:01.706 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:01 +0000 (0:00:19.742) 0:07:34.110 ******** 2021-10-08T19:09:01.746 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi112.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-10-08T19:09:01.770 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:01 +0000 (0:00:00.063) 0:07:34.174 ******** 2021-10-08T19:09:01.802 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:01.804 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-catatonit-3.2.3-0.11.module+el8.4.0+12050+ef972f71.x86_64", "Installed: podman-3.2.3-0.11.module+el8.4.0+12050+ef972f71.x86_64", "Installed: podman-docker-3.2.3-0.11.module+el8.4.0+12050+ef972f71.noarch", "Removed: podman-3.0.1-6.module+el8.4.0+10607+f4da7515.x86_64", "Removed: podman-catatonit-3.0.1-6.module+el8.4.0+10607+f4da7515.x86_64", "Removed: podman-docker-3.0.1-6.module+el8.4.0+10607+f4da7515.noarch"]} 2021-10-08T19:09:01.826 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:01 +0000 (0:00:00.057) 0:07:34.231 ******** 2021-10-08T19:09:01.848 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:01 +0000 (0:00:00.022) 0:07:34.253 ******** 2021-10-08T19:09:01.882 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-10-08T19:09:01.905 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:01 +0000 (0:00:00.056) 0:07:34.309 ******** 2021-10-08T19:09:01.932 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:01.954 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:01 +0000 (0:00:00.049) 0:07:34.359 ******** 2021-10-08T19:09:02.046 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-08T19:09:02.048 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:09:02.176 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:09:02.219 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:09:02.248 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:02 +0000 (0:00:00.293) 0:07:34.652 ******** 2021-10-08T19:09:02.361 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-10-08T19:09:02.384 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:02 +0000 (0:00:00.136) 0:07:34.789 ******** 2021-10-08T19:09:02.731 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-08T19:09:02.735 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:09:02.915 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:09:03.183 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:09:03.213 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:03 +0000 (0:00:00.829) 0:07:35.618 ******** 2021-10-08T19:09:03.370 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-10-08T19:09:03.398 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:03 +0000 (0:00:00.184) 0:07:35.802 ******** 2021-10-08T19:09:16.871 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-10-08T19:09:16.873 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:16.895 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:16 +0000 (0:00:13.496) 0:07:49.299 ******** 2021-10-08T19:09:17.256 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-10-08T19:09:17.282 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:17 +0000 (0:00:00.386) 0:07:49.686 ******** 2021-10-08T19:09:19.406 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-10-08T19:09:19.408 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-u6rk5w0g-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-u6rk5w0g-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py in 2021-10-08T19:09:19.410 INFO:teuthology.task.ansible.out:stall for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-08T19:09:19.431 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:19 +0000 (0:00:02.148) 0:07:51.835 ******** 2021-10-08T19:09:19.462 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-08T19:09:19.464 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:19.487 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:19 +0000 (0:00:00.055) 0:07:51.891 ******** 2021-10-08T19:09:19.524 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-10-08T19:09:19.526 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:19.548 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:19 +0000 (0:00:00.060) 0:07:51.952 ******** 2021-10-08T19:09:19.837 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-goiwt203-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-goiwt203-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0 2021-10-08T19:09:19.839 INFO:teuthology.task.ansible.out::", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-08T19:09:19.868 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:19 +0000 (0:00:00.320) 0:07:52.272 ******** 2021-10-08T19:09:19.906 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-08T19:09:19.908 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.162483", "end": "2021-10-08 19:09:19.890455", "rc": 0, "start": "2021-10-08 19:09:19.727972", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:09:19.931 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:19 +0000 (0:00:00.063) 0:07:52.335 ******** 2021-10-08T19:09:19.954 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:19 +0000 (0:00:00.023) 0:07:52.359 ******** 2021-10-08T19:09:19.973 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-10-08T19:09:19.976 INFO:teuthology.task.ansible.out:skipping: [smithi112.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:19.996 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:20.028 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:20 +0000 (0:00:00.073) 0:07:52.432 ******** 2021-10-08T19:09:20.386 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-10-08T19:09:20.388 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.165657", "end": "2021-10-08 19:09:20.367901", "rc": 0, "start": "2021-10-08 19:09:20.202244", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-08T19:09:20.408 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:20 +0000 (0:00:00.380) 0:07:52.813 ******** 2021-10-08T19:09:20.448 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-10-08T19:09:20.450 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-08T19:09:20.527 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-10-08T19:09:20.528 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-10-08T19:09:20.530 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-10-08T19:09:20.532 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-08T19:09:20.548 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-08T19:09:20.550 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:20 +0000 (0:00:00.139) 0:07:52.953 ******** 2021-10-08T19:09:21.200 INFO:teuthology.task.ansible.out:ok: [smithi112.front.sepia.ceph.com] 2021-10-08T19:09:21.230 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2021-10-08T19:09:21.246 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Friday 08 October 2021 19:09:21 +0000 (0:00:00.698) 0:07:53.651 ******** 2021-10-08T19:09:21.440 INFO:teuthology.task.ansible.out:changed: [smithi112.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:09:21.465 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-10-08T19:09:21.466 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi112.front.sepia.ceph.com : ok=142 changed=42 unreachable=0 failed=0 skipped=178 rescued=0 ignored=4 smithi142.front.sepia.ceph.com : ok=142 changed=42 unreachable=0 failed=0 skipped=178 rescued=0 ignored=4 2021-10-08T19:09:21.467 INFO:teuthology.task.ansible.out:Friday 08 October 2021 19:09:21 +0000 (0:00:00.220) 0:07:53.871 ******** =============================================================================== 2021-10-08T19:09:21.468 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 58.23s common : nrpe - Ensure SELinux policy is up to date -------------------- 52.07s users : Update authorized_keys using the keys repo --------------------- 36.24s testnode : Install packages -------------------------------------------- 31.42s testnode : Ensure ceph packages are not present. ----------------------- 29.69s testnode : Ensure ceph dependency packages are not present. ------------ 27.48s container-host : Install container packages ---------------------------- 19.74s Remove revoked users --------------------------------------------------- 18.79s common : Register with subscription-manager. --------------------------- 16.83s common : nrpe - Remove SELinux policy package -------------------------- 15.37s common : nrpe - Load SELinux policy package ---------------------------- 15.19s container-host : Ensure git is installed ------------------------------- 13.50s common : Install Kerberos Packages (RedHat) ---------------------------- 13.50s testnode : Install epel packages --------------------------------------- 13.23s testnode : Zap all non-root disks --------------------------------------- 7.41s common : nrpe - Install SELinux dependencies ---------------------------- 2.87s testnode : Make sure rpm dependencies are installed --------------------- 2.77s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.57s common : Enable necessary rhsm repos ------------------------------------ 2.41s testnode : Remove packages ---------------------------------------------- 2.31s 2021-10-08T19:09:21.927 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2021-10-08T19:09:21.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2021-10-08T19:09:21.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:09:22.062 DEBUG:teuthology.orchestra.run.smithi112:> true 2021-10-08T19:09:22.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2021-10-08T19:09:22.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-08T19:09:22.204 DEBUG:teuthology.orchestra.run.smithi142:> true 2021-10-08T19:09:22.272 INFO:teuthology.run_tasks:Running task clock... 2021-10-08T19:09:22.296 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-10-08T19:09:22.296 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-08T19:09:22.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-08T19:09:22.332 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-10-08T19:09:22.347 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-10-08T19:09:22.387 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2021-10-08T19:09:22.396 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2021-10-08T19:09:22.412 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-10-08T19:09:22.425 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-10-08T19:09:22.492 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2021-10-08T19:09:22.494 INFO:teuthology.orchestra.run.smithi112.stdout:210 Number of sources = 4 2021-10-08T19:09:22.495 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-10-08T19:09:22.495 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2021-10-08T19:09:22.495 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:09:22.495 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:09:22.496 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:09:22.496 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:09:22.496 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-08T19:09:22.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-08T19:09:22.531 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-10-08T19:09:22.545 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-10-08T19:09:22.580 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2021-10-08T19:09:22.595 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2021-10-08T19:09:22.604 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-10-08T19:09:22.620 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-10-08T19:09:22.682 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2021-10-08T19:09:22.683 INFO:teuthology.orchestra.run.smithi142.stdout:210 Number of sources = 4 2021-10-08T19:09:22.684 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-10-08T19:09:22.684 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2021-10-08T19:09:22.684 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:09:22.684 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:09:22.684 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:09:22.685 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-10-08T19:09:22.685 INFO:teuthology.run_tasks:Running task pexec... 2021-10-08T19:09:22.704 INFO:teuthology.task.pexec:Executing custom commands... 2021-10-08T19:09:22.705 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi112.front.sepia.ceph.com 2021-10-08T19:09:22.705 DEBUG:teuthology.orchestra.run.smithi112:> TESTDIR=/home/ubuntu/cephtest bash -s 2021-10-08T19:09:22.706 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi142.front.sepia.ceph.com 2021-10-08T19:09:22.706 DEBUG:teuthology.orchestra.run.smithi142:> TESTDIR=/home/ubuntu/cephtest bash -s 2021-10-08T19:09:23.061 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:09:23.082 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:09:23.632 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 2021-10-08T19:09:23.651 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:09:23.758 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:09:23.828 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:09:25.774 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:09:25.775 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:09:25.775 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2021-10-08T19:09:25.775 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:09:25.775 INFO:teuthology.orchestra.run.smithi112.stdout:Resetting modules: 2021-10-08T19:09:25.776 INFO:teuthology.orchestra.run.smithi112.stdout: container-tools 2021-10-08T19:09:25.776 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:09:25.776 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:09:25.776 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:09:25.777 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:09:25.862 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:09:25.863 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:09:25.863 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2021-10-08T19:09:25.863 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:09:25.863 INFO:teuthology.orchestra.run.smithi142.stdout:Resetting modules: 2021-10-08T19:09:25.864 INFO:teuthology.orchestra.run.smithi142.stdout: container-tools 2021-10-08T19:09:25.864 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:09:25.864 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:09:25.864 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:09:25.864 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:09:36.158 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:08:54 PM UTC. 2021-10-08T19:09:36.355 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:08:53 PM UTC. 2021-10-08T19:09:38.550 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:09:38.756 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:09:38.956 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:09:39.165 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:09:39.499 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:09:39.672 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2021-10-08T19:09:44.592 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:09:44.705 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:09:49.923 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:06:20 PM UTC. 2021-10-08T19:09:50.167 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:06:20 PM UTC. 2021-10-08T19:09:52.665 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:09:52.667 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================================================== 2021-10-08T19:09:52.668 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:09:52.668 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================================================== 2021-10-08T19:09:52.668 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2021-10-08T19:09:52.668 INFO:teuthology.orchestra.run.smithi142.stdout: conmon x86_64 2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 52 k 2021-10-08T19:09:52.669 INFO:teuthology.orchestra.run.smithi142.stdout: container-selinux noarch 2:2.167.0-1.module+el8.4.0+12646+b6fd1bdf rhel-8-for-x86_64-appstream-rpms 52 k 2021-10-08T19:09:52.669 INFO:teuthology.orchestra.run.smithi142.stdout: containernetworking-plugins x86_64 0.9.1-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 20 M 2021-10-08T19:09:52.669 INFO:teuthology.orchestra.run.smithi142.stdout: containers-common x86_64 1:1.3.1-5.module+el8.4.0+11990+22932769 rhel-8-for-x86_64-appstream-rpms 95 k 2021-10-08T19:09:52.672 INFO:teuthology.orchestra.run.smithi142.stdout: criu x86_64 3.15-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 511 k 2021-10-08T19:09:52.673 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-overlayfs x86_64 1.6-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 73 k 2021-10-08T19:09:52.673 INFO:teuthology.orchestra.run.smithi142.stdout: libslirp x86_64 4.3.1-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 69 k 2021-10-08T19:09:52.673 INFO:teuthology.orchestra.run.smithi142.stdout: runc x86_64 1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 3.3 M 2021-10-08T19:09:52.673 INFO:teuthology.orchestra.run.smithi142.stdout: slirp4netns x86_64 1.1.8-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 51 k 2021-10-08T19:09:52.673 INFO:teuthology.orchestra.run.smithi142.stdout:Installing group/module packages: 2021-10-08T19:09:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: buildah x86_64 1.21.4-2.module+el8.4.0+12050+ef972f71 rhel-8-for-x86_64-appstream-rpms 8.2 M 2021-10-08T19:09:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: cockpit-podman noarch 32-2.module+el8.4.0+11990+22932769 rhel-8-for-x86_64-appstream-rpms 410 k 2021-10-08T19:09:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: crun x86_64 0.20.1-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 192 k 2021-10-08T19:09:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: skopeo x86_64 1:1.3.1-5.module+el8.4.0+11990+22932769 rhel-8-for-x86_64-appstream-rpms 7.0 M 2021-10-08T19:09:52.675 INFO:teuthology.orchestra.run.smithi142.stdout: toolbox noarch 0.0.8-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 16 k 2021-10-08T19:09:52.675 INFO:teuthology.orchestra.run.smithi142.stdout: udica noarch 0.2.4-2.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 51 k 2021-10-08T19:09:52.675 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:09:52.675 INFO:teuthology.orchestra.run.smithi142.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2021-10-08T19:09:52.675 INFO:teuthology.orchestra.run.smithi142.stdout:Installing module profiles: 2021-10-08T19:09:52.676 INFO:teuthology.orchestra.run.smithi142.stdout: container-tools/common 2021-10-08T19:09:52.676 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling module streams: 2021-10-08T19:09:52.676 INFO:teuthology.orchestra.run.smithi142.stdout: container-tools rhel8 2021-10-08T19:09:52.676 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:09:52.677 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:09:52.677 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================================================== 2021-10-08T19:09:52.677 INFO:teuthology.orchestra.run.smithi142.stdout:Install 7 Packages 2021-10-08T19:09:52.677 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 9 Packages 2021-10-08T19:09:52.677 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:09:52.678 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 40 M 2021-10-08T19:09:52.679 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:09:52.720 INFO:teuthology.orchestra.run.smithi142.stdout:(1/16): toolbox-0.0.8-1.module+el8.4.0+11822+6c 322 kB/s | 16 kB 00:00 2021-10-08T19:09:52.731 INFO:teuthology.orchestra.run.smithi142.stdout:(2/16): yajl-2.1.0-10.el8.x86_64.rpm 723 kB/s | 41 kB 00:00 2021-10-08T19:09:52.732 INFO:teuthology.orchestra.run.smithi142.stdout:(3/16): crun-0.20.1-1.module+el8.4.0+11822+6cc1 3.2 MB/s | 192 kB 00:00 2021-10-08T19:09:52.756 INFO:teuthology.orchestra.run.smithi142.stdout:(4/16): udica-0.2.4-2.module+el8.4.0+11822+6cc1 1.8 MB/s | 51 kB 00:00 2021-10-08T19:09:52.770 INFO:teuthology.orchestra.run.smithi142.stdout:(5/16): cockpit-podman-32-2.module+el8.4.0+1199 9.9 MB/s | 410 kB 00:00 2021-10-08T19:09:52.791 INFO:teuthology.orchestra.run.smithi142.stdout:(6/16): fuse-overlayfs-1.6-1.module+el8.4.0+118 3.4 MB/s | 73 kB 00:00 2021-10-08T19:09:52.838 INFO:teuthology.orchestra.run.smithi142.stdout:(7/16): skopeo-1.3.1-5.module+el8.4.0+11990+229 60 MB/s | 7.0 MB 00:00 2021-10-08T19:09:52.859 INFO:teuthology.orchestra.run.smithi142.stdout:(8/16): libslirp-4.3.1-1.module+el8.4.0+11822+6 3.4 MB/s | 69 kB 00:00 2021-10-08T19:09:52.867 INFO:teuthology.orchestra.run.smithi142.stdout:(9/16): runc-1.0.0-74.rc95.module+el8.4.0+11822 43 MB/s | 3.3 MB 00:00 2021-10-08T19:09:52.909 INFO:teuthology.orchestra.run.smithi142.stdout:(10/16): buildah-1.21.4-2.module+el8.4.0+12050+ 53 MB/s | 8.2 MB 00:00 2021-10-08T19:09:52.910 INFO:teuthology.orchestra.run.smithi142.stdout:(11/16): containers-common-1.3.1-5.module+el8.4 1.8 MB/s | 95 kB 00:00 2021-10-08T19:09:52.918 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:09:52.919 INFO:teuthology.orchestra.run.smithi112.stdout:========================================================================================================================== 2021-10-08T19:09:52.919 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:09:52.919 INFO:teuthology.orchestra.run.smithi112.stdout:========================================================================================================================== 2021-10-08T19:09:52.920 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2021-10-08T19:09:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: conmon x86_64 2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 52 k 2021-10-08T19:09:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: container-selinux noarch 2:2.167.0-1.module+el8.4.0+12646+b6fd1bdf rhel-8-for-x86_64-appstream-rpms 52 k 2021-10-08T19:09:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: containernetworking-plugins x86_64 0.9.1-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 20 M 2021-10-08T19:09:52.920 INFO:teuthology.orchestra.run.smithi112.stdout: containers-common x86_64 1:1.3.1-5.module+el8.4.0+11990+22932769 rhel-8-for-x86_64-appstream-rpms 95 k 2021-10-08T19:09:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: criu x86_64 3.15-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 511 k 2021-10-08T19:09:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-overlayfs x86_64 1.6-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 73 k 2021-10-08T19:09:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: libslirp x86_64 4.3.1-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 69 k 2021-10-08T19:09:52.921 INFO:teuthology.orchestra.run.smithi112.stdout: runc x86_64 1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 3.3 M 2021-10-08T19:09:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: slirp4netns x86_64 1.1.8-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 51 k 2021-10-08T19:09:52.922 INFO:teuthology.orchestra.run.smithi112.stdout:Installing group/module packages: 2021-10-08T19:09:52.922 INFO:teuthology.orchestra.run.smithi112.stdout: buildah x86_64 1.21.4-2.module+el8.4.0+12050+ef972f71 rhel-8-for-x86_64-appstream-rpms 8.2 M 2021-10-08T19:09:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: cockpit-podman noarch 32-2.module+el8.4.0+11990+22932769 rhel-8-for-x86_64-appstream-rpms 410 k 2021-10-08T19:09:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: crun x86_64 0.20.1-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 192 k 2021-10-08T19:09:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: skopeo x86_64 1:1.3.1-5.module+el8.4.0+11990+22932769 rhel-8-for-x86_64-appstream-rpms 7.0 M 2021-10-08T19:09:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: toolbox noarch 0.0.8-1.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 16 k 2021-10-08T19:09:52.923 INFO:teuthology.orchestra.run.smithi112.stdout: udica noarch 0.2.4-2.module+el8.4.0+11822+6cc1e7d7 rhel-8-for-x86_64-appstream-rpms 51 k 2021-10-08T19:09:52.924 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:09:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2021-10-08T19:09:52.924 INFO:teuthology.orchestra.run.smithi112.stdout:Installing module profiles: 2021-10-08T19:09:52.924 INFO:teuthology.orchestra.run.smithi112.stdout: container-tools/common 2021-10-08T19:09:52.925 INFO:teuthology.orchestra.run.smithi112.stdout:Enabling module streams: 2021-10-08T19:09:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: container-tools rhel8 2021-10-08T19:09:52.925 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:09:52.925 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:09:52.926 INFO:teuthology.orchestra.run.smithi112.stdout:========================================================================================================================== 2021-10-08T19:09:52.926 INFO:teuthology.orchestra.run.smithi112.stdout:Install 7 Packages 2021-10-08T19:09:52.926 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 9 Packages 2021-10-08T19:09:52.926 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:09:52.927 INFO:teuthology.orchestra.run.smithi142.stdout:(12/16): criu-3.15-1.module+el8.4.0+11822+6cc1e 9.3 MB/s | 511 kB 00:00 2021-10-08T19:09:52.928 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 40 M 2021-10-08T19:09:52.928 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:09:52.948 INFO:teuthology.orchestra.run.smithi142.stdout:(13/16): slirp4netns-1.1.8-1.module+el8.4.0+118 1.5 MB/s | 51 kB 00:00 2021-10-08T19:09:52.952 INFO:teuthology.orchestra.run.smithi142.stdout:(14/16): conmon-2.0.29-1.module+el8.4.0+11822+6 1.7 MB/s | 52 kB 00:00 2021-10-08T19:09:52.966 INFO:teuthology.orchestra.run.smithi142.stdout:(15/16): container-selinux-2.167.0-1.module+el8 2.3 MB/s | 52 kB 00:00 2021-10-08T19:09:52.970 INFO:teuthology.orchestra.run.smithi112.stdout:(1/16): yajl-2.1.0-10.el8.x86_64.rpm 851 kB/s | 41 kB 00:00 2021-10-08T19:09:52.978 INFO:teuthology.orchestra.run.smithi112.stdout:(2/16): toolbox-0.0.8-1.module+el8.4.0+11822+6c 284 kB/s | 16 kB 00:00 2021-10-08T19:09:52.991 INFO:teuthology.orchestra.run.smithi112.stdout:(3/16): crun-0.20.1-1.module+el8.4.0+11822+6cc1 2.8 MB/s | 192 kB 00:00 2021-10-08T19:09:53.002 INFO:teuthology.orchestra.run.smithi112.stdout:(4/16): udica-0.2.4-2.module+el8.4.0+11822+6cc1 2.0 MB/s | 51 kB 00:00 2021-10-08T19:09:53.022 INFO:teuthology.orchestra.run.smithi112.stdout:(5/16): cockpit-podman-32-2.module+el8.4.0+1199 14 MB/s | 410 kB 00:00 2021-10-08T19:09:53.049 INFO:teuthology.orchestra.run.smithi112.stdout:(6/16): fuse-overlayfs-1.6-1.module+el8.4.0+118 2.7 MB/s | 73 kB 00:00 2021-10-08T19:09:53.085 INFO:teuthology.orchestra.run.smithi112.stdout:(7/16): skopeo-1.3.1-5.module+el8.4.0+11990+229 61 MB/s | 7.0 MB 00:00 2021-10-08T19:09:53.105 INFO:teuthology.orchestra.run.smithi112.stdout:(8/16): libslirp-4.3.1-1.module+el8.4.0+11822+6 3.4 MB/s | 69 kB 00:00 2021-10-08T19:09:53.120 INFO:teuthology.orchestra.run.smithi142.stdout:(16/16): containernetworking-plugins-0.9.1-1.mo 96 MB/s | 20 MB 00:00 2021-10-08T19:09:53.121 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:09:53.121 INFO:teuthology.orchestra.run.smithi142.stdout:Total 89 MB/s | 40 MB 00:00 2021-10-08T19:09:53.128 INFO:teuthology.orchestra.run.smithi112.stdout:(9/16): runc-1.0.0-74.rc95.module+el8.4.0+11822 42 MB/s | 3.3 MB 00:00 2021-10-08T19:09:53.129 INFO:teuthology.orchestra.run.smithi112.stdout:(10/16): containers-common-1.3.1-5.module+el8.4 3.8 MB/s | 95 kB 00:00 2021-10-08T19:09:53.134 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:09:53.152 INFO:teuthology.orchestra.run.smithi112.stdout:(11/16): buildah-1.21.4-2.module+el8.4.0+12050+ 55 MB/s | 8.2 MB 00:00 2021-10-08T19:09:53.175 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:09:53.176 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:09:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:(12/16): criu-3.15-1.module+el8.4.0+11822+6cc1e 9.4 MB/s | 511 kB 00:00 2021-10-08T19:09:53.192 INFO:teuthology.orchestra.run.smithi112.stdout:(13/16): slirp4netns-1.1.8-1.module+el8.4.0+118 1.5 MB/s | 51 kB 00:00 2021-10-08T19:09:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:(14/16): conmon-2.0.29-1.module+el8.4.0+11822+6 2.2 MB/s | 52 kB 00:00 2021-10-08T19:09:53.212 INFO:teuthology.orchestra.run.smithi112.stdout:(15/16): container-selinux-2.167.0-1.module+el8 2.2 MB/s | 52 kB 00:00 2021-10-08T19:09:53.391 INFO:teuthology.orchestra.run.smithi112.stdout:(16/16): containernetworking-plugins-0.9.1-1.mo 78 MB/s | 20 MB 00:00 2021-10-08T19:09:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:09:53.392 INFO:teuthology.orchestra.run.smithi112.stdout:Total 86 MB/s | 40 MB 00:00 2021-10-08T19:09:53.405 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:09:53.447 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:09:53.447 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:09:53.515 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:09:53.522 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:09:53.794 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:09:53.801 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:09:54.447 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:09:54.476 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12646 1/25 2021-10-08T19:09:54.649 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : container-selinux-2:2.167.0-1.module+el8.4.0+12646 1/25 2021-10-08T19:09:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:09:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12646 1/25 2021-10-08T19:09:54.897 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : container-selinux-2:2.167.0-1.module+el8.4.0+12646 1/25 2021-10-08T19:10:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12646 1/25 2021-10-08T19:10:10.347 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12646 1/25 2021-10-08T19:10:10.865 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : criu-3.15-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2/25 2021-10-08T19:10:10.892 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : criu-3.15-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2/25 2021-10-08T19:10:11.069 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : runc-1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7.x 3/25 2021-10-08T19:10:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : runc-1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7.x 3/25 2021-10-08T19:10:11.211 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libslirp-4.3.1-1.module+el8.4.0+11822+6cc1e7d7.x86 4/25 2021-10-08T19:10:11.325 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libslirp-4.3.1-1.module+el8.4.0+11822+6cc1e7d7.x86 4/25 2021-10-08T19:10:11.396 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : slirp4netns-1.1.8-1.module+el8.4.0+11822+6cc1e7d7. 5/25 2021-10-08T19:10:11.494 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : slirp4netns-1.1.8-1.module+el8.4.0+11822+6cc1e7d7. 5/25 2021-10-08T19:10:11.588 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7 6/25 2021-10-08T19:10:11.620 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7 6/25 2021-10-08T19:10:11.620 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : containers-common-1:1.3.1-5.module+el8.4.0+11990+2 7/25 2021-10-08T19:10:11.620 INFO:teuthology.orchestra.run.smithi142.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2021-10-08T19:10:11.620 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:10:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7 6/25 2021-10-08T19:10:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7 6/25 2021-10-08T19:10:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : containers-common-1:1.3.1-5.module+el8.4.0+11990+2 7/25 2021-10-08T19:10:11.708 INFO:teuthology.orchestra.run.smithi112.stdout:warning: /etc/containers/registries.conf created as /etc/containers/registries.conf.rpmnew 2021-10-08T19:10:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:10:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : yajl-2.1.0-10.el8.x86_64 8/25 2021-10-08T19:10:12.111 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : yajl-2.1.0-10.el8.x86_64 8/25 2021-10-08T19:10:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : crun-0.20.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 9/25 2021-10-08T19:10:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : crun-0.20.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 9/25 2021-10-08T19:10:13.647 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : skopeo-1:1.3.1-5.module+el8.4.0+11990+22932769.x86 10/25 2021-10-08T19:10:13.696 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : skopeo-1:1.3.1-5.module+el8.4.0+11990+22932769.x86 10/25 2021-10-08T19:10:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : buildah-1.21.4-2.module+el8.4.0+12050+ef972f71.x86 11/25 2021-10-08T19:10:13.887 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : buildah-1.21.4-2.module+el8.4.0+12050+ef972f71.x86 11/25 2021-10-08T19:10:15.671 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : conmon-2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7.x8 12/25 2021-10-08T19:10:15.726 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : conmon-2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7.x8 12/25 2021-10-08T19:10:15.852 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : containernetworking-plugins-0.9.1-1.module+el8.4.0 13/25 2021-10-08T19:10:15.942 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : containernetworking-plugins-0.9.1-1.module+el8.4.0 13/25 2021-10-08T19:10:16.013 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cockpit-podman-32-2.module+el8.4.0+11990+22932769. 14/25 2021-10-08T19:10:16.122 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cockpit-podman-32-2.module+el8.4.0+11990+22932769. 14/25 2021-10-08T19:10:16.215 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : udica-0.2.4-2.module+el8.4.0+11822+6cc1e7d7.noarch 15/25 2021-10-08T19:10:16.297 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : udica-0.2.4-2.module+el8.4.0+11822+6cc1e7d7.noarch 15/25 2021-10-08T19:10:16.331 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : toolbox-0.0.8-1.module+el8.4.0+11822+6cc1e7d7.noar 16/25 2021-10-08T19:10:16.429 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : toolbox-0.0.8-1.module+el8.4.0+11822+6cc1e7d7.noar 16/25 2021-10-08T19:10:16.490 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : containers-common-1:1.2.2-8.module+el8.4.0+10607+f 17/25 2021-10-08T19:10:16.647 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : containers-common-1:1.2.2-8.module+el8.4.0+10607+f 17/25 2021-10-08T19:10:16.697 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : slirp4netns-1.1.8-1.module+el8.4.0+10607+f4da7515. 18/25 2021-10-08T19:10:16.803 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : slirp4netns-1.1.8-1.module+el8.4.0+10607+f4da7515. 18/25 2021-10-08T19:10:16.856 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : runc-1.0.0-70.rc92.module+el8.4.0+10607+f4da7515.x 19/25 2021-10-08T19:10:16.857 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : container-selinux-2:2.158.0-1.module+el8.4.0+10607 20/25 2021-10-08T19:10:16.979 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : runc-1.0.0-70.rc92.module+el8.4.0+10607+f4da7515.x 19/25 2021-10-08T19:10:16.979 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : container-selinux-2:2.158.0-1.module+el8.4.0+10607 20/25 2021-10-08T19:10:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module+el8.4.0+10607 20/25 2021-10-08T19:10:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: container-selinux-2:2.158.0-1.module+el8.4.0+10607 20/25 2021-10-08T19:10:17.173 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : criu-3.15-1.module+el8.4.0+10607+f4da7515.x86_64 21/25 2021-10-08T19:10:17.306 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : criu-3.15-1.module+el8.4.0+10607+f4da7515.x86_64 21/25 2021-10-08T19:10:17.338 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libslirp-4.3.1-1.module+el8.4.0+10607+f4da7515.x86 22/25 2021-10-08T19:10:17.445 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libslirp-4.3.1-1.module+el8.4.0+10607+f4da7515.x86 22/25 2021-10-08T19:10:17.490 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : fuse-overlayfs-1.4.0-2.module+el8.4.0+10607+f4da75 23/25 2021-10-08T19:10:17.578 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : fuse-overlayfs-1.4.0-2.module+el8.4.0+10607+f4da75 23/25 2021-10-08T19:10:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : conmon-2:2.0.26-1.module+el8.4.0+10607+f4da7515.x8 24/25 2021-10-08T19:10:17.701 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : conmon-2:2.0.26-1.module+el8.4.0+10607+f4da7515.x8 24/25 2021-10-08T19:10:17.763 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module+el8.4.0 25/25 2021-10-08T19:10:17.839 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : containernetworking-plugins-0.9.1-1.module+el8.4.0 25/25 2021-10-08T19:10:33.736 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12646 25/25 2021-10-08T19:10:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: container-selinux-2:2.167.0-1.module+el8.4.0+12646 25/25 2021-10-08T19:10:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module+el8.4.0 25/25 2021-10-08T19:10:34.099 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 1/25 2021-10-08T19:10:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : toolbox-0.0.8-1.module+el8.4.0+11822+6cc1e7d7.noar 2/25 2021-10-08T19:10:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : crun-0.20.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 3/25 2021-10-08T19:10:34.101 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : skopeo-1:1.3.1-5.module+el8.4.0+11990+22932769.x86 4/25 2021-10-08T19:10:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : udica-0.2.4-2.module+el8.4.0+11822+6cc1e7d7.noarch 5/25 2021-10-08T19:10:34.102 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cockpit-podman-32-2.module+el8.4.0+11990+22932769. 6/25 2021-10-08T19:10:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : buildah-1.21.4-2.module+el8.4.0+12050+ef972f71.x86 7/25 2021-10-08T19:10:34.104 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7 8/25 2021-10-08T19:10:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-overlayfs-1.4.0-2.module+el8.4.0+10607+f4da75 9/25 2021-10-08T19:10:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : runc-1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7.x 10/25 2021-10-08T19:10:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : runc-1.0.0-70.rc92.module+el8.4.0+10607+f4da7515.x 11/25 2021-10-08T19:10:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libslirp-4.3.1-1.module+el8.4.0+11822+6cc1e7d7.x86 12/25 2021-10-08T19:10:34.105 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libslirp-4.3.1-1.module+el8.4.0+10607+f4da7515.x86 13/25 2021-10-08T19:10:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : containers-common-1:1.3.1-5.module+el8.4.0+11990+2 14/25 2021-10-08T19:10:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : containers-common-1:1.2.2-8.module+el8.4.0+10607+f 15/25 2021-10-08T19:10:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : criu-3.15-1.module+el8.4.0+11822+6cc1e7d7.x86_64 16/25 2021-10-08T19:10:34.106 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : criu-3.15-1.module+el8.4.0+10607+f4da7515.x86_64 17/25 2021-10-08T19:10:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : containernetworking-plugins-0.9.1-1.module+el8.4.0 18/25 2021-10-08T19:10:34.107 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : containernetworking-plugins-0.9.1-1.module+el8.4.0 19/25 2021-10-08T19:10:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : slirp4netns-1.1.8-1.module+el8.4.0+11822+6cc1e7d7. 20/25 2021-10-08T19:10:34.108 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : slirp4netns-1.1.8-1.module+el8.4.0+10607+f4da7515. 21/25 2021-10-08T19:10:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : conmon-2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7.x8 22/25 2021-10-08T19:10:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : conmon-2:2.0.26-1.module+el8.4.0+10607+f4da7515.x8 23/25 2021-10-08T19:10:34.109 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : container-selinux-2:2.167.0-1.module+el8.4.0+12646 24/25 2021-10-08T19:10:34.284 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: containernetworking-plugins-0.9.1-1.module+el8.4.0 25/25 2021-10-08T19:10:34.286 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 1/25 2021-10-08T19:10:34.286 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : toolbox-0.0.8-1.module+el8.4.0+11822+6cc1e7d7.noar 2/25 2021-10-08T19:10:34.287 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : crun-0.20.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 3/25 2021-10-08T19:10:34.287 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : skopeo-1:1.3.1-5.module+el8.4.0+11990+22932769.x86 4/25 2021-10-08T19:10:34.287 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : udica-0.2.4-2.module+el8.4.0+11822+6cc1e7d7.noarch 5/25 2021-10-08T19:10:34.287 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cockpit-podman-32-2.module+el8.4.0+11990+22932769. 6/25 2021-10-08T19:10:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : buildah-1.21.4-2.module+el8.4.0+12050+ef972f71.x86 7/25 2021-10-08T19:10:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7 8/25 2021-10-08T19:10:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-overlayfs-1.4.0-2.module+el8.4.0+10607+f4da75 9/25 2021-10-08T19:10:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : runc-1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7.x 10/25 2021-10-08T19:10:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : runc-1.0.0-70.rc92.module+el8.4.0+10607+f4da7515.x 11/25 2021-10-08T19:10:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libslirp-4.3.1-1.module+el8.4.0+11822+6cc1e7d7.x86 12/25 2021-10-08T19:10:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libslirp-4.3.1-1.module+el8.4.0+10607+f4da7515.x86 13/25 2021-10-08T19:10:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : containers-common-1:1.3.1-5.module+el8.4.0+11990+2 14/25 2021-10-08T19:10:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : containers-common-1:1.2.2-8.module+el8.4.0+10607+f 15/25 2021-10-08T19:10:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : criu-3.15-1.module+el8.4.0+11822+6cc1e7d7.x86_64 16/25 2021-10-08T19:10:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : criu-3.15-1.module+el8.4.0+10607+f4da7515.x86_64 17/25 2021-10-08T19:10:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : containernetworking-plugins-0.9.1-1.module+el8.4.0 18/25 2021-10-08T19:10:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : containernetworking-plugins-0.9.1-1.module+el8.4.0 19/25 2021-10-08T19:10:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : slirp4netns-1.1.8-1.module+el8.4.0+11822+6cc1e7d7. 20/25 2021-10-08T19:10:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : slirp4netns-1.1.8-1.module+el8.4.0+10607+f4da7515. 21/25 2021-10-08T19:10:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : conmon-2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7.x8 22/25 2021-10-08T19:10:34.292 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : conmon-2:2.0.26-1.module+el8.4.0+10607+f4da7515.x8 23/25 2021-10-08T19:10:34.292 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : container-selinux-2:2.167.0-1.module+el8.4.0+12646 24/25 2021-10-08T19:10:34.663 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : container-selinux-2:2.158.0-1.module+el8.4.0+10607 25/25 2021-10-08T19:10:34.664 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:10:34.770 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : container-selinux-2:2.158.0-1.module+el8.4.0+10607 25/25 2021-10-08T19:10:34.771 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:10:45.365 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:09:31 PM UTC. 2021-10-08T19:10:45.388 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:09:31 PM UTC. 2021-10-08T19:10:47.909 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:10:47.909 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2021-10-08T19:10:47.909 INFO:teuthology.orchestra.run.smithi142.stdout: conmon-2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.910 INFO:teuthology.orchestra.run.smithi142.stdout: container-selinux-2:2.167.0-1.module+el8.4.0+12646+b6fd1bdf.noarch 2021-10-08T19:10:47.910 INFO:teuthology.orchestra.run.smithi142.stdout: containernetworking-plugins-0.9.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.910 INFO:teuthology.orchestra.run.smithi142.stdout: containers-common-1:1.3.1-5.module+el8.4.0+11990+22932769.x86_64 2021-10-08T19:10:47.910 INFO:teuthology.orchestra.run.smithi142.stdout: criu-3.15-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.911 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.911 INFO:teuthology.orchestra.run.smithi142.stdout: libslirp-4.3.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.911 INFO:teuthology.orchestra.run.smithi142.stdout: runc-1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.911 INFO:teuthology.orchestra.run.smithi142.stdout: slirp4netns-1.1.8-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.912 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:10:47.912 INFO:teuthology.orchestra.run.smithi142.stdout: buildah-1.21.4-2.module+el8.4.0+12050+ef972f71.x86_64 2021-10-08T19:10:47.912 INFO:teuthology.orchestra.run.smithi142.stdout: cockpit-podman-32-2.module+el8.4.0+11990+22932769.noarch 2021-10-08T19:10:47.912 INFO:teuthology.orchestra.run.smithi142.stdout: crun-0.20.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.912 INFO:teuthology.orchestra.run.smithi142.stdout: skopeo-1:1.3.1-5.module+el8.4.0+11990+22932769.x86_64 2021-10-08T19:10:47.913 INFO:teuthology.orchestra.run.smithi142.stdout: toolbox-0.0.8-1.module+el8.4.0+11822+6cc1e7d7.noarch 2021-10-08T19:10:47.913 INFO:teuthology.orchestra.run.smithi142.stdout: udica-0.2.4-2.module+el8.4.0+11822+6cc1e7d7.noarch 2021-10-08T19:10:47.913 INFO:teuthology.orchestra.run.smithi142.stdout: yajl-2.1.0-10.el8.x86_64 2021-10-08T19:10:47.913 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:10:47.914 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:10:47.927 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:10:47.927 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2021-10-08T19:10:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: conmon-2:2.0.29-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: container-selinux-2:2.167.0-1.module+el8.4.0+12646+b6fd1bdf.noarch 2021-10-08T19:10:47.928 INFO:teuthology.orchestra.run.smithi112.stdout: containernetworking-plugins-0.9.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.929 INFO:teuthology.orchestra.run.smithi112.stdout: containers-common-1:1.3.1-5.module+el8.4.0+11990+22932769.x86_64 2021-10-08T19:10:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: criu-3.15-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.930 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-overlayfs-1.6-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: libslirp-4.3.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: runc-1.0.0-74.rc95.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.931 INFO:teuthology.orchestra.run.smithi112.stdout: slirp4netns-1.1.8-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.932 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:10:47.932 INFO:teuthology.orchestra.run.smithi112.stdout: buildah-1.21.4-2.module+el8.4.0+12050+ef972f71.x86_64 2021-10-08T19:10:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: cockpit-podman-32-2.module+el8.4.0+11990+22932769.noarch 2021-10-08T19:10:47.933 INFO:teuthology.orchestra.run.smithi112.stdout: crun-0.20.1-1.module+el8.4.0+11822+6cc1e7d7.x86_64 2021-10-08T19:10:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: skopeo-1:1.3.1-5.module+el8.4.0+11990+22932769.x86_64 2021-10-08T19:10:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: toolbox-0.0.8-1.module+el8.4.0+11822+6cc1e7d7.noarch 2021-10-08T19:10:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: udica-0.2.4-2.module+el8.4.0+11822+6cc1e7d7.noarch 2021-10-08T19:10:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: yajl-2.1.0-10.el8.x86_64 2021-10-08T19:10:47.935 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:10:47.935 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:10:48.049 DEBUG:teuthology.parallel:result is None 2021-10-08T19:10:48.076 DEBUG:teuthology.parallel:result is None 2021-10-08T19:10:48.077 INFO:teuthology.run_tasks:Running task install... 2021-10-08T19:10:48.086 DEBUG:teuthology.task.install:project ceph 2021-10-08T19:10:48.087 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf'}, 'extra_packages': ['cephadm']} 2021-10-08T19:10:48.087 DEBUG:teuthology.task.install:config {'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf'} 2021-10-08T19:10:48.087 INFO:teuthology.task.install:Using flavor: basic 2021-10-08T19:10:48.095 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-10-08T19:10:48.096 INFO:teuthology.task.install:extra packages: [] 2021-10-08T19:10:48.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo lsb_release -is 2021-10-08T19:10:48.134 INFO:teuthology.orchestra.run.smithi112.stdout:RedHatEnterprise 2021-10-08T19:10:48.136 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-10-08T19:10:48.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2021-10-08T19:10:48.138 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'tag': None, 'wait_for_package': False} 2021-10-08T19:10:48.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo lsb_release -is 2021-10-08T19:10:48.176 INFO:teuthology.orchestra.run.smithi142.stdout:RedHatEnterprise 2021-10-08T19:10:48.177 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-10-08T19:10:48.178 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'tag': None, 'wait_for_package': False} 2021-10-08T19:10:48.178 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2021-10-08T19:10:48.212 INFO:teuthology.orchestra.run.smithi112.stdout:RedHatEnterprise 2021-10-08T19:10:48.213 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-10-08T19:10:48.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:10:48.254 INFO:teuthology.orchestra.run.smithi142.stdout:RedHatEnterprise 2021-10-08T19:10:48.256 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-10-08T19:10:48.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:10:48.371 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/ 2021-10-08T19:10:48.372 INFO:teuthology.task.install.rpm:Package version is 17.0.0-8087.g103b6cc3 2021-10-08T19:10:48.407 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/ 2021-10-08T19:10:48.408 INFO:teuthology.task.install.rpm:Package version is 17.0.0-8087.g103b6cc3 2021-10-08T19:10:48.490 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-10-08T19:10:48.490 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:10:48.491 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-10-08T19:10:48.514 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-10-08T19:10:48.515 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/103b6cc3554193fcd0852d9c647cef19e99920cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-10-08T19:10:48.525 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/master/103b6cc3554193fcd0852d9c647cef19e99920cf/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-10-08T19:10:48.525 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:10:48.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-10-08T19:10:48.551 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-10-08T19:10:48.551 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/103b6cc3554193fcd0852d9c647cef19e99920cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-10-08T19:10:48.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-10-08T19:10:48.616 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-10-08T19:10:48.653 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-10-08T19:10:48.689 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-10-08T19:10:48.716 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2021-10-08T19:10:48.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2021-10-08T19:10:48.752 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2021-10-08T19:10:48.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2021-10-08T19:10:49.073 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:10:49.109 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:10:49.383 INFO:teuthology.orchestra.run.smithi112.stdout:62 files removed 2021-10-08T19:10:49.417 INFO:teuthology.orchestra.run.smithi142.stdout:62 files removed 2021-10-08T19:10:49.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw 2021-10-08T19:10:49.462 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2021-10-08T19:10:49.745 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:10:49.780 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:10:50.413 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 279 kB/s | 75 kB 00:00 2021-10-08T19:10:50.434 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 276 kB/s | 75 kB 00:00 2021-10-08T19:10:50.661 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 41 kB/s | 9.0 kB 00:00 2021-10-08T19:10:50.696 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 39 kB/s | 9.0 kB 00:00 2021-10-08T19:10:50.898 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 6.5 kB/s | 1.4 kB 00:00 2021-10-08T19:10:50.946 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 6.2 kB/s | 1.4 kB 00:00 2021-10-08T19:10:52.813 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2021-10-08T19:10:52.815 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-10-08T19:10:53.506 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 16 MB/s | 10 MB 00:00 2021-10-08T19:10:53.580 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 14 MB/s | 10 MB 00:00 2021-10-08T19:10:55.611 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2021-10-08T19:10:55.720 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-10-08T19:10:55.941 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 135 MB/s | 37 MB 00:00 2021-10-08T19:10:56.033 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 127 MB/s | 33 MB 00:00 2021-10-08T19:11:01.258 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 138 MB/s | 37 MB 00:00 2021-10-08T19:11:01.261 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2021-10-08T19:11:09.536 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:11:09.538 INFO:teuthology.orchestra.run.smithi112.stdout:==================================================================================================== 2021-10-08T19:11:09.538 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:11:09.539 INFO:teuthology.orchestra.run.smithi112.stdout:==================================================================================================== 2021-10-08T19:11:09.539 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:11:09.539 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 8.9 M 2021-10-08T19:11:09.539 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2021-10-08T19:11:09.540 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.4 M 2021-10-08T19:11:09.540 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:11:09.540 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:11:09.540 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 5.2 M 2021-10-08T19:11:09.540 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 20 M 2021-10-08T19:11:09.541 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:11:09.541 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-10-08T19:11:09.541 INFO:teuthology.orchestra.run.smithi112.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-10-08T19:11:09.541 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 784 k 2021-10-08T19:11:09.542 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-10-08T19:11:09.542 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2021-10-08T19:11:09.542 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 483 k 2021-10-08T19:11:09.542 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2021-10-08T19:11:09.543 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:11:09.543 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-10-08T19:11:09.543 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2021-10-08T19:11:09.543 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 k 2021-10-08T19:11:09.544 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 78 k 2021-10-08T19:11:09.544 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 178 k 2021-10-08T19:11:09.544 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2021-10-08T19:11:09.545 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 366 k 2021-10-08T19:11:09.545 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 345 k 2021-10-08T19:11:09.546 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 109 k 2021-10-08T19:11:09.546 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:11:09.546 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:11:09.546 INFO:teuthology.orchestra.run.smithi112.stdout:==================================================================================================== 2021-10-08T19:11:09.546 INFO:teuthology.orchestra.run.smithi112.stdout:Install 21 Packages 2021-10-08T19:11:09.547 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 2 Packages 2021-10-08T19:11:09.547 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:11:09.548 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 49 M 2021-10-08T19:11:09.548 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:11:09.765 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:11:09.767 INFO:teuthology.orchestra.run.smithi142.stdout:==================================================================================================== 2021-10-08T19:11:09.767 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:11:09.767 INFO:teuthology.orchestra.run.smithi142.stdout:==================================================================================================== 2021-10-08T19:11:09.767 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:11:09.768 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 8.9 M 2021-10-08T19:11:09.768 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2021-10-08T19:11:09.768 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.4 M 2021-10-08T19:11:09.768 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:11:09.768 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:11:09.769 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 5.2 M 2021-10-08T19:11:09.769 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 20 M 2021-10-08T19:11:09.769 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:11:09.769 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-10-08T19:11:09.770 INFO:teuthology.orchestra.run.smithi142.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-10-08T19:11:09.770 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 784 k 2021-10-08T19:11:09.770 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-10-08T19:11:09.770 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2021-10-08T19:11:09.770 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 483 k 2021-10-08T19:11:09.771 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2021-10-08T19:11:09.771 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:11:09.771 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-10-08T19:11:09.771 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2021-10-08T19:11:09.772 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 k 2021-10-08T19:11:09.772 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 78 k 2021-10-08T19:11:09.772 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 178 k 2021-10-08T19:11:09.772 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2021-10-08T19:11:09.772 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 366 k 2021-10-08T19:11:09.773 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 345 k 2021-10-08T19:11:09.773 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 109 k 2021-10-08T19:11:09.773 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:11:09.774 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:11:09.774 INFO:teuthology.orchestra.run.smithi142.stdout:==================================================================================================== 2021-10-08T19:11:09.774 INFO:teuthology.orchestra.run.smithi142.stdout:Install 21 Packages 2021-10-08T19:11:09.774 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2021-10-08T19:11:09.775 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:11:09.775 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 49 M 2021-10-08T19:11:09.775 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:11:10.190 INFO:teuthology.orchestra.run.smithi112.stdout:(1/23): ceph-base-17.0.0-8087.g103b6cc3.el8.x86 8.0 MB/s | 5.2 MB 00:00 2021-10-08T19:11:10.242 INFO:teuthology.orchestra.run.smithi112.stdout:(2/23): ceph-selinux-17.0.0-8087.g103b6cc3.el8. 470 kB/s | 24 kB 00:00 2021-10-08T19:11:10.317 INFO:teuthology.orchestra.run.smithi112.stdout:(3/23): libcephfs2-17.0.0-8087.g103b6cc3.el8.x8 10 MB/s | 784 kB 00:00 2021-10-08T19:11:10.383 INFO:teuthology.orchestra.run.smithi112.stdout:(4/23): libradosstriper1-17.0.0-8087.g103b6cc3. 7.2 MB/s | 483 kB 00:00 2021-10-08T19:11:10.737 INFO:teuthology.orchestra.run.smithi112.stdout:(5/23): librgw2-17.0.0-8087.g103b6cc3.el8.x86_6 11 MB/s | 3.8 MB 00:00 2021-10-08T19:11:10.776 INFO:teuthology.orchestra.run.smithi112.stdout:(6/23): python3-ceph-argparse-17.0.0-8087.g103b 1.1 MB/s | 44 kB 00:00 2021-10-08T19:11:10.817 INFO:teuthology.orchestra.run.smithi112.stdout:(7/23): python3-ceph-common-17.0.0-8087.g103b6c 1.9 MB/s | 78 kB 00:00 2021-10-08T19:11:10.863 INFO:teuthology.orchestra.run.smithi112.stdout:(8/23): python3-cephfs-17.0.0-8087.g103b6cc3.el 3.9 MB/s | 178 kB 00:00 2021-10-08T19:11:10.915 INFO:teuthology.orchestra.run.smithi112.stdout:(9/23): python3-rados-17.0.0-8087.g103b6cc3.el8 6.8 MB/s | 366 kB 00:00 2021-10-08T19:11:10.968 INFO:teuthology.orchestra.run.smithi112.stdout:(10/23): python3-rbd-17.0.0-8087.g103b6cc3.el8. 6.4 MB/s | 345 kB 00:00 2021-10-08T19:11:11.012 INFO:teuthology.orchestra.run.smithi112.stdout:(11/23): python3-rgw-17.0.0-8087.g103b6cc3.el8. 2.5 MB/s | 109 kB 00:00 2021-10-08T19:11:11.071 INFO:teuthology.orchestra.run.smithi112.stdout:(12/23): ceph-radosgw-17.0.0-8087.g103b6cc3.el8 5.9 MB/s | 8.9 MB 00:01 2021-10-08T19:11:11.187 INFO:teuthology.orchestra.run.smithi112.stdout:(13/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2021-10-08T19:11:11.233 INFO:teuthology.orchestra.run.smithi112.stdout:(14/23): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2021-10-08T19:11:11.282 INFO:teuthology.orchestra.run.smithi112.stdout:(15/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2021-10-08T19:11:11.283 INFO:teuthology.orchestra.run.smithi112.stdout:(16/23): leveldb-1.22-1.el8.x86_64.rpm 858 kB/s | 181 kB 00:00 2021-10-08T19:11:11.320 INFO:teuthology.orchestra.run.smithi112.stdout:(17/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.2 MB/s | 47 kB 00:00 2021-10-08T19:11:11.330 INFO:teuthology.orchestra.run.smithi112.stdout:(18/23): librdkafka-0.11.4-1.el8.x86_64.rpm 7.2 MB/s | 353 kB 00:00 2021-10-08T19:11:11.344 INFO:teuthology.orchestra.run.smithi112.stdout:(19/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2021-10-08T19:11:11.356 INFO:teuthology.orchestra.run.smithi112.stdout:(20/23): python3-prettytable-0.7.2-14.el8.noarc 2.0 MB/s | 44 kB 00:00 2021-10-08T19:11:11.706 INFO:teuthology.orchestra.run.smithi112.stdout:(21/23): librados2-17.0.0-8087.g103b6cc3.el8.x8 9.6 MB/s | 3.4 MB 00:00 2021-10-08T19:11:11.905 INFO:teuthology.orchestra.run.smithi142.stdout:(1/23): ceph-base-17.0.0-8087.g103b6cc3.el8.x86 2.4 MB/s | 5.2 MB 00:02 2021-10-08T19:11:11.931 INFO:teuthology.orchestra.run.smithi142.stdout:(2/23): ceph-selinux-17.0.0-8087.g103b6cc3.el8. 924 kB/s | 24 kB 00:00 2021-10-08T19:11:11.939 INFO:teuthology.orchestra.run.smithi112.stdout:(22/23): ceph-common-17.0.0-8087.g103b6cc3.el8. 8.3 MB/s | 20 MB 00:02 2021-10-08T19:11:12.035 INFO:teuthology.orchestra.run.smithi142.stdout:(3/23): libcephfs2-17.0.0-8087.g103b6cc3.el8.x8 7.4 MB/s | 784 kB 00:00 2021-10-08T19:11:12.097 INFO:teuthology.orchestra.run.smithi112.stdout:(23/23): librbd1-17.0.0-8087.g103b6cc3.el8.x86_ 5.2 MB/s | 3.9 MB 00:00 2021-10-08T19:11:12.100 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:11:12.100 INFO:teuthology.orchestra.run.smithi112.stdout:Total 19 MB/s | 49 MB 00:02 2021-10-08T19:11:12.103 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:11:12.109 INFO:teuthology.orchestra.run.smithi142.stdout:(4/23): libradosstriper1-17.0.0-8087.g103b6cc3. 6.4 MB/s | 483 kB 00:00 2021-10-08T19:11:12.146 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:11:12.147 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:11:12.418 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:11:12.422 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:11:12.442 INFO:teuthology.orchestra.run.smithi142.stdout:(5/23): librgw2-17.0.0-8087.g103b6cc3.el8.x86_6 12 MB/s | 3.8 MB 00:00 2021-10-08T19:11:12.467 INFO:teuthology.orchestra.run.smithi142.stdout:(6/23): python3-ceph-argparse-17.0.0-8087.g103b 1.8 MB/s | 44 kB 00:00 2021-10-08T19:11:12.492 INFO:teuthology.orchestra.run.smithi142.stdout:(7/23): python3-ceph-common-17.0.0-8087.g103b6c 3.1 MB/s | 78 kB 00:00 2021-10-08T19:11:12.521 INFO:teuthology.orchestra.run.smithi142.stdout:(8/23): python3-cephfs-17.0.0-8087.g103b6cc3.el 5.9 MB/s | 178 kB 00:00 2021-10-08T19:11:12.554 INFO:teuthology.orchestra.run.smithi142.stdout:(9/23): python3-rados-17.0.0-8087.g103b6cc3.el8 11 MB/s | 366 kB 00:00 2021-10-08T19:11:12.593 INFO:teuthology.orchestra.run.smithi142.stdout:(10/23): python3-rbd-17.0.0-8087.g103b6cc3.el8. 8.8 MB/s | 345 kB 00:00 2021-10-08T19:11:12.620 INFO:teuthology.orchestra.run.smithi142.stdout:(11/23): python3-rgw-17.0.0-8087.g103b6cc3.el8. 4.0 MB/s | 109 kB 00:00 2021-10-08T19:11:12.795 INFO:teuthology.orchestra.run.smithi142.stdout:(12/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2021-10-08T19:11:12.874 INFO:teuthology.orchestra.run.smithi142.stdout:(13/23): leveldb-1.22-1.el8.x86_64.rpm 2.2 MB/s | 181 kB 00:00 2021-10-08T19:11:12.900 INFO:teuthology.orchestra.run.smithi142.stdout:(14/23): liboath-2.6.2-3.el8.x86_64.rpm 2.3 MB/s | 59 kB 00:00 2021-10-08T19:11:12.925 INFO:teuthology.orchestra.run.smithi142.stdout:(15/23): libunwind-1.3.1-3.el8.x86_64.rpm 2.9 MB/s | 75 kB 00:00 2021-10-08T19:11:12.958 INFO:teuthology.orchestra.run.smithi142.stdout:(16/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2021-10-08T19:11:12.983 INFO:teuthology.orchestra.run.smithi142.stdout:(17/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2021-10-08T19:11:13.003 INFO:teuthology.orchestra.run.smithi142.stdout:(18/23): python3-prettytable-0.7.2-14.el8.noarc 2.0 MB/s | 44 kB 00:00 2021-10-08T19:11:13.024 INFO:teuthology.orchestra.run.smithi142.stdout:(19/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.2 MB/s | 47 kB 00:00 2021-10-08T19:11:13.387 INFO:teuthology.orchestra.run.smithi142.stdout:(20/23): librados2-17.0.0-8087.g103b6cc3.el8.x8 9.4 MB/s | 3.4 MB 00:00 2021-10-08T19:11:13.450 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:11:13.571 INFO:teuthology.orchestra.run.smithi142.stdout:(21/23): librbd1-17.0.0-8087.g103b6cc3.el8.x86_ 21 MB/s | 3.9 MB 00:00 2021-10-08T19:11:13.629 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2021-10-08T19:11:14.015 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2021-10-08T19:11:14.219 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:11:14.321 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:11:14.503 INFO:teuthology.orchestra.run.smithi142.stdout:(22/23): ceph-radosgw-17.0.0-8087.g103b6cc3.el8 1.9 MB/s | 8.9 MB 00:04 2021-10-08T19:11:14.517 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:11:14.735 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2021-10-08T19:11:14.912 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:11:15.352 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:11:15.545 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:11:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:11:15.779 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 7/25 2021-10-08T19:11:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 7/25 2021-10-08T19:11:16.317 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2021-10-08T19:11:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:11:16.576 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:11:16.734 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-10-08T19:11:16.761 INFO:teuthology.orchestra.run.smithi142.stdout:(23/23): ceph-common-17.0.0-8087.g103b6cc3.el8. 2.9 MB/s | 20 MB 00:06 2021-10-08T19:11:16.766 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:11:16.766 INFO:teuthology.orchestra.run.smithi142.stdout:Total 7.0 MB/s | 49 MB 00:06 2021-10-08T19:11:16.771 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:11:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:11:16.818 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:11:16.871 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 11/25 2021-10-08T19:11:17.022 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:11:17.089 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:11:17.093 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:11:17.220 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:11:17.454 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 14/25 2021-10-08T19:11:17.611 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:11:17.678 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:11:17.803 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-10-08T19:11:17.985 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2021-10-08T19:11:18.127 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:11:18.205 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-10-08T19:11:18.311 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2021-10-08T19:11:18.361 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 19/25 2021-10-08T19:11:18.685 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2021-10-08T19:11:18.911 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:11:19.018 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:11:19.188 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:11:19.410 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2021-10-08T19:11:19.611 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:11:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:11:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:11:20.256 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/25 2021-10-08T19:11:20.418 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-10-08T19:11:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:11:20.956 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-10-08T19:11:21.086 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:11:21.163 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 9/25 2021-10-08T19:11:21.309 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-10-08T19:11:21.429 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 11/25 2021-10-08T19:11:21.597 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:11:21.802 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:11:21.996 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 14/25 2021-10-08T19:11:22.146 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:11:22.215 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 15/25 2021-10-08T19:11:22.428 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:11:22.436 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-10-08T19:11:22.603 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2021-10-08T19:11:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:11:22.791 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-10-08T19:11:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 19/25 2021-10-08T19:11:23.242 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:11:23.530 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:11:23.623 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:11:23.787 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:11:27.007 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:11:27.202 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:11:27.773 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 20/25 2021-10-08T19:11:28.461 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:11:28.568 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 21/25 2021-10-08T19:11:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:11:41.519 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:11:41.519 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2021-10-08T19:11:41.520 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2021-10-08T19:11:41.521 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2021-10-08T19:11:41.521 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /run 2021-10-08T19:11:41.522 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2021-10-08T19:11:41.522 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2021-10-08T19:11:41.522 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2021-10-08T19:11:41.522 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2021-10-08T19:11:41.523 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2021-10-08T19:11:41.523 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:11:42.731 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:11:42.802 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:11:42.802 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:11:43.002 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:11:43.002 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:11:43.682 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:11:43.682 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/25 2021-10-08T19:11:43.682 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:11:43.683 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:11:43.683 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:11:43.683 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:11:43.683 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 6/25 2021-10-08T19:11:43.684 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/25 2021-10-08T19:11:43.684 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 8/25 2021-10-08T19:11:43.684 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 9/25 2021-10-08T19:11:43.684 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 10/25 2021-10-08T19:11:43.684 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 11/25 2021-10-08T19:11:43.685 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:11:43.685 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:11:43.685 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2021-10-08T19:11:43.685 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : leveldb-1.22-1.el8.x86_64 15/25 2021-10-08T19:11:43.685 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 16/25 2021-10-08T19:11:43.686 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 17/25 2021-10-08T19:11:43.686 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 18/25 2021-10-08T19:11:43.687 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 19/25 2021-10-08T19:11:43.687 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 20/25 2021-10-08T19:11:43.687 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 21/25 2021-10-08T19:11:43.687 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:11:43.688 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-10-08T19:11:43.689 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 24/25 2021-10-08T19:11:44.322 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:11:44.322 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:11:46.309 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:11:46.310 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2021-10-08T19:11:46.310 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2021-10-08T19:11:46.310 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2021-10-08T19:11:46.311 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /run 2021-10-08T19:11:46.311 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2021-10-08T19:11:46.312 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2021-10-08T19:11:46.312 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2021-10-08T19:11:46.312 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2021-10-08T19:11:46.312 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2021-10-08T19:11:46.313 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:11:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:11:47.539 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 23/25 2021-10-08T19:11:47.539 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:11:47.776 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-10-08T19:11:47.776 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:11:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:11:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/25 2021-10-08T19:11:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/25 2021-10-08T19:11:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/25 2021-10-08T19:11:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/25 2021-10-08T19:11:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/25 2021-10-08T19:11:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_6 6/25 2021-10-08T19:11:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 7/25 2021-10-08T19:11:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8. 8/25 2021-10-08T19:11:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x8 9/25 2021-10-08T19:11:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 10/25 2021-10-08T19:11:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 11/25 2021-10-08T19:11:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 12/25 2021-10-08T19:11:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 13/25 2021-10-08T19:11:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2021-10-08T19:11:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : leveldb-1.22-1.el8.x86_64 15/25 2021-10-08T19:11:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 16/25 2021-10-08T19:11:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 17/25 2021-10-08T19:11:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 18/25 2021-10-08T19:11:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 19/25 2021-10-08T19:11:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 20/25 2021-10-08T19:11:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2021-10-08T19:11:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 22/25 2021-10-08T19:11:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-10-08T19:11:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 24/25 2021-10-08T19:11:49.179 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-10-08T19:11:49.179 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:11:55.111 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:11:50 PM UTC. 2021-10-08T19:11:57.712 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:11:57.713 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2021-10-08T19:11:57.714 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.715 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.715 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:11:57.715 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.715 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.716 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.716 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.716 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-10-08T19:11:57.717 INFO:teuthology.orchestra.run.smithi112.stdout: leveldb-1.22-1.el8.x86_64 2021-10-08T19:11:57.717 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.717 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.2-3.el8.x86_64 2021-10-08T19:11:57.718 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-10-08T19:11:57.718 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.718 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-10-08T19:11:57.718 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.3.1-3.el8.x86_64 2021-10-08T19:11:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-10-08T19:11:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.719 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-10-08T19:11:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:11:57.720 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:11:57.721 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:11:57.879 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-test 2021-10-08T19:11:58.205 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:11:58.688 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-10-08T19:12:00.658 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:11:55 PM UTC. 2021-10-08T19:12:03.392 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:12:03.393 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2021-10-08T19:12:03.393 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.394 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.394 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:12:03.395 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.395 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.395 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.396 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.396 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-10-08T19:12:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: leveldb-1.22-1.el8.x86_64 2021-10-08T19:12:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.2-3.el8.x86_64 2021-10-08T19:12:03.399 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-10-08T19:12:03.399 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.399 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-10-08T19:12:03.399 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.400 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.3.1-3.el8.x86_64 2021-10-08T19:12:03.400 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-10-08T19:12:03.400 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.400 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.400 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.401 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-10-08T19:12:03.401 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.401 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.401 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:03.402 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:12:03.402 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:12:03.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2021-10-08T19:12:03.811 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 86 kB/s | 2.8 kB 00:00 2021-10-08T19:12:03.883 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:12:04.387 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-10-08T19:12:08.717 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:12:09.490 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-10-08T19:12:11.245 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:12:11.245 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================ 2021-10-08T19:12:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:12:11.246 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================ 2021-10-08T19:12:11.246 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:12:11.246 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 M 2021-10-08T19:12:11.247 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:12:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2021-10-08T19:12:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 170 k 2021-10-08T19:12:11.247 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2021-10-08T19:12:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2021-10-08T19:12:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-10-08T19:12:11.248 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:12:11.248 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:12:11.248 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================ 2021-10-08T19:12:11.249 INFO:teuthology.orchestra.run.smithi112.stdout:Install 6 Packages 2021-10-08T19:12:11.249 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:12:11.250 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 45 M 2021-10-08T19:12:11.250 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 210 M 2021-10-08T19:12:11.250 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:12:11.365 INFO:teuthology.orchestra.run.smithi112.stdout:(1/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 592 kB/s | 69 kB 00:00 2021-10-08T19:12:11.397 INFO:teuthology.orchestra.run.smithi112.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 4.9 MB/s | 161 kB 00:00 2021-10-08T19:12:11.419 INFO:teuthology.orchestra.run.smithi112.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 8.4 MB/s | 187 kB 00:00 2021-10-08T19:12:11.420 INFO:teuthology.orchestra.run.smithi112.stdout:(4/6): libcephsqlite-17.0.0-8087.g103b6cc3.el8. 986 kB/s | 170 kB 00:00 2021-10-08T19:12:11.441 INFO:teuthology.orchestra.run.smithi112.stdout:(5/6): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2021-10-08T19:12:13.307 INFO:teuthology.orchestra.run.smithi112.stdout:(6/6): ceph-test-17.0.0-8087.g103b6cc3.el8.x86_ 22 MB/s | 44 MB 00:02 2021-10-08T19:12:13.310 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:12:13.311 INFO:teuthology.orchestra.run.smithi112.stdout:Total 22 MB/s | 45 MB 00:02 2021-10-08T19:12:13.314 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:12:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:12:13.339 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:12:13.582 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:12:13.586 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:12:14.036 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:12:14.223 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2021-10-08T19:12:14.403 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2021-10-08T19:12:14.486 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2021-10-08T19:12:14.630 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2021-10-08T19:12:14.768 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 4/6 2021-10-08T19:12:14.828 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:12:14.895 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/6 2021-10-08T19:12:17.388 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:12:17.390 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2021-10-08T19:12:17.391 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:12:17.391 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2021-10-08T19:12:17.391 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:12:17.392 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 44 M 2021-10-08T19:12:17.392 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:12:17.393 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2021-10-08T19:12:17.394 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 170 k 2021-10-08T19:12:17.394 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2021-10-08T19:12:17.395 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2021-10-08T19:12:17.395 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-10-08T19:12:17.396 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:12:17.396 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:12:17.396 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2021-10-08T19:12:17.397 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2021-10-08T19:12:17.397 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:12:17.397 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 45 M 2021-10-08T19:12:17.397 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 210 M 2021-10-08T19:12:17.397 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:12:17.507 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 602 kB/s | 69 kB 00:00 2021-10-08T19:12:17.540 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 4.8 MB/s | 161 kB 00:00 2021-10-08T19:12:17.562 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 8.4 MB/s | 187 kB 00:00 2021-10-08T19:12:17.564 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): libcephsqlite-17.0.0-8087.g103b6cc3.el8. 982 kB/s | 170 kB 00:00 2021-10-08T19:12:17.585 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2021-10-08T19:12:19.270 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/6 2021-10-08T19:12:19.482 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): ceph-test-17.0.0-8087.g103b6cc3.el8.x86_ 21 MB/s | 44 MB 00:02 2021-10-08T19:12:19.486 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:12:19.486 INFO:teuthology.orchestra.run.smithi142.stdout:Total 22 MB/s | 45 MB 00:02 2021-10-08T19:12:19.489 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:12:19.491 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/6 2021-10-08T19:12:19.512 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:12:19.513 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:12:19.743 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/6 2021-10-08T19:12:19.744 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/6 2021-10-08T19:12:19.744 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/6 2021-10-08T19:12:19.745 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 3/6 2021-10-08T19:12:19.745 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2021-10-08T19:12:19.745 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2021-10-08T19:12:19.758 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:12:19.762 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:12:20.091 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2021-10-08T19:12:20.092 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:12:20.243 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:12:20.421 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2021-10-08T19:12:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2021-10-08T19:12:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2021-10-08T19:12:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2021-10-08T19:12:20.965 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 4/6 2021-10-08T19:12:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/6 2021-10-08T19:12:25.449 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/6 2021-10-08T19:12:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/6 2021-10-08T19:12:25.899 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 6/6 2021-10-08T19:12:25.899 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/6 2021-10-08T19:12:25.900 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/6 2021-10-08T19:12:25.900 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 3/6 2021-10-08T19:12:25.900 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2021-10-08T19:12:25.900 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2021-10-08T19:12:26.247 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2021-10-08T19:12:26.247 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:12:30.382 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:11:50 PM UTC. 2021-10-08T19:12:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:12:32.904 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:12:32.904 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: jq-1.5-12.el8.x86_64 2021-10-08T19:12:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma-6.8.2-2.el8.x86_64 2021-10-08T19:12:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.3.3-2.el8.x86_64 2021-10-08T19:12:32.905 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-10-08T19:12:32.906 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:12:32.906 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:12:33.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph 2021-10-08T19:12:33.359 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:12:33.890 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 2021-10-08T19:12:36.575 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:11:55 PM UTC. 2021-10-08T19:12:39.082 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:12:39.082 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:12:39.082 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:39.082 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.5-12.el8.x86_64 2021-10-08T19:12:39.083 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:12:39.083 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.8.2-2.el8.x86_64 2021-10-08T19:12:39.083 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.3.3-2.el8.x86_64 2021-10-08T19:12:39.083 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-10-08T19:12:39.084 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:12:39.084 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:12:39.099 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2021-10-08T19:12:39.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2021-10-08T19:12:39.527 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:12:40.007 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-10-08T19:12:44.064 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:12:44.942 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-10-08T19:12:46.614 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:12:46.618 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================================= 2021-10-08T19:12:46.618 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:12:46.618 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================================= 2021-10-08T19:12:46.619 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:12:46.619 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 6.4 k 2021-10-08T19:12:46.619 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:12:46.619 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 2.3 M 2021-10-08T19:12:46.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 1.5 M 2021-10-08T19:12:46.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 214 k 2021-10-08T19:12:46.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:12:46.620 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 17 M 2021-10-08T19:12:46.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-10-08T19:12:46.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-10-08T19:12:46.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2021-10-08T19:12:46.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-10-08T19:12:46.621 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-10-08T19:12:46.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2021-10-08T19:12:46.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-10-08T19:12:46.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-10-08T19:12:46.622 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-10-08T19:12:46.623 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2021-10-08T19:12:46.623 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2021-10-08T19:12:46.623 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-10-08T19:12:46.624 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-10-08T19:12:46.624 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-10-08T19:12:46.624 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2021-10-08T19:12:46.624 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2021-10-08T19:12:46.625 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2021-10-08T19:12:46.625 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-10-08T19:12:46.625 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-10-08T19:12:46.625 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-10-08T19:12:46.626 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-10-08T19:12:46.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-10-08T19:12:46.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-10-08T19:12:46.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-10-08T19:12:46.627 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2021-10-08T19:12:46.628 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-10-08T19:12:46.628 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:12:46.628 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:12:46.628 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================================= 2021-10-08T19:12:46.628 INFO:teuthology.orchestra.run.smithi112.stdout:Install 32 Packages 2021-10-08T19:12:46.629 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:12:46.630 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 28 M 2021-10-08T19:12:46.630 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 112 M 2021-10-08T19:12:46.630 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:12:46.725 INFO:teuthology.orchestra.run.smithi112.stdout:(1/32): ceph-17.0.0-8087.g103b6cc3.el8.x86_64.r 63 kB/s | 6.4 kB 00:00 2021-10-08T19:12:46.995 INFO:teuthology.orchestra.run.smithi112.stdout:(2/32): ceph-mgr-17.0.0-8087.g103b6cc3.el8.x86_ 4.1 MB/s | 1.5 MB 00:00 2021-10-08T19:12:47.078 INFO:teuthology.orchestra.run.smithi112.stdout:(3/32): ceph-mds-17.0.0-8087.g103b6cc3.el8.x86_ 5.0 MB/s | 2.3 MB 00:00 2021-10-08T19:12:47.108 INFO:teuthology.orchestra.run.smithi112.stdout:(4/32): ceph-mgr-modules-core-17.0.0-8087.g103b 7.0 MB/s | 214 kB 00:00 2021-10-08T19:12:47.219 INFO:teuthology.orchestra.run.smithi112.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 393 kB/s | 44 kB 00:00 2021-10-08T19:12:47.230 INFO:teuthology.orchestra.run.smithi112.stdout:(6/32): ceph-mon-17.0.0-8087.g103b6cc3.el8.x86_ 7.7 MB/s | 3.9 MB 00:00 2021-10-08T19:12:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:(7/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 2.2 MB/s | 185 kB 00:00 2021-10-08T19:12:47.359 INFO:teuthology.orchestra.run.smithi112.stdout:(8/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 6.6 MB/s | 384 kB 00:00 2021-10-08T19:12:47.369 INFO:teuthology.orchestra.run.smithi112.stdout:(9/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2021-10-08T19:12:47.387 INFO:teuthology.orchestra.run.smithi112.stdout:(10/32): python3-jaraco-6.2-6.el8.noarch.rpm 400 kB/s | 11 kB 00:00 2021-10-08T19:12:47.397 INFO:teuthology.orchestra.run.smithi112.stdout:(11/32): python3-jaraco-functools-2.0-4.el8.noa 633 kB/s | 18 kB 00:00 2021-10-08T19:12:47.416 INFO:teuthology.orchestra.run.smithi112.stdout:(12/32): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2021-10-08T19:12:47.426 INFO:teuthology.orchestra.run.smithi112.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 2.0 MB/s | 59 kB 00:00 2021-10-08T19:12:47.454 INFO:teuthology.orchestra.run.smithi112.stdout:(14/32): python3-portend-2.6-1.el8.noarch.rpm 561 kB/s | 16 kB 00:00 2021-10-08T19:12:47.473 INFO:teuthology.orchestra.run.smithi112.stdout:(15/32): python3-pecan-1.3.2-9.el8.noarch.rpm 4.9 MB/s | 283 kB 00:00 2021-10-08T19:12:47.483 INFO:teuthology.orchestra.run.smithi112.stdout:(16/32): python3-simplegeneric-0.8.1-17.el8.noa 668 kB/s | 19 kB 00:00 2021-10-08T19:12:47.500 INFO:teuthology.orchestra.run.smithi112.stdout:(17/32): python3-singledispatch-3.4.0.3-18.el8. 861 kB/s | 24 kB 00:00 2021-10-08T19:12:47.511 INFO:teuthology.orchestra.run.smithi112.stdout:(18/32): python3-tempora-1.14.1-5.el8.noarch.rp 1.0 MB/s | 29 kB 00:00 2021-10-08T19:12:47.529 INFO:teuthology.orchestra.run.smithi112.stdout:(19/32): python3-trustme-0.6.0-4.el8.noarch.rpm 980 kB/s | 27 kB 00:00 2021-10-08T19:12:47.559 INFO:teuthology.orchestra.run.smithi112.stdout:(20/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 8.0 MB/s | 251 kB 00:00 2021-10-08T19:12:47.566 INFO:teuthology.orchestra.run.smithi112.stdout:(21/32): python3-waitress-1.2.1-2.el8.1.noarch. 4.2 MB/s | 241 kB 00:00 2021-10-08T19:12:47.588 INFO:teuthology.orchestra.run.smithi112.stdout:(22/32): python3-webtest-2.0.33-1.el8.noarch.rp 2.9 MB/s | 85 kB 00:00 2021-10-08T19:12:47.597 INFO:teuthology.orchestra.run.smithi112.stdout:(23/32): python3-zc-lockfile-2.0-2.el8.noarch.r 744 kB/s | 23 kB 00:00 2021-10-08T19:12:47.628 INFO:teuthology.orchestra.run.smithi112.stdout:(24/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.8 MB/s | 238 kB 00:00 2021-10-08T19:12:47.635 INFO:teuthology.orchestra.run.smithi112.stdout:(25/32): python3-pycparser-2.14-14.el8.noarch.r 2.8 MB/s | 109 kB 00:00 2021-10-08T19:12:47.656 INFO:teuthology.orchestra.run.smithi112.stdout:(26/32): python3-cryptography-3.2.1-4.el8.x86_6 20 MB/s | 559 kB 00:00 2021-10-08T19:12:47.663 INFO:teuthology.orchestra.run.smithi112.stdout:(27/32): python3-mako-1.0.6-13.el8.noarch.rpm 5.6 MB/s | 157 kB 00:00 2021-10-08T19:12:47.680 INFO:teuthology.orchestra.run.smithi112.stdout:(28/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.2 MB/s | 54 kB 00:00 2021-10-08T19:12:47.687 INFO:teuthology.orchestra.run.smithi112.stdout:(29/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 4.2 MB/s | 103 kB 00:00 2021-10-08T19:12:47.707 INFO:teuthology.orchestra.run.smithi112.stdout:(30/32): python3-werkzeug-0.12.2-4.el8.noarch.r 17 MB/s | 457 kB 00:00 2021-10-08T19:12:47.710 INFO:teuthology.orchestra.run.smithi112.stdout:(31/32): python3-markupsafe-0.23-19.el8.x86_64. 1.7 MB/s | 39 kB 00:00 2021-10-08T19:12:47.930 INFO:teuthology.orchestra.run.smithi112.stdout:(32/32): ceph-osd-17.0.0-8087.g103b6cc3.el8.x86 18 MB/s | 17 MB 00:00 2021-10-08T19:12:47.933 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:12:47.934 INFO:teuthology.orchestra.run.smithi112.stdout:Total 21 MB/s | 28 MB 00:01 2021-10-08T19:12:47.941 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:12:47.977 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:12:47.978 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:12:48.179 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:12:48.183 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:12:50.265 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:12:51.252 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:12:51.500 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2021-10-08T19:12:51.695 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2021-10-08T19:12:51.963 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 3/32 2021-10-08T19:12:52.248 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 4/32 2021-10-08T19:12:52.440 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 5/32 2021-10-08T19:12:52.623 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 6/32 2021-10-08T19:12:52.816 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:12:52.819 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================================= 2021-10-08T19:12:52.820 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:12:52.820 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================================= 2021-10-08T19:12:52.820 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:12:52.820 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 6.4 k 2021-10-08T19:12:52.821 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:12:52.821 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 2.3 M 2021-10-08T19:12:52.821 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 1.5 M 2021-10-08T19:12:52.821 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 214 k 2021-10-08T19:12:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.9 M 2021-10-08T19:12:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 17 M 2021-10-08T19:12:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-10-08T19:12:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-10-08T19:12:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2021-10-08T19:12:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-10-08T19:12:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-10-08T19:12:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 3.2.1-4.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2021-10-08T19:12:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-10-08T19:12:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-10-08T19:12:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-10-08T19:12:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2021-10-08T19:12:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2021-10-08T19:12:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-10-08T19:12:52.825 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-10-08T19:12:52.825 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-10-08T19:12:52.825 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2021-10-08T19:12:52.825 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2021-10-08T19:12:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2021-10-08T19:12:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-10-08T19:12:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-10-08T19:12:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-10-08T19:12:52.827 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-10-08T19:12:52.827 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-10-08T19:12:52.827 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-10-08T19:12:52.828 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-10-08T19:12:52.828 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2021-10-08T19:12:52.828 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-10-08T19:12:52.828 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:12:52.828 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:12:52.829 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================================= 2021-10-08T19:12:52.829 INFO:teuthology.orchestra.run.smithi142.stdout:Install 32 Packages 2021-10-08T19:12:52.829 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:12:52.830 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 28 M 2021-10-08T19:12:52.830 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 112 M 2021-10-08T19:12:52.831 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:12:52.870 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 7/32 2021-10-08T19:12:52.933 INFO:teuthology.orchestra.run.smithi142.stdout:(1/32): ceph-17.0.0-8087.g103b6cc3.el8.x86_64.r 60 kB/s | 6.4 kB 00:00 2021-10-08T19:12:53.184 INFO:teuthology.orchestra.run.smithi142.stdout:(2/32): ceph-mgr-17.0.0-8087.g103b6cc3.el8.x86_ 4.2 MB/s | 1.5 MB 00:00 2021-10-08T19:12:53.209 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 8/32 2021-10-08T19:12:53.226 INFO:teuthology.orchestra.run.smithi142.stdout:(3/32): ceph-mds-17.0.0-8087.g103b6cc3.el8.x86_ 5.7 MB/s | 2.3 MB 00:00 2021-10-08T19:12:53.295 INFO:teuthology.orchestra.run.smithi142.stdout:(4/32): ceph-mgr-modules-core-17.0.0-8087.g103b 2.9 MB/s | 214 kB 00:00 2021-10-08T19:12:53.404 INFO:teuthology.orchestra.run.smithi142.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 402 kB/s | 44 kB 00:00 2021-10-08T19:12:53.495 INFO:teuthology.orchestra.run.smithi142.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 2.0 MB/s | 185 kB 00:00 2021-10-08T19:12:53.512 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 9/32 2021-10-08T19:12:53.556 INFO:teuthology.orchestra.run.smithi142.stdout:(7/32): ceph-mon-17.0.0-8087.g103b6cc3.el8.x86_ 6.2 MB/s | 3.9 MB 00:00 2021-10-08T19:12:53.648 INFO:teuthology.orchestra.run.smithi142.stdout:(8/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB 00:00 2021-10-08T19:12:53.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 10/32 2021-10-08T19:12:53.717 INFO:teuthology.orchestra.run.smithi142.stdout:(9/32): python3-jaraco-6.2-6.el8.noarch.rpm 160 kB/s | 11 kB 00:00 2021-10-08T19:12:53.775 INFO:teuthology.orchestra.run.smithi142.stdout:(10/32): python3-jaraco-functools-2.0-4.el8.noa 305 kB/s | 18 kB 00:00 2021-10-08T19:12:53.802 INFO:teuthology.orchestra.run.smithi142.stdout:(11/32): python3-logutils-0.3.5-11.el8.noarch.r 1.8 MB/s | 49 kB 00:00 2021-10-08T19:12:53.808 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 11/32 2021-10-08T19:12:53.816 INFO:teuthology.orchestra.run.smithi142.stdout:(12/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.4 MB/s | 384 kB 00:00 2021-10-08T19:12:53.827 INFO:teuthology.orchestra.run.smithi142.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 2.3 MB/s | 59 kB 00:00 2021-10-08T19:12:53.852 INFO:teuthology.orchestra.run.smithi142.stdout:(14/32): python3-portend-2.6-1.el8.noarch.rpm 638 kB/s | 16 kB 00:00 2021-10-08T19:12:53.873 INFO:teuthology.orchestra.run.smithi142.stdout:(15/32): python3-pecan-1.3.2-9.el8.noarch.rpm 4.9 MB/s | 283 kB 00:00 2021-10-08T19:12:53.876 INFO:teuthology.orchestra.run.smithi142.stdout:(16/32): python3-simplegeneric-0.8.1-17.el8.noa 760 kB/s | 19 kB 00:00 2021-10-08T19:12:53.900 INFO:teuthology.orchestra.run.smithi142.stdout:(17/32): python3-tempora-1.14.1-5.el8.noarch.rp 1.2 MB/s | 29 kB 00:00 2021-10-08T19:12:53.901 INFO:teuthology.orchestra.run.smithi142.stdout:(18/32): python3-singledispatch-3.4.0.3-18.el8. 840 kB/s | 24 kB 00:00 2021-10-08T19:12:53.925 INFO:teuthology.orchestra.run.smithi142.stdout:(19/32): python3-trustme-0.6.0-4.el8.noarch.rpm 1.1 MB/s | 27 kB 00:00 2021-10-08T19:12:53.933 INFO:teuthology.orchestra.run.smithi142.stdout:(20/32): python3-waitress-1.2.1-2.el8.1.noarch. 7.5 MB/s | 241 kB 00:00 2021-10-08T19:12:53.953 INFO:teuthology.orchestra.run.smithi142.stdout:(21/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 8.8 MB/s | 251 kB 00:00 2021-10-08T19:12:53.962 INFO:teuthology.orchestra.run.smithi142.stdout:(22/32): python3-webtest-2.0.33-1.el8.noarch.rp 2.9 MB/s | 85 kB 00:00 2021-10-08T19:12:54.024 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 12/32 2021-10-08T19:12:54.073 INFO:teuthology.orchestra.run.smithi142.stdout:(23/32): ceph-osd-17.0.0-8087.g103b6cc3.el8.x86 19 MB/s | 17 MB 00:00 2021-10-08T19:12:54.078 INFO:teuthology.orchestra.run.smithi142.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 183 kB/s | 23 kB 00:00 2021-10-08T19:12:54.112 INFO:teuthology.orchestra.run.smithi142.stdout:(25/32): python3-mako-1.0.6-13.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2021-10-08T19:12:54.128 INFO:teuthology.orchestra.run.smithi142.stdout:(26/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2021-10-08T19:12:54.130 INFO:teuthology.orchestra.run.smithi142.stdout:(27/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 2.0 MB/s | 103 kB 00:00 2021-10-08T19:12:54.157 INFO:teuthology.orchestra.run.smithi142.stdout:(28/32): python3-werkzeug-0.12.2-4.el8.noarch.r 13 MB/s | 457 kB 00:00 2021-10-08T19:12:54.157 INFO:teuthology.orchestra.run.smithi142.stdout:(29/32): python3-markupsafe-0.23-19.el8.x86_64. 1.3 MB/s | 39 kB 00:00 2021-10-08T19:12:54.170 INFO:teuthology.orchestra.run.smithi142.stdout:(30/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.4 MB/s | 238 kB 00:00 2021-10-08T19:12:54.183 INFO:teuthology.orchestra.run.smithi142.stdout:(31/32): python3-pycparser-2.14-14.el8.noarch.r 4.1 MB/s | 109 kB 00:00 2021-10-08T19:12:54.192 INFO:teuthology.orchestra.run.smithi142.stdout:(32/32): python3-cryptography-3.2.1-4.el8.x86_6 16 MB/s | 559 kB 00:00 2021-10-08T19:12:54.195 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:12:54.195 INFO:teuthology.orchestra.run.smithi142.stdout:Total 20 MB/s | 28 MB 00:01 2021-10-08T19:12:54.202 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:12:54.237 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:12:54.238 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:12:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2021-10-08T19:12:54.441 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:12:54.445 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:12:54.464 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 14/32 2021-10-08T19:12:54.637 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2021-10-08T19:12:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2021-10-08T19:12:54.971 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2021-10-08T19:12:55.097 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2021-10-08T19:12:55.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2021-10-08T19:12:55.463 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2021-10-08T19:12:55.529 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:12:55.639 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2021-10-08T19:12:55.780 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2021-10-08T19:12:55.897 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2021-10-08T19:12:55.984 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2021-10-08T19:12:56.132 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2021-10-08T19:12:56.201 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 3/32 2021-10-08T19:12:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2021-10-08T19:12:56.566 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 4/32 2021-10-08T19:12:56.667 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2021-10-08T19:12:56.816 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 5/32 2021-10-08T19:12:56.970 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 6/32 2021-10-08T19:12:56.972 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2021-10-08T19:12:57.114 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 7/32 2021-10-08T19:12:57.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 27/32 2021-10-08T19:12:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 8/32 2021-10-08T19:12:57.409 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 28/32 2021-10-08T19:12:57.554 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 9/32 2021-10-08T19:12:57.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 10/32 2021-10-08T19:12:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2021-10-08T19:12:58.254 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 12/32 2021-10-08T19:12:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2021-10-08T19:12:58.710 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 14/32 2021-10-08T19:12:58.891 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2021-10-08T19:12:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 28/32 2021-10-08T19:12:59.041 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2021-10-08T19:12:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 29/32 2021-10-08T19:12:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 29/32 2021-10-08T19:12:59.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 30/32 2021-10-08T19:12:59.882 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 30/32 2021-10-08T19:12:59.909 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2021-10-08T19:13:00.006 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 31/32 2021-10-08T19:13:00.025 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 31/32 2021-10-08T19:13:00.077 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2021-10-08T19:13:00.129 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/32 2021-10-08T19:13:00.250 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2021-10-08T19:13:00.442 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2021-10-08T19:13:00.485 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/32 2021-10-08T19:13:00.485 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/32 2021-10-08T19:13:00.485 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/32 2021-10-08T19:13:00.485 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/32 2021-10-08T19:13:00.486 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/32 2021-10-08T19:13:00.486 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/32 2021-10-08T19:13:00.487 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 6/32 2021-10-08T19:13:00.487 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2021-10-08T19:13:00.487 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2021-10-08T19:13:00.487 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2021-10-08T19:13:00.488 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2021-10-08T19:13:00.488 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2021-10-08T19:13:00.489 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2021-10-08T19:13:00.489 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2021-10-08T19:13:00.489 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2021-10-08T19:13:00.489 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2021-10-08T19:13:00.490 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2021-10-08T19:13:00.490 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2021-10-08T19:13:00.491 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2021-10-08T19:13:00.491 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2021-10-08T19:13:00.491 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2021-10-08T19:13:00.491 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 21/32 2021-10-08T19:13:00.492 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2021-10-08T19:13:00.492 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2021-10-08T19:13:00.492 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2021-10-08T19:13:00.492 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 25/32 2021-10-08T19:13:00.493 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 26/32 2021-10-08T19:13:00.494 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 27/32 2021-10-08T19:13:00.494 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 28/32 2021-10-08T19:13:00.494 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 29/32 2021-10-08T19:13:00.494 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 30/32 2021-10-08T19:13:00.495 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 31/32 2021-10-08T19:13:00.635 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2021-10-08T19:13:00.862 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2021-10-08T19:13:01.094 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2021-10-08T19:13:01.098 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 32/32 2021-10-08T19:13:01.099 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:13:01.294 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2021-10-08T19:13:01.600 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2021-10-08T19:13:01.920 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2021-10-08T19:13:02.273 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 27/32 2021-10-08T19:13:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 28/32 2021-10-08T19:13:03.891 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 28/32 2021-10-08T19:13:04.037 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 29/32 2021-10-08T19:13:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 29/32 2021-10-08T19:13:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 30/32 2021-10-08T19:13:04.819 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 30/32 2021-10-08T19:13:04.978 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 31/32 2021-10-08T19:13:04.996 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 31/32 2021-10-08T19:13:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/32 2021-10-08T19:13:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 32/32 2021-10-08T19:13:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/32 2021-10-08T19:13:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/32 2021-10-08T19:13:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 3/32 2021-10-08T19:13:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 4/32 2021-10-08T19:13:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 5/32 2021-10-08T19:13:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8. 6/32 2021-10-08T19:13:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2021-10-08T19:13:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2021-10-08T19:13:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2021-10-08T19:13:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2021-10-08T19:13:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2021-10-08T19:13:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2021-10-08T19:13:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2021-10-08T19:13:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2021-10-08T19:13:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2021-10-08T19:13:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2021-10-08T19:13:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2021-10-08T19:13:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2021-10-08T19:13:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2021-10-08T19:13:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2021-10-08T19:13:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 21/32 2021-10-08T19:13:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2021-10-08T19:13:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2021-10-08T19:13:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2021-10-08T19:13:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 25/32 2021-10-08T19:13:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 26/32 2021-10-08T19:13:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 27/32 2021-10-08T19:13:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2021-10-08T19:13:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 29/32 2021-10-08T19:13:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 30/32 2021-10-08T19:13:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 31/32 2021-10-08T19:13:06.061 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 32/32 2021-10-08T19:13:06.062 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:13:11.559 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:12:25 PM UTC. 2021-10-08T19:13:14.072 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:13:14.072 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:13:14.073 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:14.073 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:14.073 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:14.073 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:13:14.074 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:14.074 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:14.074 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-10-08T19:13:14.074 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-10-08T19:13:14.075 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-10-08T19:13:14.075 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-10-08T19:13:14.075 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-10-08T19:13:14.075 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-10-08T19:13:14.075 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-6.2-6.el8.noarch 2021-10-08T19:13:14.076 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-10-08T19:13:14.076 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-10-08T19:13:14.076 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.0.6-13.el8.noarch 2021-10-08T19:13:14.076 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-10-08T19:13:14.076 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-10-08T19:13:14.077 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-10-08T19:13:14.077 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-2.6-1.el8.noarch 2021-10-08T19:13:14.077 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-10-08T19:13:14.077 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.14-14.el8.noarch 2021-10-08T19:13:14.078 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2017.2-9.el8.noarch 2021-10-08T19:13:14.078 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-10-08T19:13:14.078 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-10-08T19:13:14.078 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-10-08T19:13:14.078 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-10-08T19:13:14.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-10-08T19:13:14.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-10-08T19:13:14.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-10-08T19:13:14.079 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-10-08T19:13:14.080 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-10-08T19:13:14.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:13:14.080 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:13:14.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-base 2021-10-08T19:13:14.567 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:13:15.116 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-10-08T19:13:16.557 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:12:31 PM UTC. 2021-10-08T19:13:19.109 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:13:19.110 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:13:19.110 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:19.110 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:19.111 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:19.111 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:13:19.111 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:19.111 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:13:19.112 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-10-08T19:13:19.112 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-10-08T19:13:19.112 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-10-08T19:13:19.112 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-10-08T19:13:19.112 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-10-08T19:13:19.113 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-10-08T19:13:19.113 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-6.2-6.el8.noarch 2021-10-08T19:13:19.113 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-10-08T19:13:19.113 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-10-08T19:13:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.0.6-13.el8.noarch 2021-10-08T19:13:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-10-08T19:13:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-10-08T19:13:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-10-08T19:13:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-2.6-1.el8.noarch 2021-10-08T19:13:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-10-08T19:13:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.14-14.el8.noarch 2021-10-08T19:13:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2017.2-9.el8.noarch 2021-10-08T19:13:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-10-08T19:13:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-10-08T19:13:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-10-08T19:13:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-10-08T19:13:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-10-08T19:13:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-10-08T19:13:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-10-08T19:13:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-10-08T19:13:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-10-08T19:13:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:13:19.118 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:13:19.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2021-10-08T19:13:19.577 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:13:20.064 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 88 kB/s | 2.8 kB 00:00 2021-10-08T19:13:20.332 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2021-10-08T19:13:24.921 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 77 kB/s | 2.4 kB 00:00 2021-10-08T19:13:25.352 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:13:27.527 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:13:27.956 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:13:27.957 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:13:27.957 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:13:28.085 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install cephadm 2021-10-08T19:13:28.410 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:13:28.943 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-10-08T19:13:29.067 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-10-08T19:13:30.277 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:13:30.972 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:13:30.973 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:13:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:13:30.974 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:13:30.974 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:13:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 66 k 2021-10-08T19:13:30.974 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:13:30.975 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:13:30.975 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:13:30.975 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2021-10-08T19:13:30.975 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:13:30.976 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 66 k 2021-10-08T19:13:30.976 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 291 k 2021-10-08T19:13:30.976 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:13:31.118 INFO:teuthology.orchestra.run.smithi112.stdout:cephadm-17.0.0-8087.g103b6cc3.el8.noarch.rpm 458 kB/s | 66 kB 00:00 2021-10-08T19:13:31.119 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:13:31.120 INFO:teuthology.orchestra.run.smithi112.stdout:Total 454 kB/s | 66 kB 00:00 2021-10-08T19:13:31.120 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:13:31.126 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:13:31.127 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:13:31.128 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:13:31.132 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:13:31.180 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:13:32.373 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:13:32.807 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:13:32.808 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:13:32.808 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:13:32.901 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2021-10-08T19:13:33.233 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:13:33.738 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2021-10-08T19:13:33.915 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 76 kB/s | 2.4 kB 00:00 2021-10-08T19:13:34.284 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:13:34.496 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:13:34.653 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:13:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:13:34.897 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:13:35.759 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:13:35.760 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:13:35.760 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:13:35.761 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:13:35.761 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:13:35.761 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 66 k 2021-10-08T19:13:35.761 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:13:35.761 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:13:35.762 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:13:35.763 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2021-10-08T19:13:35.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:13:35.763 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 66 k 2021-10-08T19:13:35.764 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 291 k 2021-10-08T19:13:35.764 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:13:35.906 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-17.0.0-8087.g103b6cc3.el8.noarch.rpm 455 kB/s | 66 kB 00:00 2021-10-08T19:13:35.907 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:13:35.907 INFO:teuthology.orchestra.run.smithi142.stdout:Total 450 kB/s | 66 kB 00:00 2021-10-08T19:13:35.908 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:13:35.914 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:13:35.914 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:13:35.916 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:13:35.921 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:13:36.147 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:13:39.035 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:13:39.211 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:13:39.373 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:13:39.640 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:13:39.640 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:13:45.466 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:13:06 PM UTC. 2021-10-08T19:13:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:13:48.109 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:13:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:13:48.109 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:13:48.109 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:13:48.231 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-immutable-object-cache 2021-10-08T19:13:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:13:49.102 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 2021-10-08T19:13:50.092 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:13:11 PM UTC. 2021-10-08T19:13:52.661 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:13:52.662 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:13:52.662 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:13:52.662 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:13:52.662 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:13:52.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2021-10-08T19:13:53.139 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:13:53.651 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-10-08T19:13:54.253 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-10-08T19:13:58.557 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 75 kB/s | 2.4 kB 00:00 2021-10-08T19:13:59.171 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:14:01.715 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:14:01.716 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:14:01.717 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2021-10-08T19:14:01.717 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:14:01.717 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:14:01.717 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 169 k 2021-10-08T19:14:01.717 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:14:01.718 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:14:01.718 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:14:01.718 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2021-10-08T19:14:01.718 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:14:01.719 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 169 k 2021-10-08T19:14:01.719 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 567 k 2021-10-08T19:14:01.719 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:14:01.979 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-immutable-object-cache-17.0.0-8087.g103b6c 643 kB/s | 169 kB 00:00 2021-10-08T19:14:01.980 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:01.981 INFO:teuthology.orchestra.run.smithi112.stdout:Total 639 kB/s | 169 kB 00:00 2021-10-08T19:14:01.981 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:14:01.993 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:14:01.993 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:14:02.046 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:14:02.050 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:14:02.172 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:14:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:02.911 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:02.911 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:14:03.952 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:14:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:14:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:14:06.505 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2021-10-08T19:14:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:14:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:14:06.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 169 k 2021-10-08T19:14:06.506 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:14:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:14:06.507 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:14:06.507 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2021-10-08T19:14:06.507 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:14:06.507 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 169 k 2021-10-08T19:14:06.508 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 567 k 2021-10-08T19:14:06.508 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:14:06.674 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-17.0.0-8087.g103b6c 1.0 MB/s | 169 kB 00:00 2021-10-08T19:14:06.675 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:06.675 INFO:teuthology.orchestra.run.smithi142.stdout:Total 996 kB/s | 169 kB 00:00 2021-10-08T19:14:06.676 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:14:06.686 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:14:06.687 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:14:06.738 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:14:06.742 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:14:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:14:07.046 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:07.422 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3. 1/1 2021-10-08T19:14:07.662 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:14:13.581 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:13:40 PM UTC. 2021-10-08T19:14:16.071 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:14:16.071 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:14:16.071 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:16.071 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:14:16.072 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:14:16.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr 2021-10-08T19:14:16.522 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:14:17.037 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:14:18.124 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:13:44 PM UTC. 2021-10-08T19:14:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:14:20.632 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:14:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:14:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:14:20.632 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:14:20.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2021-10-08T19:14:21.072 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:14:21.563 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-10-08T19:14:22.230 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-10-08T19:14:26.513 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 2021-10-08T19:14:27.309 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:14:29.429 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:14:29.851 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:14:29.853 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:14:29.853 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:14:29.954 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-dashboard 2021-10-08T19:14:30.278 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:14:30.863 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-10-08T19:14:30.990 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-10-08T19:14:31.919 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:14:32.797 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:14:32.797 INFO:teuthology.orchestra.run.smithi112.stdout:=================================================================================================== 2021-10-08T19:14:32.797 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:14:32.798 INFO:teuthology.orchestra.run.smithi112.stdout:=================================================================================================== 2021-10-08T19:14:32.798 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:14:32.798 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 1.5 M 2021-10-08T19:14:32.798 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:14:32.799 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 24 k 2021-10-08T19:14:32.799 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 8.9 k 2021-10-08T19:14:32.799 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-10-08T19:14:32.799 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-10-08T19:14:32.799 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-10-08T19:14:32.800 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:14:32.800 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:14:32.800 INFO:teuthology.orchestra.run.smithi112.stdout:=================================================================================================== 2021-10-08T19:14:32.800 INFO:teuthology.orchestra.run.smithi112.stdout:Install 6 Packages 2021-10-08T19:14:32.800 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:14:32.801 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 1.8 M 2021-10-08T19:14:32.801 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 7.5 M 2021-10-08T19:14:32.801 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:14:32.904 INFO:teuthology.orchestra.run.smithi112.stdout:(1/6): ceph-prometheus-alerts-17.0.0-8087.g103b 82 kB/s | 8.9 kB 00:00 2021-10-08T19:14:32.918 INFO:teuthology.orchestra.run.smithi112.stdout:(2/6): ceph-grafana-dashboards-17.0.0-8087.g103 196 kB/s | 24 kB 00:00 2021-10-08T19:14:32.984 INFO:teuthology.orchestra.run.smithi112.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 426 kB/s | 34 kB 00:00 2021-10-08T19:14:33.015 INFO:teuthology.orchestra.run.smithi112.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-10-08T19:14:33.062 INFO:teuthology.orchestra.run.smithi112.stdout:(5/6): ceph-mgr-dashboard-17.0.0-8087.g103b6cc3 5.8 MB/s | 1.5 MB 00:00 2021-10-08T19:14:33.079 INFO:teuthology.orchestra.run.smithi112.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2021-10-08T19:14:33.081 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:33.084 INFO:teuthology.orchestra.run.smithi112.stdout:Total 6.4 MB/s | 1.8 MB 00:00 2021-10-08T19:14:33.084 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:14:33.092 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:14:33.093 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:14:33.146 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:14:33.147 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:14:33.415 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:14:33.573 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2021-10-08T19:14:33.736 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2021-10-08T19:14:33.881 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2021-10-08T19:14:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 4/6 2021-10-08T19:14:34.095 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:14:34.371 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 5/6 2021-10-08T19:14:34.521 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:14:34.522 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:14:34.522 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:14:34.548 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:14:34.613 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2021-10-08T19:14:34.755 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:14:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 1/6 2021-10-08T19:14:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 2/6 2021-10-08T19:14:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 3/6 2021-10-08T19:14:34.756 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2021-10-08T19:14:34.757 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2021-10-08T19:14:34.942 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:14:35.006 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2021-10-08T19:14:35.006 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:14:35.454 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-10-08T19:14:35.632 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:14:37.458 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:14:37.459 INFO:teuthology.orchestra.run.smithi142.stdout:=================================================================================================== 2021-10-08T19:14:37.459 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:14:37.460 INFO:teuthology.orchestra.run.smithi142.stdout:=================================================================================================== 2021-10-08T19:14:37.460 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:14:37.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 1.5 M 2021-10-08T19:14:37.460 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:14:37.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 24 k 2021-10-08T19:14:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 8.9 k 2021-10-08T19:14:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-10-08T19:14:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-10-08T19:14:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-10-08T19:14:37.462 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:14:37.462 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:14:37.462 INFO:teuthology.orchestra.run.smithi142.stdout:=================================================================================================== 2021-10-08T19:14:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2021-10-08T19:14:37.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:14:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 1.8 M 2021-10-08T19:14:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 7.5 M 2021-10-08T19:14:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:14:37.570 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): ceph-prometheus-alerts-17.0.0-8087.g103b 82 kB/s | 8.9 kB 00:00 2021-10-08T19:14:37.583 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): ceph-grafana-dashboards-17.0.0-8087.g103 197 kB/s | 24 kB 00:00 2021-10-08T19:14:37.655 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 399 kB/s | 34 kB 00:00 2021-10-08T19:14:37.685 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-10-08T19:14:37.707 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.5 MB/s | 196 kB 00:00 2021-10-08T19:14:37.729 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): ceph-mgr-dashboard-17.0.0-8087.g103b6cc3 5.8 MB/s | 1.5 MB 00:00 2021-10-08T19:14:37.731 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:14:37.732 INFO:teuthology.orchestra.run.smithi142.stdout:Total 6.8 MB/s | 1.8 MB 00:00 2021-10-08T19:14:37.733 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:14:37.742 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:14:37.742 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:14:37.793 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:14:37.798 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:14:38.060 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:14:38.249 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2021-10-08T19:14:38.429 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2021-10-08T19:14:38.591 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2021-10-08T19:14:38.741 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 4/6 2021-10-08T19:14:39.078 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 5/6 2021-10-08T19:14:39.256 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:14:39.477 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 6/6 2021-10-08T19:14:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8. 1/6 2021-10-08T19:14:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarc 2/6 2021-10-08T19:14:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.n 3/6 2021-10-08T19:14:39.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2021-10-08T19:14:39.479 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2021-10-08T19:14:39.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2021-10-08T19:14:39.839 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:14:45.467 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:14:08 PM UTC. 2021-10-08T19:14:48.054 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:14:48.054 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:14:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:48.055 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:48.061 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-10-08T19:14:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-10-08T19:14:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.4.1-12.el8.noarch 2021-10-08T19:14:48.062 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:14:48.062 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:14:48.190 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-diskprediction-local 2021-10-08T19:14:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:14:49.034 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-10-08T19:14:50.326 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:14:12 PM UTC. 2021-10-08T19:14:52.880 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:14:52.880 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:14:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:14:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-10-08T19:14:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-10-08T19:14:52.882 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.4.1-12.el8.noarch 2021-10-08T19:14:52.882 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:14:52.882 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:14:53.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2021-10-08T19:14:53.356 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:14:53.871 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-10-08T19:14:54.287 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-10-08T19:14:58.751 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-10-08T19:14:59.181 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:15:01.729 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:15:01.731 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2021-10-08T19:15:01.732 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:15:01.732 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2021-10-08T19:15:01.732 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:15:01.733 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 7.4 M 2021-10-08T19:15:01.734 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:15:01.735 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2021-10-08T19:15:01.735 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2021-10-08T19:15:01.735 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2021-10-08T19:15:01.736 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2021-10-08T19:15:01.736 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2021-10-08T19:15:01.736 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2021-10-08T19:15:01.737 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2021-10-08T19:15:01.737 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:15:01.738 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:15:01.738 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================================================== 2021-10-08T19:15:01.739 INFO:teuthology.orchestra.run.smithi112.stdout:Install 8 Packages 2021-10-08T19:15:01.739 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:15:01.739 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 36 M 2021-10-08T19:15:01.739 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 199 M 2021-10-08T19:15:01.740 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:15:01.773 INFO:teuthology.orchestra.run.smithi112.stdout:(1/8): libquadmath-8.4.1-1.el8.x86_64.rpm 4.1 MB/s | 169 kB 00:00 2021-10-08T19:15:01.784 INFO:teuthology.orchestra.run.smithi112.stdout:(2/8): libgfortran-8.4.1-1.el8.x86_64.rpm 12 MB/s | 639 kB 00:00 2021-10-08T19:15:01.829 INFO:teuthology.orchestra.run.smithi112.stdout:(3/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 67 MB/s | 3.7 MB 00:00 2021-10-08T19:15:01.887 INFO:teuthology.orchestra.run.smithi112.stdout:(4/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 82 MB/s | 4.7 MB 00:00 2021-10-08T19:15:02.023 INFO:teuthology.orchestra.run.smithi112.stdout:(5/8): python3-scipy-1.0.0-20.module+el8.1.0+33 62 MB/s | 15 MB 00:00 2021-10-08T19:15:02.052 INFO:teuthology.orchestra.run.smithi112.stdout:(6/8): openblas-0.3.12-1.el8.x86_64.rpm 28 MB/s | 4.6 MB 00:00 2021-10-08T19:15:02.053 INFO:teuthology.orchestra.run.smithi112.stdout:(7/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 7.3 MB/s | 225 kB 00:00 2021-10-08T19:15:02.454 INFO:teuthology.orchestra.run.smithi112.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-808 10 MB/s | 7.4 MB 00:00 2021-10-08T19:15:02.457 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:02.458 INFO:teuthology.orchestra.run.smithi112.stdout:Total 50 MB/s | 36 MB 00:00 2021-10-08T19:15:02.465 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:15:02.491 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:15:02.491 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:15:02.781 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:15:02.785 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:15:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:15:03.440 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:15:03.565 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:15:03.706 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:15:04.186 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:15:04.249 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:15:04.423 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:15:04.949 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:15:05.115 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:15:05.815 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:15:06.090 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:15:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:15:06.739 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:15:06.740 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================================================== 2021-10-08T19:15:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:15:06.741 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================================================== 2021-10-08T19:15:06.741 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:15:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 7.4 M 2021-10-08T19:15:06.742 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:15:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2021-10-08T19:15:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2021-10-08T19:15:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2021-10-08T19:15:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2021-10-08T19:15:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2021-10-08T19:15:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2021-10-08T19:15:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2021-10-08T19:15:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:15:06.744 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:15:06.744 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================================================== 2021-10-08T19:15:06.744 INFO:teuthology.orchestra.run.smithi142.stdout:Install 8 Packages 2021-10-08T19:15:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:15:06.745 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 36 M 2021-10-08T19:15:06.745 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 199 M 2021-10-08T19:15:06.745 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:15:06.823 INFO:teuthology.orchestra.run.smithi142.stdout:(1/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 46 MB/s | 3.7 MB 00:00 2021-10-08T19:15:06.879 INFO:teuthology.orchestra.run.smithi142.stdout:(2/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 86 MB/s | 4.7 MB 00:00 2021-10-08T19:15:07.014 INFO:teuthology.orchestra.run.smithi142.stdout:(3/8): python3-scipy-1.0.0-20.module+el8.1.0+33 53 MB/s | 15 MB 00:00 2021-10-08T19:15:07.044 INFO:teuthology.orchestra.run.smithi142.stdout:(4/8): openblas-0.3.12-1.el8.x86_64.rpm 28 MB/s | 4.6 MB 00:00 2021-10-08T19:15:07.046 INFO:teuthology.orchestra.run.smithi142.stdout:(5/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 6.9 MB/s | 225 kB 00:00 2021-10-08T19:15:07.068 INFO:teuthology.orchestra.run.smithi142.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 7.0 MB/s | 169 kB 00:00 2021-10-08T19:15:07.076 INFO:teuthology.orchestra.run.smithi142.stdout:(7/8): libgfortran-8.4.1-1.el8.x86_64.rpm 21 MB/s | 639 kB 00:00 2021-10-08T19:15:07.319 INFO:teuthology.orchestra.run.smithi142.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-808 13 MB/s | 7.4 MB 00:00 2021-10-08T19:15:07.320 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:07.320 INFO:teuthology.orchestra.run.smithi142.stdout:Total 62 MB/s | 36 MB 00:00 2021-10-08T19:15:07.329 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:15:07.347 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:15:07.352 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:15:07.646 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:15:07.649 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:15:08.178 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:15:08.310 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:15:08.316 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:15:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-10-08T19:15:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:15:09.154 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:15:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:15:09.539 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2021-10-08T19:15:09.672 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:15:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-10-08T19:15:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:15:09.927 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 1/8 2021-10-08T19:15:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 2/8 2021-10-08T19:15:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 3/8 2021-10-08T19:15:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-10-08T19:15:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 5/8 2021-10-08T19:15:09.928 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 6/8 2021-10-08T19:15:09.929 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 7/8 2021-10-08T19:15:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:15:10.195 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 8/8 2021-10-08T19:15:10.196 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:15:10.782 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:15:11.099 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-10-08T19:15:11.299 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:15:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:15:14.529 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2021-10-08T19:15:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:15:14.943 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 8/8 2021-10-08T19:15:14.943 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc 1/8 2021-10-08T19:15:14.946 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 2/8 2021-10-08T19:15:14.946 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 3/8 2021-10-08T19:15:14.946 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-10-08T19:15:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 5/8 2021-10-08T19:15:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-10-08T19:15:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 7/8 2021-10-08T19:15:15.206 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 8/8 2021-10-08T19:15:15.207 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:15:20.746 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:14:40 PM UTC. 2021-10-08T19:15:23.284 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:15:23.284 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:15:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:15:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-10-08T19:15:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-10-08T19:15:23.285 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.12-1.el8.x86_64 2021-10-08T19:15:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-10-08T19:15:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-10-08T19:15:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-10-08T19:15:23.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2021-10-08T19:15:23.287 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:15:23.287 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:15:23.417 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-rook 2021-10-08T19:15:23.746 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:15:24.277 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:15:25.671 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:14:45 PM UTC. 2021-10-08T19:15:28.217 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:15:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:15:28.217 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:15:28.218 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-10-08T19:15:28.218 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-10-08T19:15:28.218 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.12-1.el8.x86_64 2021-10-08T19:15:28.218 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-10-08T19:15:28.219 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-10-08T19:15:28.219 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-10-08T19:15:28.219 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2021-10-08T19:15:28.219 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:15:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:15:28.333 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2021-10-08T19:15:28.665 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:15:29.187 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2021-10-08T19:15:29.464 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-10-08T19:15:34.089 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:15:34.378 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:15:37.384 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:15:37.386 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================================== 2021-10-08T19:15:37.386 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:15:37.386 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================================== 2021-10-08T19:15:37.386 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:15:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 45 k 2021-10-08T19:15:37.387 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:15:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-10-08T19:15:37.387 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-10-08T19:15:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-10-08T19:15:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-10-08T19:15:37.388 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2021-10-08T19:15:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-10-08T19:15:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2021-10-08T19:15:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2021-10-08T19:15:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2021-10-08T19:15:37.389 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-10-08T19:15:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-10-08T19:15:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-10-08T19:15:37.390 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:15:37.390 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:15:37.391 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================================== 2021-10-08T19:15:37.391 INFO:teuthology.orchestra.run.smithi112.stdout:Install 13 Packages 2021-10-08T19:15:37.391 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:15:37.392 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 1.9 M 2021-10-08T19:15:37.392 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 25 M 2021-10-08T19:15:37.392 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:15:37.463 INFO:teuthology.orchestra.run.smithi112.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 219 kB/s | 16 kB 00:00 2021-10-08T19:15:37.464 INFO:teuthology.orchestra.run.smithi112.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 440 kB/s | 33 kB 00:00 2021-10-08T19:15:37.536 INFO:teuthology.orchestra.run.smithi112.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 1.1 MB/s | 81 kB 00:00 2021-10-08T19:15:37.562 INFO:teuthology.orchestra.run.smithi112.stdout:(4/13): python3-rsa-4.7.2-1.el8.noarch.rpm 2.3 MB/s | 61 kB 00:00 2021-10-08T19:15:37.588 INFO:teuthology.orchestra.run.smithi112.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 2.3 MB/s | 61 kB 00:00 2021-10-08T19:15:37.620 INFO:teuthology.orchestra.run.smithi112.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.3 MB/s | 43 kB 00:00 2021-10-08T19:15:37.638 INFO:teuthology.orchestra.run.smithi112.stdout:(7/13): python3-kubernetes-11.0.0-6.el8.noarch. 6.7 MB/s | 1.2 MB 00:00 2021-10-08T19:15:37.646 INFO:teuthology.orchestra.run.smithi112.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 5.7 MB/s | 155 kB 00:00 2021-10-08T19:15:37.672 INFO:teuthology.orchestra.run.smithi112.stdout:(9/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 800 kB/s | 27 kB 00:00 2021-10-08T19:15:37.678 INFO:teuthology.orchestra.run.smithi112.stdout:(10/13): python3-pyasn1-modules-0.3.7-6.el8.noa 3.4 MB/s | 110 kB 00:00 2021-10-08T19:15:37.688 INFO:teuthology.orchestra.run.smithi112.stdout:(11/13): ceph-mgr-rook-17.0.0-8087.g103b6cc3.el 150 kB/s | 45 kB 00:00 2021-10-08T19:15:37.695 INFO:teuthology.orchestra.run.smithi112.stdout:(12/13): python3-jsonpointer-1.10-11.el8.noarch 833 kB/s | 20 kB 00:00 2021-10-08T19:15:37.703 INFO:teuthology.orchestra.run.smithi112.stdout:(13/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.0 MB/s | 126 kB 00:00 2021-10-08T19:15:37.704 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:37.704 INFO:teuthology.orchestra.run.smithi112.stdout:Total 6.1 MB/s | 1.9 MB 00:00 2021-10-08T19:15:37.709 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:15:37.723 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:15:37.723 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:15:37.789 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:15:37.794 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:15:38.293 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:15:38.530 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-10-08T19:15:38.774 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 2/13 2021-10-08T19:15:38.951 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2021-10-08T19:15:39.101 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2021-10-08T19:15:39.311 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2021-10-08T19:15:39.408 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:15:39.566 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-10-08T19:15:39.790 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-10-08T19:15:39.967 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2021-10-08T19:15:40.175 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-10-08T19:15:40.375 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2021-10-08T19:15:41.469 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2021-10-08T19:15:41.785 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2021-10-08T19:15:41.911 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:15:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:15:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 1/13 2021-10-08T19:15:42.136 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2021-10-08T19:15:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2021-10-08T19:15:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2021-10-08T19:15:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2021-10-08T19:15:42.137 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 6/13 2021-10-08T19:15:42.138 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2021-10-08T19:15:42.138 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 8/13 2021-10-08T19:15:42.138 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 9/13 2021-10-08T19:15:42.138 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/13 2021-10-08T19:15:42.139 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 11/13 2021-10-08T19:15:42.139 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 12/13 2021-10-08T19:15:42.445 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 13/13 2021-10-08T19:15:42.446 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:15:42.495 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:15:42.497 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================================== 2021-10-08T19:15:42.497 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:15:42.497 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================================== 2021-10-08T19:15:42.498 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:15:42.498 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 45 k 2021-10-08T19:15:42.498 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:15:42.498 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-10-08T19:15:42.499 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-10-08T19:15:42.499 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-10-08T19:15:42.499 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-10-08T19:15:42.499 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2021-10-08T19:15:42.500 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-10-08T19:15:42.500 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2021-10-08T19:15:42.500 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2021-10-08T19:15:42.500 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2021-10-08T19:15:42.500 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-10-08T19:15:42.501 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-10-08T19:15:42.501 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-10-08T19:15:42.501 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:15:42.502 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:15:42.502 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================================== 2021-10-08T19:15:42.502 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2021-10-08T19:15:42.502 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:15:42.503 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 1.9 M 2021-10-08T19:15:42.503 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 25 M 2021-10-08T19:15:42.504 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:15:42.578 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 209 kB/s | 16 kB 00:00 2021-10-08T19:15:42.584 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 392 kB/s | 33 kB 00:00 2021-10-08T19:15:42.645 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): ceph-mgr-rook-17.0.0-8087.g103b6cc3.el8 309 kB/s | 45 kB 00:00 2021-10-08T19:15:42.651 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): python3-google-auth-1.1.1-10.el8.noarch 1.1 MB/s | 81 kB 00:00 2021-10-08T19:15:42.679 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 2.3 MB/s | 61 kB 00:00 2021-10-08T19:15:42.709 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 851 kB/s | 27 kB 00:00 2021-10-08T19:15:42.735 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-pyasn1-modules-0.3.7-6.el8.noar 4.3 MB/s | 110 kB 00:00 2021-10-08T19:15:42.743 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-rsa-4.7.2-1.el8.noarch.rpm 630 kB/s | 61 kB 00:00 2021-10-08T19:15:42.759 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-jsonpointer-1.10-11.el8.noarch. 861 kB/s | 20 kB 00:00 2021-10-08T19:15:42.782 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): python3-kubernetes-11.0.0-6.el8.noarch 5.9 MB/s | 1.2 MB 00:00 2021-10-08T19:15:42.784 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.1 MB/s | 126 kB 00:00 2021-10-08T19:15:42.791 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-requests-oauthlib-1.0.0-1.el8. 1.3 MB/s | 43 kB 00:00 2021-10-08T19:15:42.813 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 4.8 MB/s | 155 kB 00:00 2021-10-08T19:15:42.814 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:15:42.814 INFO:teuthology.orchestra.run.smithi142.stdout:Total 6.1 MB/s | 1.9 MB 00:00 2021-10-08T19:15:42.819 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:15:42.833 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:15:42.833 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:15:42.903 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:15:42.905 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:15:43.392 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:15:43.682 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-10-08T19:15:43.892 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 2/13 2021-10-08T19:15:44.169 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2021-10-08T19:15:44.382 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2021-10-08T19:15:44.602 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2021-10-08T19:15:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2021-10-08T19:15:44.985 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2021-10-08T19:15:45.204 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2021-10-08T19:15:45.380 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-10-08T19:15:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2021-10-08T19:15:46.728 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2021-10-08T19:15:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2021-10-08T19:15:47.143 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:15:47.366 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 13/13 2021-10-08T19:15:47.366 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 1/13 2021-10-08T19:15:47.367 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2021-10-08T19:15:47.367 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2021-10-08T19:15:47.367 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2021-10-08T19:15:47.367 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2021-10-08T19:15:47.368 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 6/13 2021-10-08T19:15:47.368 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2021-10-08T19:15:47.368 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 8/13 2021-10-08T19:15:47.368 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 9/13 2021-10-08T19:15:47.369 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 10/13 2021-10-08T19:15:47.369 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 11/13 2021-10-08T19:15:47.369 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 12/13 2021-10-08T19:15:48.102 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 13/13 2021-10-08T19:15:48.102 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:15:52.842 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:15:15 PM UTC. 2021-10-08T19:15:55.371 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:15:55.372 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:15:55.372 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:15:55.372 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-10-08T19:15:55.373 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-10-08T19:15:55.373 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-10-08T19:15:55.373 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-10-08T19:15:55.373 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-10-08T19:15:55.374 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-10-08T19:15:55.374 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-10-08T19:15:55.374 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-10-08T19:15:55.374 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-10-08T19:15:55.375 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-10-08T19:15:55.375 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-10-08T19:15:55.375 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-10-08T19:15:55.375 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:15:55.376 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:15:55.496 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-cephadm 2021-10-08T19:15:55.832 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:15:56.366 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-10-08T19:15:58.905 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:15:20 PM UTC. 2021-10-08T19:16:01.450 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:16:01.451 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:16:01.451 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:16:01.451 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-10-08T19:16:01.451 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-10-08T19:16:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-10-08T19:16:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-10-08T19:16:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-10-08T19:16:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-10-08T19:16:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-10-08T19:16:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-10-08T19:16:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-10-08T19:16:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-10-08T19:16:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-10-08T19:16:01.454 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-10-08T19:16:01.454 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:16:01.454 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:16:01.565 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2021-10-08T19:16:01.628 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-10-08T19:16:01.900 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:16:02.386 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2021-10-08T19:16:06.593 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:16:07.401 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-10-08T19:16:09.223 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:16:09.224 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================================== 2021-10-08T19:16:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:16:09.225 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================================== 2021-10-08T19:16:09.225 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:16:09.225 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 96 k 2021-10-08T19:16:09.226 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:16:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2021-10-08T19:16:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2021-10-08T19:16:09.226 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2021-10-08T19:16:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:16:09.227 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:16:09.227 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================================== 2021-10-08T19:16:09.227 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2021-10-08T19:16:09.227 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:16:09.228 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 5.9 M 2021-10-08T19:16:09.228 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 25 M 2021-10-08T19:16:09.228 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:16:09.259 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 16 MB/s | 538 kB 00:00 2021-10-08T19:16:09.307 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): python3-babel-2.5.1-5.el8.noarch.rpm 100 MB/s | 4.8 MB 00:00 2021-10-08T19:16:09.400 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): ceph-mgr-cephadm-17.0.0-8087.g103b6cc3.e 549 kB/s | 96 kB 00:00 2021-10-08T19:16:09.403 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.6 MB/s | 476 kB 00:00 2021-10-08T19:16:09.405 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:16:09.405 INFO:teuthology.orchestra.run.smithi112.stdout:Total 33 MB/s | 5.9 MB 00:00 2021-10-08T19:16:09.408 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:16:09.417 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:16:09.417 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:16:09.491 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:16:09.495 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:16:10.482 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:16:10.819 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/4 2021-10-08T19:16:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/4 2021-10-08T19:16:11.439 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 3/4 2021-10-08T19:16:11.589 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 4/4 2021-10-08T19:16:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 4/4 2021-10-08T19:16:11.840 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/4 2021-10-08T19:16:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/4 2021-10-08T19:16:11.841 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/4 2021-10-08T19:16:12.079 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/4 2021-10-08T19:16:12.079 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:16:12.717 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:16:15.350 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:16:15.351 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================================== 2021-10-08T19:16:15.351 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:16:15.351 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================================== 2021-10-08T19:16:15.351 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:16:15.352 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 96 k 2021-10-08T19:16:15.352 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:16:15.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2021-10-08T19:16:15.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2021-10-08T19:16:15.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2021-10-08T19:16:15.353 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:16:15.353 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:16:15.354 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================================== 2021-10-08T19:16:15.354 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2021-10-08T19:16:15.354 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:16:15.355 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 5.9 M 2021-10-08T19:16:15.355 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 25 M 2021-10-08T19:16:15.356 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:16:15.386 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 16 MB/s | 538 kB 00:00 2021-10-08T19:16:15.439 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): python3-babel-2.5.1-5.el8.noarch.rpm 99 MB/s | 4.8 MB 00:00 2021-10-08T19:16:15.533 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): ceph-mgr-cephadm-17.0.0-8087.g103b6cc3.e 529 kB/s | 96 kB 00:00 2021-10-08T19:16:15.559 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.3 MB/s | 476 kB 00:00 2021-10-08T19:16:15.560 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:16:15.561 INFO:teuthology.orchestra.run.smithi142.stdout:Total 28 MB/s | 5.9 MB 00:00 2021-10-08T19:16:15.564 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:16:15.573 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:16:15.573 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:16:15.647 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:16:15.651 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:16:16.652 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:16:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/4 2021-10-08T19:16:17.350 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/4 2021-10-08T19:16:17.654 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 3/4 2021-10-08T19:16:17.821 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 4/4 2021-10-08T19:16:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 4/4 2021-10-08T19:16:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 1/4 2021-10-08T19:16:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/4 2021-10-08T19:16:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/4 2021-10-08T19:16:18.301 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/4 2021-10-08T19:16:18.302 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:16:22.788 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:15:48 PM UTC. 2021-10-08T19:16:25.276 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:16:25.276 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:16:25.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:16:25.276 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2021-10-08T19:16:25.277 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.5.1-5.el8.noarch 2021-10-08T19:16:25.277 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-10-08T19:16:25.277 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:16:25.277 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:16:25.391 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-fuse 2021-10-08T19:16:25.726 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:16:26.245 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-10-08T19:16:28.766 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:15:53 PM UTC. 2021-10-08T19:16:31.416 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-10-08T19:16:31.487 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:16:31.487 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:16:31.488 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:16:31.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2021-10-08T19:16:31.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.5.1-5.el8.noarch 2021-10-08T19:16:31.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-10-08T19:16:31.488 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:16:31.489 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:16:31.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2021-10-08T19:16:32.006 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:16:32.520 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-10-08T19:16:36.475 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:16:37.551 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-10-08T19:16:39.000 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:16:39.001 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:16:39.001 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:16:39.001 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:16:39.001 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:16:39.002 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse 2021-10-08T19:16:39.002 INFO:teuthology.orchestra.run.smithi112.stdout: x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 869 k 2021-10-08T19:16:39.002 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2021-10-08T19:16:39.002 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2021-10-08T19:16:39.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:16:39.003 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:16:39.003 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:16:39.003 INFO:teuthology.orchestra.run.smithi112.stdout:Install 2 Packages 2021-10-08T19:16:39.004 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:16:39.004 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 952 k 2021-10-08T19:16:39.004 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 3.1 M 2021-10-08T19:16:39.004 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:16:39.034 INFO:teuthology.orchestra.run.smithi112.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 83 kB 00:00 2021-10-08T19:16:39.754 INFO:teuthology.orchestra.run.smithi112.stdout:(2/2): ceph-fuse-17.0.0-8087.g103b6cc3.el8.x86_ 1.1 MB/s | 869 kB 00:00 2021-10-08T19:16:39.755 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:16:39.756 INFO:teuthology.orchestra.run.smithi112.stdout:Total 1.2 MB/s | 952 kB 00:00 2021-10-08T19:16:39.757 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:16:39.780 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:16:39.780 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:16:39.858 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:16:39.863 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:16:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:16:40.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-10-08T19:16:40.727 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:16:41.063 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:16:41.063 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/2 2021-10-08T19:16:41.315 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-10-08T19:16:41.315 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:16:42.815 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:16:45.352 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:16:45.353 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:16:45.353 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:16:45.353 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:16:45.354 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:16:45.354 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse 2021-10-08T19:16:45.354 INFO:teuthology.orchestra.run.smithi142.stdout: x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 869 k 2021-10-08T19:16:45.354 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2021-10-08T19:16:45.355 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2021-10-08T19:16:45.355 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:16:45.355 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:16:45.355 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:16:45.355 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2021-10-08T19:16:45.356 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:16:45.356 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 952 k 2021-10-08T19:16:45.356 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 3.1 M 2021-10-08T19:16:45.356 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:16:45.386 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 83 kB 00:00 2021-10-08T19:16:45.600 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): ceph-fuse-17.0.0-8087.g103b6cc3.el8.x86_ 3.5 MB/s | 869 kB 00:00 2021-10-08T19:16:45.602 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:16:45.602 INFO:teuthology.orchestra.run.smithi142.stdout:Total 3.8 MB/s | 952 kB 00:00 2021-10-08T19:16:45.602 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:16:45.623 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:16:45.624 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:16:45.695 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:16:45.699 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:16:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:16:46.134 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-10-08T19:16:46.359 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:16:46.697 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2/2 2021-10-08T19:16:46.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/2 2021-10-08T19:16:46.931 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-10-08T19:16:46.932 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:16:51.728 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:16:17 PM UTC. 2021-10-08T19:16:54.336 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:16:54.336 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:16:54.336 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-10-08T19:16:54.337 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:16:54.337 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:16:54.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-volume 2021-10-08T19:16:54.802 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:16:55.365 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2021-10-08T19:16:57.397 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:16:23 PM UTC. 2021-10-08T19:17:00.025 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:00.025 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:17:00.025 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-10-08T19:17:00.026 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:00.026 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:17:00.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-volume 2021-10-08T19:17:00.498 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:17:00.515 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:17:01.000 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-10-08T19:17:05.549 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:17:05.954 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-10-08T19:17:08.104 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:17:08.105 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:17:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2021-10-08T19:17:08.106 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:17:08.106 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:17:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 253 k 2021-10-08T19:17:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:17:08.107 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:17:08.107 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:17:08.107 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2021-10-08T19:17:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:17:08.107 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 253 k 2021-10-08T19:17:08.108 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 1.2 M 2021-10-08T19:17:08.108 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:17:08.370 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-volume-17.0.0-8087.g103b6cc3.el8.noarch.rp 957 kB/s | 253 kB 00:00 2021-10-08T19:17:08.371 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:08.371 INFO:teuthology.orchestra.run.smithi112.stdout:Total 952 kB/s | 253 kB 00:00 2021-10-08T19:17:08.371 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:17:08.381 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:17:08.381 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:17:08.398 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:17:08.402 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:17:08.581 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:17:08.799 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:09.150 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:09.365 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:09.365 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:17:11.457 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:17:14.031 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:17:14.032 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:17:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2021-10-08T19:17:14.033 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:17:14.033 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:17:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:17.0.0-8087.g103b6cc3.el8 ceph-noarch 253 k 2021-10-08T19:17:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:14.034 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:17:14.034 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:17:14.034 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2021-10-08T19:17:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:14.035 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 253 k 2021-10-08T19:17:14.035 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 1.2 M 2021-10-08T19:17:14.035 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:17:14.365 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-volume-17.0.0-8087.g103b6cc3.el8.noarch.rp 761 kB/s | 253 kB 00:00 2021-10-08T19:17:14.366 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:14.366 INFO:teuthology.orchestra.run.smithi142.stdout:Total 758 kB/s | 253 kB 00:00 2021-10-08T19:17:14.367 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:17:14.376 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:17:14.377 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:17:14.393 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:17:14.397 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:17:14.593 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:17:14.821 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:15.184 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:15.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 1/1 2021-10-08T19:17:15.411 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:17:19.820 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:16:46 PM UTC. 2021-10-08T19:17:22.433 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:17:22.433 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:17:22.433 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:22.434 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:17:22.434 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:17:22.553 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados-devel 2021-10-08T19:17:22.892 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:17:23.438 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:17:25.976 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:16:52 PM UTC. 2021-10-08T19:17:28.513 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:28.513 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:17:28.514 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:17.0.0-8087.g103b6cc3.el8.noarch 2021-10-08T19:17:28.514 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:28.514 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:17:28.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2021-10-08T19:17:28.693 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2021-10-08T19:17:28.968 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:17:29.485 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:17:33.605 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:17:34.349 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 2021-10-08T19:17:36.189 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:17:36.191 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:17:36.191 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2021-10-08T19:17:36.191 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:17:36.191 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:17:36.191 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 125 k 2021-10-08T19:17:36.192 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:17:36.192 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:17:36.192 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:17:36.192 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2021-10-08T19:17:36.193 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:17:36.193 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 125 k 2021-10-08T19:17:36.193 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 432 k 2021-10-08T19:17:36.193 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:17:36.359 INFO:teuthology.orchestra.run.smithi112.stdout:librados-devel-17.0.0-8087.g103b6cc3.el8.x86_64 741 kB/s | 125 kB 00:00 2021-10-08T19:17:36.360 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:36.360 INFO:teuthology.orchestra.run.smithi112.stdout:Total 735 kB/s | 125 kB 00:00 2021-10-08T19:17:36.361 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:17:36.367 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:17:36.367 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:17:36.421 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:17:36.425 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:17:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:17:36.692 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:17:36.927 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:17:37.174 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:17:37.175 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:17:39.733 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:17:42.356 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:17:42.357 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:17:42.357 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2021-10-08T19:17:42.358 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:17:42.358 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:17:42.358 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 125 k 2021-10-08T19:17:42.358 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:17:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:17:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2021-10-08T19:17:42.359 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 125 k 2021-10-08T19:17:42.360 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 432 k 2021-10-08T19:17:42.360 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:17:42.530 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-17.0.0-8087.g103b6cc3.el8.x86_64 727 kB/s | 125 kB 00:00 2021-10-08T19:17:42.531 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:17:42.531 INFO:teuthology.orchestra.run.smithi142.stdout:Total 721 kB/s | 125 kB 00:00 2021-10-08T19:17:42.531 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:17:42.537 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:17:42.537 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:17:42.594 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:17:42.598 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:17:42.713 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:17:42.880 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:17:43.099 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:17:43.352 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:17:43.352 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:17:47.547 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:17:14 PM UTC. 2021-10-08T19:17:50.068 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:17:50.069 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:17:50.069 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:50.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:17:50.070 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:17:50.190 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs2 2021-10-08T19:17:50.527 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:17:51.075 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-10-08T19:17:53.785 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:17:20 PM UTC. 2021-10-08T19:17:56.236 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:17:56.957 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:56.957 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:17:56.958 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:17:56.958 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:17:56.958 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:17:57.075 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2021-10-08T19:17:57.414 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:17:57.932 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-10-08T19:18:01.098 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:18:02.801 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-10-08T19:18:03.217 INFO:teuthology.orchestra.run.smithi112.stdout:Package libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:03.645 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:03.647 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:18:03.647 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:18:03.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs-devel 2021-10-08T19:18:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:04.626 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 86 kB/s | 2.4 kB 00:00 2021-10-08T19:18:04.746 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 99 kB/s | 2.8 kB 00:00 2021-10-08T19:18:06.555 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:06.556 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:18:06.556 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2021-10-08T19:18:06.557 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:18:06.557 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:18:06.557 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:18:06.558 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:18:06.558 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:18:06.558 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:18:06.558 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2021-10-08T19:18:06.559 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:18:06.559 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 24 k 2021-10-08T19:18:06.559 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 102 k 2021-10-08T19:18:06.559 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:18:06.679 INFO:teuthology.orchestra.run.smithi112.stdout:libcephfs-devel-17.0.0-8087.g103b6cc3.el8.x86_6 197 kB/s | 24 kB 00:00 2021-10-08T19:18:06.679 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:06.680 INFO:teuthology.orchestra.run.smithi112.stdout:Total 194 kB/s | 24 kB 00:00 2021-10-08T19:18:06.680 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:18:06.683 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:18:06.684 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:18:06.685 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:18:06.689 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:18:06.739 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:18:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:07.059 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:07.267 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:07.267 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:18:08.375 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:18:10.490 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:10.918 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:10.919 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:18:10.919 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:18:11.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2021-10-08T19:18:11.346 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:11.866 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-10-08T19:18:12.040 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-10-08T19:18:14.091 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:14.092 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:18:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2021-10-08T19:18:14.092 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:18:14.093 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:18:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 24 k 2021-10-08T19:18:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:18:14.093 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:18:14.094 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:18:14.094 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2021-10-08T19:18:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:18:14.094 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 24 k 2021-10-08T19:18:14.095 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 102 k 2021-10-08T19:18:14.095 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:18:14.214 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-17.0.0-8087.g103b6cc3.el8.x86_6 197 kB/s | 24 kB 00:00 2021-10-08T19:18:14.214 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:14.215 INFO:teuthology.orchestra.run.smithi142.stdout:Total 194 kB/s | 24 kB 00:00 2021-10-08T19:18:14.215 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:18:14.218 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:18:14.219 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:18:14.220 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:18:14.225 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:18:14.278 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:18:14.467 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:14.875 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:14.876 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:18:17.702 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:17:42 PM UTC. 2021-10-08T19:18:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:18:20.216 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:18:20.216 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:20.217 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:18:20.217 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:18:20.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados2 2021-10-08T19:18:20.678 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:21.200 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-10-08T19:18:25.246 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:17:48 PM UTC. 2021-10-08T19:18:26.367 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2021-10-08T19:18:27.816 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:18:27.816 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:18:27.816 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:18:27.817 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:18:27.817 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:18:27.922 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2021-10-08T19:18:28.259 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:28.758 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:18:31.305 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:18:33.454 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:33.677 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 2021-10-08T19:18:33.899 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:33.900 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:18:33.900 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:18:34.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librbd1 2021-10-08T19:18:34.340 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:34.857 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-10-08T19:18:34.985 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2021-10-08T19:18:36.378 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:36.809 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:36.811 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:18:36.811 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:18:36.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rados 2021-10-08T19:18:37.244 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:37.770 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:18:37.897 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-10-08T19:18:39.032 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:18:39.352 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:39.785 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:39.786 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:18:39.786 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:18:39.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rgw 2021-10-08T19:18:40.221 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:40.733 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-10-08T19:18:40.858 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-10-08T19:18:41.143 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:41.571 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:41.572 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:18:41.572 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:18:41.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2021-10-08T19:18:42.014 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:42.224 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:42.533 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-10-08T19:18:42.653 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:42.654 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:18:42.655 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:18:42.710 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-10-08T19:18:42.756 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-cephfs 2021-10-08T19:18:43.090 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:43.597 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-10-08T19:18:43.725 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-10-08T19:18:44.134 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:44.568 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:44.569 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:18:44.569 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:18:44.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2021-10-08T19:18:44.999 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:45.121 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:45.490 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 89 kB/s | 2.8 kB 00:00 2021-10-08T19:18:45.571 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:45.572 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:18:45.572 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:18:45.667 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-10-08T19:18:45.672 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rbd 2021-10-08T19:18:46.005 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:46.539 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 77 kB/s | 2.4 kB 00:00 2021-10-08T19:18:46.666 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 88 kB/s | 2.8 kB 00:00 2021-10-08T19:18:47.059 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:47.493 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:47.495 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:18:47.495 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:18:47.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2021-10-08T19:18:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:48.063 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:48.433 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2021-10-08T19:18:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2021-10-08T19:18:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:18:48.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-fuse 2021-10-08T19:18:48.610 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 2021-10-08T19:18:48.942 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:49.464 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-10-08T19:18:49.586 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2021-10-08T19:18:50.033 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:50.457 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:50.458 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:18:50.458 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:18:50.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2021-10-08T19:18:50.885 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:51.382 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-10-08T19:18:51.386 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:18:51.388 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:18:51.388 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2021-10-08T19:18:51.388 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:18:51.389 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:18:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 93 k 2021-10-08T19:18:51.389 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:18:51.389 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:18:51.390 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:18:51.390 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2021-10-08T19:18:51.390 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:18:51.390 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 93 k 2021-10-08T19:18:51.391 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 281 k 2021-10-08T19:18:51.391 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:18:51.534 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-fuse-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 640 kB/s | 93 kB 00:00 2021-10-08T19:18:51.535 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:51.535 INFO:teuthology.orchestra.run.smithi112.stdout:Total 634 kB/s | 93 kB 00:00 2021-10-08T19:18:51.535 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:18:51.547 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:18:51.547 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:18:51.556 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:18:51.601 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:18:51.604 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:18:51.717 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:18:51.890 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:52.117 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:52.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:52.335 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:18:52.933 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:53.358 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:53.359 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:18:53.360 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:18:53.451 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2021-10-08T19:18:53.796 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:54.290 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-10-08T19:18:54.463 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-10-08T19:18:55.808 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 is already installed. 2021-10-08T19:18:56.230 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2021-10-08T19:18:56.231 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:18:56.313 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2021-10-08T19:18:56.653 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:18:57.162 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-10-08T19:18:57.336 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-10-08T19:18:59.140 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:18:59.141 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:18:59.141 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2021-10-08T19:18:59.141 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:18:59.141 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:18:59.142 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 93 k 2021-10-08T19:18:59.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:18:59.142 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:18:59.142 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:18:59.143 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2021-10-08T19:18:59.143 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:18:59.143 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 93 k 2021-10-08T19:18:59.143 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 281 k 2021-10-08T19:18:59.143 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:18:59.309 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 556 kB/s | 93 kB 00:00 2021-10-08T19:18:59.309 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:18:59.310 INFO:teuthology.orchestra.run.smithi142.stdout:Total 551 kB/s | 93 kB 00:00 2021-10-08T19:18:59.310 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:18:59.321 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:18:59.322 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:18:59.378 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:18:59.382 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:18:59.488 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:18:59.643 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:18:59.871 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:00.090 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:00.091 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:19:02.767 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:18:12 PM UTC. 2021-10-08T19:19:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:19:05.351 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:19:05.351 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:19:05.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:19:05.352 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:19:05.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-mirror 2021-10-08T19:19:05.850 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:19:06.423 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-10-08T19:19:10.642 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:18:20 PM UTC. 2021-10-08T19:19:11.617 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-10-08T19:19:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:19:13.178 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:19:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:19:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:19:13.179 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:19:13.297 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2021-10-08T19:19:13.633 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:19:14.118 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2021-10-08T19:19:16.504 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:19:18.998 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 76 kB/s | 2.4 kB 00:00 2021-10-08T19:19:19.142 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:19:19.143 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:19:19.143 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2021-10-08T19:19:19.143 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:19:19.144 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:19:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:19:19.144 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:19:19.144 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:19:19.144 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:19:19.145 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2021-10-08T19:19:19.145 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:19:19.145 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 3.8 M 2021-10-08T19:19:19.145 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 19 M 2021-10-08T19:19:19.146 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:19:20.447 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-mirror-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 2.9 MB/s | 3.8 MB 00:01 2021-10-08T19:19:20.448 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:19:20.449 INFO:teuthology.orchestra.run.smithi112.stdout:Total 2.9 MB/s | 3.8 MB 00:01 2021-10-08T19:19:20.450 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:19:20.464 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:19:20.464 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:19:20.537 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:19:20.541 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:19:21.028 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:19:21.206 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:21.552 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:21.797 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:21.797 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:19:24.271 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:19:26.896 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:19:26.897 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:19:26.897 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2021-10-08T19:19:26.898 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:19:26.898 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:19:26.898 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 3.8 M 2021-10-08T19:19:26.898 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:19:26.899 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:19:26.899 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:19:26.899 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2021-10-08T19:19:26.899 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:19:26.899 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.8 M 2021-10-08T19:19:26.900 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 19 M 2021-10-08T19:19:26.900 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:19:27.256 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 11 MB/s | 3.8 MB 00:00 2021-10-08T19:19:27.257 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:19:27.258 INFO:teuthology.orchestra.run.smithi142.stdout:Total 10 MB/s | 3.8 MB 00:00 2021-10-08T19:19:27.258 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:19:27.271 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:19:27.271 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:19:27.341 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:19:27.345 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:19:27.832 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:19:28.016 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:28.389 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:28.647 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:28.648 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:19:32.362 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:18:57 PM UTC. 2021-10-08T19:19:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:19:34.953 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:19:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:19:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:19:34.954 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:19:35.069 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-nbd 2021-10-08T19:19:35.406 INFO:teuthology.orchestra.run.smithi112.stdout:Updating Subscription Management repositories. 2021-10-08T19:19:35.932 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 72 kB/s | 2.4 kB 00:00 2021-10-08T19:19:39.236 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 08 Oct 2021 07:19:05 PM UTC. 2021-10-08T19:19:41.125 INFO:teuthology.orchestra.run.smithi112.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:19:41.824 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:19:41.825 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:19:41.825 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:19:41.825 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:19:41.825 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:19:41.933 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2021-10-08T19:19:42.272 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2021-10-08T19:19:42.800 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-10-08T19:19:46.099 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:19:47.666 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2021-10-08T19:19:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2021-10-08T19:19:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:19:48.662 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2021-10-08T19:19:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:19:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2021-10-08T19:19:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 173 k 2021-10-08T19:19:48.663 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:19:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2021-10-08T19:19:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2021-10-08T19:19:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2021-10-08T19:19:48.664 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:19:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 173 k 2021-10-08T19:19:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 563 k 2021-10-08T19:19:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2021-10-08T19:19:48.833 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-nbd-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 1.0 MB/s | 173 kB 00:00 2021-10-08T19:19:48.834 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:19:48.834 INFO:teuthology.orchestra.run.smithi112.stdout:Total 1.0 MB/s | 173 kB 00:00 2021-10-08T19:19:48.834 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2021-10-08T19:19:48.846 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2021-10-08T19:19:48.846 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2021-10-08T19:19:48.903 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2021-10-08T19:19:48.907 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2021-10-08T19:19:49.027 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2021-10-08T19:19:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:49.445 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:49.669 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:49.669 INFO:teuthology.orchestra.run.smithi112.stdout:Installed products updated. 2021-10-08T19:19:52.974 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:10:55 PM UTC. 2021-10-08T19:19:55.534 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2021-10-08T19:19:55.535 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:19:55.535 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2021-10-08T19:19:55.536 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:19:55.536 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2021-10-08T19:19:55.536 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:17.0.0-8087.g103b6cc3.el8 ceph 173 k 2021-10-08T19:19:55.536 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:19:55.537 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2021-10-08T19:19:55.537 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2021-10-08T19:19:55.537 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2021-10-08T19:19:55.537 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:19:55.538 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 173 k 2021-10-08T19:19:55.538 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 563 k 2021-10-08T19:19:55.538 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2021-10-08T19:19:55.707 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-17.0.0-8087.g103b6cc3.el8.x86_64.rpm 1.0 MB/s | 173 kB 00:00 2021-10-08T19:19:55.708 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2021-10-08T19:19:55.709 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.0 MB/s | 173 kB 00:00 2021-10-08T19:19:55.709 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2021-10-08T19:19:55.720 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2021-10-08T19:19:55.720 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2021-10-08T19:19:55.774 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2021-10-08T19:19:55.778 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2021-10-08T19:19:55.896 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2021-10-08T19:19:56.134 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:56.360 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:56.581 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 1/1 2021-10-08T19:19:56.582 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2021-10-08T19:20:00.089 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:19:27 PM UTC. 2021-10-08T19:20:02.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:20:02.588 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2021-10-08T19:20:02.588 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:20:02.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:20:02.589 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2021-10-08T19:20:02.709 DEBUG:teuthology.parallel:result is None 2021-10-08T19:20:07.078 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:05 ago on Fri 08 Oct 2021 07:19:33 PM UTC. 2021-10-08T19:20:09.607 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:20:09.607 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2021-10-08T19:20:09.608 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:17.0.0-8087.g103b6cc3.el8.x86_64 2021-10-08T19:20:09.608 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:20:09.608 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2021-10-08T19:20:09.727 DEBUG:teuthology.parallel:result is None 2021-10-08T19:20:09.728 DEBUG:teuthology.orchestra.run.smithi112:> sudo lsb_release -is 2021-10-08T19:20:09.776 INFO:teuthology.orchestra.run.smithi112.stdout:RedHatEnterprise 2021-10-08T19:20:09.777 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-10-08T19:20:09.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:20:09.936 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-10-08T19:20:09.959 INFO:teuthology.orchestra.run.smithi112.stdout:17.0.0-8087.g103b6cc3.el8 2021-10-08T19:20:09.960 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-8087.g103b6cc3.el8 2021-10-08T19:20:09.960 INFO:teuthology.task.install:The correct ceph version 17.0.0-8087.g103b6cc3 is installed. 2021-10-08T19:20:09.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2021-10-08T19:20:10.002 INFO:teuthology.orchestra.run.smithi142.stdout:RedHatEnterprise 2021-10-08T19:20:10.003 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-10-08T19:20:10.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:20:10.155 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-10-08T19:20:10.175 INFO:teuthology.orchestra.run.smithi142.stdout:17.0.0-8087.g103b6cc3.el8 2021-10-08T19:20:10.176 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-8087.g103b6cc3.el8 2021-10-08T19:20:10.176 INFO:teuthology.task.install:The correct ceph version 17.0.0-8087.g103b6cc3 is installed. 2021-10-08T19:20:10.177 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-10-08T19:20:10.177 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:20:10.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-08T19:20:10.207 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:20:10.208 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-08T19:20:10.240 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-10-08T19:20:10.241 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:20:10.241 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2021-10-08T19:20:10.274 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-08T19:20:10.340 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:20:10.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2021-10-08T19:20:10.365 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-08T19:20:10.429 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-10-08T19:20:10.429 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:20:10.430 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-08T19:20:10.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-08T19:20:10.520 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:20:10.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-08T19:20:10.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-08T19:20:10.608 INFO:teuthology.run_tasks:Running task cephadm... 2021-10-08T19:20:10.681 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '103b6cc3554193fcd0852d9c647cef19e99920cf', 'cephadm_mode': 'cephadm-package'} 2021-10-08T19:20:10.682 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:20:10.683 INFO:tasks.cephadm:Cluster fsid is c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:10.684 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-10-08T19:20:10.684 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.112', 'mon.c': '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]', 'mon.b': '172.21.15.142'} 2021-10-08T19:20:10.684 INFO:tasks.cephadm:First mon is mon.a on smithi112 2021-10-08T19:20:10.685 INFO:tasks.cephadm:First mgr is y 2021-10-08T19:20:10.685 INFO:tasks.cephadm:Normalizing hostnames... 2021-10-08T19:20:10.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2021-10-08T19:20:10.713 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname $(hostname -s) 2021-10-08T19:20:10.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2021-10-08T19:20:10.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph 2021-10-08T19:20:10.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2021-10-08T19:20:10.873 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /etc/ceph 2021-10-08T19:20:10.896 INFO:tasks.cephadm:Writing seed config... 2021-10-08T19:20:10.897 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-10-08T19:20:10.898 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-10-08T19:20:10.898 INFO:tasks.cephadm: override: [client] debug ms = 1 2021-10-08T19:20:10.899 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2021-10-08T19:20:10.899 INFO:tasks.cephadm: override: [global] ms type = async 2021-10-08T19:20:10.899 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-10-08T19:20:10.899 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-10-08T19:20:10.900 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-10-08T19:20:10.900 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2021-10-08T19:20:10.900 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-10-08T19:20:10.901 INFO:tasks.cephadm: override: [osd] debug osd = 20 2021-10-08T19:20:10.901 INFO:tasks.cephadm: override: [osd] osd class default list = * 2021-10-08T19:20:10.901 INFO:tasks.cephadm: override: [osd] osd class load list = * 2021-10-08T19:20:10.902 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-10-08T19:20:10.902 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:20:10.903 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-10-08T19:20:10.929 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c1559bde-286c-11ec-8c25-001a4aab830c mon election default strategy = 1 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2021-10-08T19:20:10.929 DEBUG:teuthology.orchestra.run.smithi112:mon.a> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a.service 2021-10-08T19:20:10.971 DEBUG:teuthology.orchestra.run.smithi112:mgr.y> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.y.service 2021-10-08T19:20:10.995 INFO:journalctl@ceph.mon.a.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:20:10.996 INFO:tasks.cephadm:Bootstrapping... 2021-10-08T19:20:10.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -v bootstrap --fsid c1559bde-286c-11ec-8c25-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.112 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:20:11.019 INFO:journalctl@ceph.mgr.y.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:20:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:-------------------------------------------------------------------------------- 2021-10-08T19:20:11.224 INFO:teuthology.orchestra.run.smithi112.stderr:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf', '-v', 'bootstrap', '--fsid', 'c1559bde-286c-11ec-8c25-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.112', '--skip-admin-label'] 2021-10-08T19:20:11.224 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:20:11.870 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: 3.2.3 2021-10-08T19:20:11.938 INFO:teuthology.orchestra.run.smithi112.stderr:Verifying podman|docker is present... 2021-10-08T19:20:11.939 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:20:11.980 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: 3.2.3 2021-10-08T19:20:12.079 INFO:teuthology.orchestra.run.smithi112.stderr:Verifying lvm2 is present... 2021-10-08T19:20:12.079 INFO:teuthology.orchestra.run.smithi112.stderr:Verifying time synchronization is in place... 2021-10-08T19:20:12.080 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-enabled chrony.service 2021-10-08T19:20:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-10-08T19:20:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-active chrony.service 2021-10-08T19:20:12.093 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: inactive 2021-10-08T19:20:12.094 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-enabled chronyd.service 2021-10-08T19:20:12.100 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: enabled 2021-10-08T19:20:12.100 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-active chronyd.service 2021-10-08T19:20:12.106 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: active 2021-10-08T19:20:12.107 INFO:teuthology.orchestra.run.smithi112.stderr:Unit chronyd.service is enabled and running 2021-10-08T19:20:12.107 INFO:teuthology.orchestra.run.smithi112.stderr:Repeating the final host check... 2021-10-08T19:20:12.107 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2021-10-08T19:20:12.145 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: 3.2.3 2021-10-08T19:20:12.248 INFO:teuthology.orchestra.run.smithi112.stderr:podman (/bin/podman) version 3.2.3 is present 2021-10-08T19:20:12.249 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl is present 2021-10-08T19:20:12.249 INFO:teuthology.orchestra.run.smithi112.stderr:lvcreate is present 2021-10-08T19:20:12.249 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-enabled chrony.service 2021-10-08T19:20:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-10-08T19:20:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-active chrony.service 2021-10-08T19:20:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: inactive 2021-10-08T19:20:12.261 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-enabled chronyd.service 2021-10-08T19:20:12.267 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: enabled 2021-10-08T19:20:12.267 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-active chronyd.service 2021-10-08T19:20:12.273 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: active 2021-10-08T19:20:12.274 INFO:teuthology.orchestra.run.smithi112.stderr:Unit chronyd.service is enabled and running 2021-10-08T19:20:12.274 INFO:teuthology.orchestra.run.smithi112.stderr:Host looks OK 2021-10-08T19:20:12.274 INFO:teuthology.orchestra.run.smithi112.stderr:Cluster fsid: c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:20:12.275 INFO:teuthology.orchestra.run.smithi112.stderr:Acquiring lock 140631997626856 on /run/cephadm/c1559bde-286c-11ec-8c25-001a4aab830c.lock 2021-10-08T19:20:12.275 INFO:teuthology.orchestra.run.smithi112.stderr:Lock 140631997626856 acquired on /run/cephadm/c1559bde-286c-11ec-8c25-001a4aab830c.lock 2021-10-08T19:20:12.275 INFO:teuthology.orchestra.run.smithi112.stderr:Verifying IP 172.21.15.112 port 3300 ... 2021-10-08T19:20:12.276 INFO:teuthology.orchestra.run.smithi112.stderr:Verifying IP 172.21.15.112 port 6789 ... 2021-10-08T19:20:12.277 INFO:teuthology.orchestra.run.smithi112.stderr:Base mon IP is 172.21.15.112, final addrv is [v2:172.21.15.112:3300,v1:172.21.15.112:6789] 2021-10-08T19:20:12.277 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /sbin/ip route ls 2021-10-08T19:20:12.277 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2021-10-08T19:20:12.277 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.112 metric 100 2021-10-08T19:20:12.278 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /sbin/ip -6 route ls 2021-10-08T19:20:12.279 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-10-08T19:20:12.279 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2021-10-08T19:20:12.279 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1786sec hoplimit 64 pref medium 2021-10-08T19:20:12.280 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /sbin/ip -6 addr ls 2021-10-08T19:20:12.281 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-10-08T19:20:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: inet6 ::1/128 scope host 2021-10-08T19:20:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-10-08T19:20:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2021-10-08T19:20:12.282 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2021-10-08T19:20:12.283 INFO:teuthology.orchestra.run.smithi112.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-10-08T19:20:12.284 INFO:teuthology.orchestra.run.smithi112.stderr:Mon IP `172.21.15.112` is in CIDR network `172.21.0.0/20` 2021-10-08T19:20:12.284 INFO:teuthology.orchestra.run.smithi112.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2021-10-08T19:20:12.284 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf... 2021-10-08T19:20:12.284 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman pull quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf 2021-10-08T19:20:12.352 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: Trying to pull quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf... 2021-10-08T19:20:12.451 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: Getting image source signatures 2021-10-08T19:20:12.543 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: Copying blob sha256:be118be2c7433f0fef49ac99462184a67ed6f0c5b5723500aea70f60acdb522f 2021-10-08T19:20:12.593 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: Copying blob sha256:bf399268b236a88e4db94bb617389c57056c51b9b05d91ff5b48f1ad6f845f5e 2021-10-08T19:20:35.190 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: Copying config sha256:085fa9937774283f2e7d932e3f979b6814e0da92c6b18e0753c7a57d64a9fc79 2021-10-08T19:20:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: Writing manifest to image destination 2021-10-08T19:20:35.257 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: Storing signatures 2021-10-08T19:20:45.429 INFO:teuthology.orchestra.run.smithi112.stderr:/bin/podman: 085fa9937774283f2e7d932e3f979b6814e0da92c6b18e0753c7a57d64a9fc79 2021-10-08T19:20:45.451 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --version 2021-10-08T19:20:45.991 INFO:teuthology.orchestra.run.smithi112.stderr:ceph: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev) 2021-10-08T19:20:57.009 INFO:teuthology.orchestra.run.smithi112.stderr:Ceph version: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev) 2021-10-08T19:20:57.010 INFO:teuthology.orchestra.run.smithi112.stderr:Extracting ceph user uid/gid from container image... 2021-10-08T19:20:57.010 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint stat --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -c %u %g /var/lib/ceph 2021-10-08T19:20:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:stat: 167 167 2021-10-08T19:20:57.959 INFO:teuthology.orchestra.run.smithi112.stderr:Creating initial keys... 2021-10-08T19:20:57.959 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:20:58.313 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph-authtool: AQAammBhpDZLEhAAFQkIl/XEH7bZsmpv83PGBw== 2021-10-08T19:20:58.900 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:20:59.246 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph-authtool: AQAbmmBh1ZpHDhAAdc3IXH7aDPlRm+b/nPh4og== 2021-10-08T19:20:59.745 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --gen-print-key 2021-10-08T19:21:00.096 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph-authtool: AQAcmmBhORpbBRAA6X1J6hxS2xJquo6YrPgajQ== 2021-10-08T19:21:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:Creating initial monmap... 2021-10-08T19:21:00.587 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmp394q1ira:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --create --clobber --fsid c1559bde-286c-11ec-8c25-001a4aab830c --addv a [v2:172.21.15.112:3300,v1:172.21.15.112:6789] /tmp/monmap 2021-10-08T19:21:00.922 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-10-08T19:21:00.922 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2021-10-08T19:21:00.922 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:00.923 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-10-08T19:21:01.427 INFO:teuthology.orchestra.run.smithi112.stderr:monmaptool for a [v2:172.21.15.112:3300,v1:172.21.15.112:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-10-08T19:21:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:setting min_mon_release = octopus 2021-10-08T19:21:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/monmaptool: set fsid to c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-10-08T19:21:01.428 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:01.429 INFO:teuthology.orchestra.run.smithi112.stderr:Creating mon... 2021-10-08T19:21:01.429 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpjss6jo67:/tmp/keyring:z -v /tmp/ceph-tmp394q1ira:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf --mkfs -i a --fsid c1559bde-286c-11ec-8c25-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false 2021-10-08T19:21:02.368 INFO:teuthology.orchestra.run.smithi112.stderr:create mon.a on 2021-10-08T19:21:02.369 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:02.374 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl disable ceph.target 2021-10-08T19:21:02.382 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-10-08T19:21:02.462 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl enable ceph.target 2021-10-08T19:21:02.469 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2021-10-08T19:21:02.549 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl start ceph.target 2021-10-08T19:21:02.557 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl enable ceph-c1559bde-286c-11ec-8c25-001a4aab830c.target 2021-10-08T19:21:02.564 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c1559bde-286c-11ec-8c25-001a4aab830c.target → /etc/systemd/system/ceph-c1559bde-286c-11ec-8c25-001a4aab830c.target. 2021-10-08T19:21:02.564 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-c1559bde-286c-11ec-8c25-001a4aab830c.target → /etc/systemd/system/ceph-c1559bde-286c-11ec-8c25-001a4aab830c.target. 2021-10-08T19:21:02.645 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl start ceph-c1559bde-286c-11ec-8c25-001a4aab830c.target 2021-10-08T19:21:02.652 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl daemon-reload 2021-10-08T19:21:02.736 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl stop ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:21:02.757 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl reset-failed ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:21:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Failed to reset failed state of unit ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a.service: Unit ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a.service not loaded. 2021-10-08T19:21:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl enable ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:21:02.771 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Created symlink /etc/systemd/system/ceph-c1559bde-286c-11ec-8c25-001a4aab830c.target.wants/ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-c1559bde-286c-11ec-8c25-001a4aab830c@.service. 2021-10-08T19:21:02.855 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl start ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:21:03.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:02 smithi112 systemd[1]: Starting Ceph mon.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:21:03.466 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:03 smithi112 bash[30651]: eb40eb89917df15af479dfdf377d31b08494384da52943ca528371a8c8ea82b1 2021-10-08T19:21:03.466 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:03 smithi112 ceph-mon[30861]: mkfs c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:03.467 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:03 smithi112 ceph-mon[30861]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:21:03.468 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:21:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: disabled 2021-10-08T19:21:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:21:03.484 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: inactive 2021-10-08T19:21:03.485 INFO:teuthology.orchestra.run.smithi112.stderr:firewalld.service is not enabled 2021-10-08T19:21:03.485 INFO:teuthology.orchestra.run.smithi112.stderr:Not possible to enable service . firewalld.service is not available 2021-10-08T19:21:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:Waiting for mon to start... 2021-10-08T19:21:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:Waiting for mon... 2021-10-08T19:21:03.486 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status 2021-10-08T19:21:03.727 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:03 smithi112 systemd[1]: Started Ceph mon.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:21:03.915 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.909+0000 7fa37947c700 1 Processor -- start 2021-10-08T19:21:03.915 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.909+0000 7fa37947c700 1 -- start start 2021-10-08T19:21:03.916 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.909+0000 7fa37947c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa3740fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:03.916 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.909+0000 7fa37947c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740ff300 con 0x7fa374070450 2021-10-08T19:21:03.916 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.910+0000 7fa372ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa3740fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:03.916 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.910+0000 7fa372ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa3740fedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60938/0 (socket says 172.21.15.112:60938) 2021-10-08T19:21:03.916 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.910+0000 7fa372ffd700 1 -- 172.21.15.112:0/33601494 learned_addr learned my addr 172.21.15.112:0/33601494 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:03.917 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.910+0000 7fa372ffd700 1 -- 172.21.15.112:0/33601494 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740ff440 con 0x7fa374070450 2021-10-08T19:21:03.917 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.910+0000 7fa372ffd700 1 --2- 172.21.15.112:0/33601494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa3740fedc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa364009960 tx=0x7fa3640092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5ee40bd82269f9 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:03.917 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.910+0000 7fa371ffb700 1 -- 172.21.15.112:0/33601494 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa36400b860 con 0x7fa374070450 2021-10-08T19:21:03.917 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.910+0000 7fa371ffb700 1 -- 172.21.15.112:0/33601494 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36400b9c0 con 0x7fa374070450 2021-10-08T19:21:03.918 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.910+0000 7fa371ffb700 1 -- 172.21.15.112:0/33601494 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa36400bb50 con 0x7fa374070450 2021-10-08T19:21:03.918 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.911+0000 7fa37947c700 1 -- 172.21.15.112:0/33601494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 msgr2=0x7fa3740fedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:03.918 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.911+0000 7fa37947c700 1 --2- 172.21.15.112:0/33601494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa3740fedc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa364009960 tx=0x7fa3640092d0 comp rx=0 tx=0).stop 2021-10-08T19:21:03.918 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.911+0000 7fa37947c700 1 -- 172.21.15.112:0/33601494 shutdown_connections 2021-10-08T19:21:03.918 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.911+0000 7fa37947c700 1 --2- 172.21.15.112:0/33601494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa3740fedc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:03.919 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.911+0000 7fa37947c700 1 -- 172.21.15.112:0/33601494 >> 172.21.15.112:0/33601494 conn(0x7fa3740f6850 msgr2=0x7fa3740f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:03.919 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.911+0000 7fa37947c700 1 -- 172.21.15.112:0/33601494 shutdown_connections 2021-10-08T19:21:03.919 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.911+0000 7fa37947c700 1 -- 172.21.15.112:0/33601494 wait complete. 2021-10-08T19:21:03.919 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.912+0000 7fa37947c700 1 Processor -- start 2021-10-08T19:21:03.919 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.912+0000 7fa37947c700 1 -- start start 2021-10-08T19:21:03.920 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.912+0000 7fa37947c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa37410a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:03.920 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.912+0000 7fa37947c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37410aa20 con 0x7fa374070450 2021-10-08T19:21:03.920 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.912+0000 7fa372ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa37410a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:03.920 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.912+0000 7fa372ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa37410a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60940/0 (socket says 172.21.15.112:60940) 2021-10-08T19:21:03.921 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.912+0000 7fa372ffd700 1 -- 172.21.15.112:0/2456831366 learned_addr learned my addr 172.21.15.112:0/2456831366 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:03.921 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa372ffd700 1 -- 172.21.15.112:0/2456831366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa364009570 con 0x7fa374070450 2021-10-08T19:21:03.921 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa372ffd700 1 --2- 172.21.15.112:0/2456831366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa37410a4e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa3640090b0 tx=0x7fa364016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:03.921 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa36b7fe700 1 -- 172.21.15.112:0/2456831366 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa36400be60 con 0x7fa374070450 2021-10-08T19:21:03.921 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa36b7fe700 1 -- 172.21.15.112:0/2456831366 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36401a650 con 0x7fa374070450 2021-10-08T19:21:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37410ac20 con 0x7fa374070450 2021-10-08T19:21:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa36b7fe700 1 -- 172.21.15.112:0/2456831366 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa36401a900 con 0x7fa374070450 2021-10-08T19:21:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37410b8c0 con 0x7fa374070450 2021-10-08T19:21:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa36b7fe700 1 -- 172.21.15.112:0/2456831366 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fa364017020 con 0x7fa374070450 2021-10-08T19:21:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.913+0000 7fa36b7fe700 1 -- 172.21.15.112:0/2456831366 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa36402fa00 con 0x7fa374070450 2021-10-08T19:21:03.923 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.914+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37410b110 con 0x7fa374070450 2021-10-08T19:21:03.924 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.916+0000 7fa36b7fe700 1 -- 172.21.15.112:0/2456831366 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7fa36402fbc0 con 0x7fa374070450 2021-10-08T19:21:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.985+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fa3740ff750 con 0x7fa374070450 2021-10-08T19:21:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.985+0000 7fa36b7fe700 1 -- 172.21.15.112:0/2456831366 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fa36402fd60 con 0x7fa374070450 2021-10-08T19:21:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: cluster: 2021-10-08T19:21:03.989 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: id: c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-10-08T19:21:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: services: 2021-10-08T19:21:03.990 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 584126320) 2021-10-08T19:21:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mgr: no daemons active 2021-10-08T19:21:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-10-08T19:21:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: data: 2021-10-08T19:21:03.991 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-10-08T19:21:03.992 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-10-08T19:21:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-10-08T19:21:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: pgs: 2021-10-08T19:21:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.993 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.986+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 msgr2=0x7fa37410a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:03.994 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.986+0000 7fa37947c700 1 --2- 172.21.15.112:0/2456831366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa37410a4e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa3640090b0 tx=0x7fa364016000 comp rx=0 tx=0).stop 2021-10-08T19:21:03.994 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.986+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 shutdown_connections 2021-10-08T19:21:03.994 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.986+0000 7fa37947c700 1 --2- 172.21.15.112:0/2456831366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa374070450 0x7fa37410a4e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:03.994 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.986+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 >> 172.21.15.112:0/2456831366 conn(0x7fa3740f6850 msgr2=0x7fa3740f8040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:03.995 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.986+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 shutdown_connections 2021-10-08T19:21:03.995 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:03.986+0000 7fa37947c700 1 -- 172.21.15.112:0/2456831366 wait complete. 2021-10-08T19:21:04.623 INFO:teuthology.orchestra.run.smithi112.stderr:mon is available 2021-10-08T19:21:04.624 INFO:teuthology.orchestra.run.smithi112.stderr:Assimilating anything we can from ceph.conf... 2021-10-08T19:21:04.624 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z -v /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-10-08T19:21:04.679 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:04 smithi112 ceph-mon[30861]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:21:04.680 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:04 smithi112 ceph-mon[30861]: monmap e1: 1 mons at {a=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} 2021-10-08T19:21:04.680 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:04 smithi112 ceph-mon[30861]: fsmap 2021-10-08T19:21:04.680 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:04 smithi112 ceph-mon[30861]: osdmap e1: 0 total, 0 up, 0 in 2021-10-08T19:21:04.680 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:04 smithi112 ceph-mon[30861]: mgrmap e1: no daemons active 2021-10-08T19:21:04.681 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:04 smithi112 ceph-mon[30861]: from='client.? 172.21.15.112:0/2456831366' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-10-08T19:21:05.056 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.050+0000 7f4fc282b700 1 Processor -- start 2021-10-08T19:21:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.050+0000 7f4fc282b700 1 -- start start 2021-10-08T19:21:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.050+0000 7f4fc282b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc0fb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.050+0000 7f4fc282b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0fb9c0 con 0x7f4fbc0fb070 2021-10-08T19:21:05.057 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.051+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc0fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.051+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc0fb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60942/0 (socket says 172.21.15.112:60942) 2021-10-08T19:21:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.051+0000 7f4fbbfff700 1 -- 172.21.15.112:0/1488696725 learned_addr learned my addr 172.21.15.112:0/1488696725 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.051+0000 7f4fbbfff700 1 -- 172.21.15.112:0/1488696725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0fbb00 con 0x7f4fbc0fb070 2021-10-08T19:21:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fbbfff700 1 --2- 172.21.15.112:0/1488696725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc0fb480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00b5f0 tx=0x7f4fac006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633546bd709ad7a3 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:05.058 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fbaffd700 1 -- 172.21.15.112:0/1488696725 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fac0106d0 con 0x7f4fbc0fb070 2021-10-08T19:21:05.059 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fbaffd700 1 -- 172.21.15.112:0/1488696725 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac010830 con 0x7f4fbc0fb070 2021-10-08T19:21:05.059 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fbaffd700 1 -- 172.21.15.112:0/1488696725 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fac010ae0 con 0x7f4fbc0fb070 2021-10-08T19:21:05.059 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fc282b700 1 -- 172.21.15.112:0/1488696725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 msgr2=0x7f4fbc0fb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fc282b700 1 --2- 172.21.15.112:0/1488696725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc0fb480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00b5f0 tx=0x7f4fac006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fc282b700 1 -- 172.21.15.112:0/1488696725 shutdown_connections 2021-10-08T19:21:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fc282b700 1 --2- 172.21.15.112:0/1488696725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc0fb480 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fc282b700 1 -- 172.21.15.112:0/1488696725 >> 172.21.15.112:0/1488696725 conn(0x7f4fbc0f6840 msgr2=0x7f4fbc0f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:05.060 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fc282b700 1 -- 172.21.15.112:0/1488696725 shutdown_connections 2021-10-08T19:21:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.052+0000 7f4fc282b700 1 -- 172.21.15.112:0/1488696725 wait complete. 2021-10-08T19:21:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.053+0000 7f4fc282b700 1 Processor -- start 2021-10-08T19:21:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.053+0000 7f4fc282b700 1 -- start start 2021-10-08T19:21:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.053+0000 7f4fc282b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:05.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.053+0000 7f4fc282b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc109960 con 0x7f4fbc0fb070 2021-10-08T19:21:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.053+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.053+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60944/0 (socket says 172.21.15.112:60944) 2021-10-08T19:21:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.053+0000 7f4fbbfff700 1 -- 172.21.15.112:0/3793077114 learned_addr learned my addr 172.21.15.112:0/3793077114 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:05.062 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fbbfff700 1 -- 172.21.15.112:0/3793077114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac00b200 con 0x7f4fbc0fb070 2021-10-08T19:21:05.063 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fbbfff700 1 --2- 172.21.15.112:0/3793077114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc109420 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4fac006f20 tx=0x7f4fac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:05.063 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fb8ff9700 1 -- 172.21.15.112:0/3793077114 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fac01d430 con 0x7f4fbc0fb070 2021-10-08T19:21:05.063 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fb8ff9700 1 -- 172.21.15.112:0/3793077114 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac01d590 con 0x7f4fbc0fb070 2021-10-08T19:21:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fb8ff9700 1 -- 172.21.15.112:0/3793077114 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fac01d720 con 0x7f4fbc0fb070 2021-10-08T19:21:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc109b60 con 0x7f4fbc0fb070 2021-10-08T19:21:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc10a800 con 0x7f4fbc0fb070 2021-10-08T19:21:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fb8ff9700 1 -- 172.21.15.112:0/3793077114 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f4fac00f070 con 0x7f4fbc0fb070 2021-10-08T19:21:05.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.054+0000 7f4fb8ff9700 1 -- 172.21.15.112:0/3793077114 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4fac025860 con 0x7f4fbc0fb070 2021-10-08T19:21:05.065 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.055+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc109ff0 con 0x7f4fbc0fb070 2021-10-08T19:21:05.065 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.057+0000 7f4fb8ff9700 1 -- 172.21.15.112:0/3793077114 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7f4fac044270 con 0x7f4fbc0fb070 2021-10-08T19:21:05.125 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.124+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f4fbc05a9f0 con 0x7f4fbc0fb070 2021-10-08T19:21:05.130 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.126+0000 7f4fb8ff9700 1 -- 172.21.15.112:0/3793077114 <== mon.0 v2:172.21.15.112:3300/0 7 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f4fac01dce0 con 0x7f4fbc0fb070 2021-10-08T19:21:05.130 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.126+0000 7f4fb8ff9700 1 -- 172.21.15.112:0/3793077114 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+340 (secure 0 0 0) 0x7f4fac033030 con 0x7f4fbc0fb070 2021-10-08T19:21:05.130 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.130 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: [global] 2021-10-08T19:21:05.131 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: fsid = c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:05.131 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.112:3300,v1:172.21.15.112:6789] 2021-10-08T19:21:05.131 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-10-08T19:21:05.131 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-10-08T19:21:05.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-10-08T19:21:05.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-10-08T19:21:05.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: [mgr] 2021-10-08T19:21:05.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-10-08T19:21:05.133 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.133 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: [osd] 2021-10-08T19:21:05.133 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-10-08T19:21:05.133 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-10-08T19:21:05.133 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.128+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 msgr2=0x7f4fbc109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.128+0000 7f4fc282b700 1 --2- 172.21.15.112:0/3793077114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc109420 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4fac006f20 tx=0x7f4fac015000 comp rx=0 tx=0).stop 2021-10-08T19:21:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.128+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 shutdown_connections 2021-10-08T19:21:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.128+0000 7f4fc282b700 1 --2- 172.21.15.112:0/3793077114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fbc0fb070 0x7f4fbc109420 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.128+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 >> 172.21.15.112:0/3793077114 conn(0x7f4fbc0f6840 msgr2=0x7f4fbc0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:05.135 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.128+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 shutdown_connections 2021-10-08T19:21:05.135 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:05.128+0000 7f4fc282b700 1 -- 172.21.15.112:0/3793077114 wait complete. 2021-10-08T19:21:05.660 INFO:teuthology.orchestra.run.smithi112.stderr:Generating new minimal ceph.conf... 2021-10-08T19:21:05.660 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z -v /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-10-08T19:21:05.717 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:05 smithi112 ceph-mon[30861]: from='client.? 172.21.15.112:0/3793077114' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-10-08T19:21:05.717 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:05 smithi112 ceph-mon[30861]: from='client.? 172.21.15.112:0/3793077114' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-10-08T19:21:06.070 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.065+0000 7fb64123a700 1 Processor -- start 2021-10-08T19:21:06.071 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.065+0000 7fb64123a700 1 -- start start 2021-10-08T19:21:06.071 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.065+0000 7fb64123a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c0fc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:06.071 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.065+0000 7fb64123a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0fcab0 con 0x7fb63c0fc160 2021-10-08T19:21:06.072 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.065+0000 7fb63ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c0fc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:06.072 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.065+0000 7fb63ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c0fc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60946/0 (socket says 172.21.15.112:60946) 2021-10-08T19:21:06.072 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.065+0000 7fb63ad9d700 1 -- 172.21.15.112:0/399248291 learned_addr learned my addr 172.21.15.112:0/399248291 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:06.072 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb63ad9d700 1 -- 172.21.15.112:0/399248291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0fcbf0 con 0x7fb63c0fc160 2021-10-08T19:21:06.073 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb63ad9d700 1 --2- 172.21.15.112:0/399248291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c0fc570 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00b5f0 tx=0x7fb62c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2b6cbc0733feb1 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:06.073 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb63a59c700 1 -- 172.21.15.112:0/399248291 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb62c0106d0 con 0x7fb63c0fc160 2021-10-08T19:21:06.073 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb63a59c700 1 -- 172.21.15.112:0/399248291 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fb62c010c60 con 0x7fb63c0fc160 2021-10-08T19:21:06.074 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb63a59c700 1 -- 172.21.15.112:0/399248291 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb62c011af0 con 0x7fb63c0fc160 2021-10-08T19:21:06.074 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb64123a700 1 -- 172.21.15.112:0/399248291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 msgr2=0x7fb63c0fc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:06.074 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb64123a700 1 --2- 172.21.15.112:0/399248291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c0fc570 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00b5f0 tx=0x7fb62c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:06.074 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb64123a700 1 -- 172.21.15.112:0/399248291 shutdown_connections 2021-10-08T19:21:06.075 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb64123a700 1 --2- 172.21.15.112:0/399248291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c0fc570 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:06.075 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb64123a700 1 -- 172.21.15.112:0/399248291 >> 172.21.15.112:0/399248291 conn(0x7fb63c0f7910 msgr2=0x7fb63c0f9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:06.075 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.066+0000 7fb64123a700 1 -- 172.21.15.112:0/399248291 shutdown_connections 2021-10-08T19:21:06.075 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.067+0000 7fb64123a700 1 -- 172.21.15.112:0/399248291 wait complete. 2021-10-08T19:21:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.067+0000 7fb64123a700 1 Processor -- start 2021-10-08T19:21:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.067+0000 7fb64123a700 1 -- start start 2021-10-08T19:21:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.067+0000 7fb64123a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c10abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.067+0000 7fb64123a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c10b110 con 0x7fb63c0fc160 2021-10-08T19:21:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.067+0000 7fb63ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c10abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:06.077 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.067+0000 7fb63ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c10abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60948/0 (socket says 172.21.15.112:60948) 2021-10-08T19:21:06.077 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.067+0000 7fb63ad9d700 1 -- 172.21.15.112:0/3868189416 learned_addr learned my addr 172.21.15.112:0/3868189416 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:06.077 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb63ad9d700 1 -- 172.21.15.112:0/3868189416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c00b200 con 0x7fb63c0fc160 2021-10-08T19:21:06.077 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb63ad9d700 1 --2- 172.21.15.112:0/3868189416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c10abd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c010 tx=0x7fb62c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:06.078 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb633fff700 1 -- 172.21.15.112:0/3868189416 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb62c01b410 con 0x7fb63c0fc160 2021-10-08T19:21:06.078 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb633fff700 1 -- 172.21.15.112:0/3868189416 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fb62c01b9a0 con 0x7fb63c0fc160 2021-10-08T19:21:06.078 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb633fff700 1 -- 172.21.15.112:0/3868189416 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb62c0236d0 con 0x7fb63c0fc160 2021-10-08T19:21:06.078 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c10b310 con 0x7fb63c0fc160 2021-10-08T19:21:06.079 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c10bfb0 con 0x7fb63c0fc160 2021-10-08T19:21:06.079 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb633fff700 1 -- 172.21.15.112:0/3868189416 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fb62c00f070 con 0x7fb63c0fc160 2021-10-08T19:21:06.079 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.068+0000 7fb633fff700 1 -- 172.21.15.112:0/3868189416 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb62c02d600 con 0x7fb63c0fc160 2021-10-08T19:21:06.079 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.069+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c10b7a0 con 0x7fb63c0fc160 2021-10-08T19:21:06.080 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.071+0000 7fb633fff700 1 -- 172.21.15.112:0/3868189416 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7fb62c01b570 con 0x7fb63c0fc160 2021-10-08T19:21:06.139 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.138+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb63c05a9f0 con 0x7fb63c0fc160 2021-10-08T19:21:06.140 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.138+0000 7fb633fff700 1 -- 172.21.15.112:0/3868189416 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fb62c01b7d0 con 0x7fb63c0fc160 2021-10-08T19:21:06.141 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.139+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 msgr2=0x7fb63c10abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:06.141 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.139+0000 7fb64123a700 1 --2- 172.21.15.112:0/3868189416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c10abd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c010 tx=0x7fb62c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:06.141 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.139+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 shutdown_connections 2021-10-08T19:21:06.142 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.139+0000 7fb64123a700 1 --2- 172.21.15.112:0/3868189416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c0fc160 0x7fb63c10abd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:06.142 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.139+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 >> 172.21.15.112:0/3868189416 conn(0x7fb63c0f7910 msgr2=0x7fb63c0f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:06.142 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.139+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 shutdown_connections 2021-10-08T19:21:06.142 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:06.139+0000 7fb64123a700 1 -- 172.21.15.112:0/3868189416 wait complete. 2021-10-08T19:21:06.785 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:06 smithi112 ceph-mon[30861]: from='client.? 172.21.15.112:0/3868189416' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:06.794 INFO:teuthology.orchestra.run.smithi112.stderr:Restarting the monitor... 2021-10-08T19:21:06.794 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl restart ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a 2021-10-08T19:21:07.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:06 smithi112 systemd[1]: Stopping Ceph mon.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:21:07.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:06 smithi112 bash[31319]: Error: no container with name or ID "ceph-c1559bde-286c-11ec-8c25-001a4aab830c-mon.a" found: no such container 2021-10-08T19:21:07.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:06 smithi112 conmon[30837]: 2021-10-08T19:21:06.943+0000 7f38de1d5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2021-10-08T19:21:07.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:06 smithi112 conmon[30837]: 2021-10-08T19:21:06.943+0000 7f38de1d5700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-10-08T19:21:07.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:07 smithi112 bash[31319]: ceph-c1559bde-286c-11ec-8c25-001a4aab830c-mon-a 2021-10-08T19:21:07.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:07 smithi112 bash[31319]: Error: no container with name or ID "ceph-c1559bde-286c-11ec-8c25-001a4aab830c-mon.a" found: no such container 2021-10-08T19:21:07.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:07 smithi112 systemd[1]: ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.a.service: Succeeded. 2021-10-08T19:21:07.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:07 smithi112 systemd[1]: Stopped Ceph mon.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:21:07.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:07 smithi112 systemd[1]: Starting Ceph mon.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:21:08.136 INFO:teuthology.orchestra.run.smithi112.stderr:Setting mon public_network to 172.21.0.0/20 2021-10-08T19:21:08.136 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mon public_network 172.21.0.0/20 2021-10-08T19:21:08.310 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: set uid:gid to 167:167 (ceph:ceph) 2021-10-08T19:21:08.311 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev), process ceph-mon, pid 7 2021-10-08T19:21:08.311 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: pidfile_write: ignore empty --pid-file 2021-10-08T19:21:08.311 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: load: jerasure load: lrc 2021-10-08T19:21:08.311 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: RocksDB version: 6.15.5 2021-10-08T19:21:08.312 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-10-08T19:21:08.312 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Compile date Oct 7 2021 2021-10-08T19:21:08.312 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: DB SUMMARY 2021-10-08T19:21:08.312 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: DB Session ID: JZP0T6YU5GE5308XN1WY 2021-10-08T19:21:08.313 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: CURRENT file: CURRENT 2021-10-08T19:21:08.313 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: IDENTITY file: IDENTITY 2021-10-08T19:21:08.313 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2021-10-08T19:21:08.313 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2021-10-08T19:21:08.313 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 84507 ; 2021-10-08T19:21:08.314 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.error_if_exists: 0 2021-10-08T19:21:08.314 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.create_if_missing: 0 2021-10-08T19:21:08.314 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.paranoid_checks: 1 2021-10-08T19:21:08.314 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-10-08T19:21:08.315 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.env: 0x55ad56549b60 2021-10-08T19:21:08.315 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.fs: Posix File System 2021-10-08T19:21:08.315 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.info_log: 0x55ad57be4120 2021-10-08T19:21:08.315 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_file_opening_threads: 16 2021-10-08T19:21:08.315 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.statistics: (nil) 2021-10-08T19:21:08.316 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.use_fsync: 0 2021-10-08T19:21:08.316 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_log_file_size: 0 2021-10-08T19:21:08.316 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-10-08T19:21:08.316 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.log_file_time_to_roll: 0 2021-10-08T19:21:08.317 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.keep_log_file_num: 1000 2021-10-08T19:21:08.317 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.recycle_log_file_num: 0 2021-10-08T19:21:08.317 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.allow_fallocate: 1 2021-10-08T19:21:08.317 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.allow_mmap_reads: 0 2021-10-08T19:21:08.317 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.allow_mmap_writes: 0 2021-10-08T19:21:08.318 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.use_direct_reads: 0 2021-10-08T19:21:08.318 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-10-08T19:21:08.318 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.create_missing_column_families: 0 2021-10-08T19:21:08.318 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.db_log_dir: 2021-10-08T19:21:08.319 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-10-08T19:21:08.319 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.table_cache_numshardbits: 6 2021-10-08T19:21:08.319 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.WAL_ttl_seconds: 0 2021-10-08T19:21:08.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.WAL_size_limit_MB: 0 2021-10-08T19:21:08.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-10-08T19:21:08.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-10-08T19:21:08.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.is_fd_close_on_exec: 1 2021-10-08T19:21:08.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.advise_random_on_open: 1 2021-10-08T19:21:08.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.db_write_buffer_size: 0 2021-10-08T19:21:08.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.write_buffer_manager: 0x55ad57c59dd0 2021-10-08T19:21:08.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-10-08T19:21:08.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-10-08T19:21:08.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-10-08T19:21:08.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.use_adaptive_mutex: 0 2021-10-08T19:21:08.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.rate_limiter: (nil) 2021-10-08T19:21:08.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-10-08T19:21:08.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.wal_recovery_mode: 2 2021-10-08T19:21:08.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.enable_thread_tracking: 0 2021-10-08T19:21:08.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.enable_pipelined_write: 0 2021-10-08T19:21:08.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.unordered_write: 0 2021-10-08T19:21:08.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-10-08T19:21:08.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-10-08T19:21:08.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-10-08T19:21:08.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-10-08T19:21:08.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.row_cache: None 2021-10-08T19:21:08.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.wal_filter: None 2021-10-08T19:21:08.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-10-08T19:21:08.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.allow_ingest_behind: 0 2021-10-08T19:21:08.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.preserve_deletes: 0 2021-10-08T19:21:08.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.two_write_queues: 0 2021-10-08T19:21:08.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.manual_wal_flush: 0 2021-10-08T19:21:08.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.atomic_flush: 0 2021-10-08T19:21:08.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-10-08T19:21:08.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.persist_stats_to_disk: 0 2021-10-08T19:21:08.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.write_dbid_to_manifest: 0 2021-10-08T19:21:08.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.log_readahead_size: 0 2021-10-08T19:21:08.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-10-08T19:21:08.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.best_efforts_recovery: 0 2021-10-08T19:21:08.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-10-08T19:21:08.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-10-08T19:21:08.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.allow_data_in_errors: 0 2021-10-08T19:21:08.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.db_host_id: __hostname__ 2021-10-08T19:21:08.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_background_jobs: 2 2021-10-08T19:21:08.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_background_compactions: -1 2021-10-08T19:21:08.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_subcompactions: 1 2021-10-08T19:21:08.335 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-10-08T19:21:08.335 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-10-08T19:21:08.335 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.delayed_write_rate : 16777216 2021-10-08T19:21:08.335 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_total_wal_size: 0 2021-10-08T19:21:08.336 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-10-08T19:21:08.336 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.stats_dump_period_sec: 600 2021-10-08T19:21:08.336 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.stats_persist_period_sec: 600 2021-10-08T19:21:08.336 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-10-08T19:21:08.336 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_open_files: -1 2021-10-08T19:21:08.337 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bytes_per_sync: 0 2021-10-08T19:21:08.337 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.wal_bytes_per_sync: 0 2021-10-08T19:21:08.337 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.strict_bytes_per_sync: 0 2021-10-08T19:21:08.337 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_readahead_size: 0 2021-10-08T19:21:08.338 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_background_flushes: -1 2021-10-08T19:21:08.338 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Compression algorithms supported: 2021-10-08T19:21:08.338 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-10-08T19:21:08.338 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: kZSTD supported: 0 2021-10-08T19:21:08.338 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: kXpressCompression supported: 0 2021-10-08T19:21:08.339 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: kLZ4HCCompression supported: 1 2021-10-08T19:21:08.339 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: kLZ4Compression supported: 1 2021-10-08T19:21:08.339 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: kBZip2Compression supported: 0 2021-10-08T19:21:08.339 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: kZlibCompression supported: 1 2021-10-08T19:21:08.340 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: kSnappyCompression supported: 1 2021-10-08T19:21:08.340 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Fast CRC32 supported: Supported on x86 2021-10-08T19:21:08.340 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2021-10-08T19:21:08.340 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-10-08T19:21:08.340 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-10-08T19:21:08.341 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.merge_operator: 2021-10-08T19:21:08.341 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_filter: None 2021-10-08T19:21:08.341 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_filter_factory: None 2021-10-08T19:21:08.341 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.sst_partitioner_factory: None 2021-10-08T19:21:08.342 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.memtable_factory: SkipListFactory 2021-10-08T19:21:08.342 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.table_factory: BlockBasedTable 2021-10-08T19:21:08.342 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ad57badb80) 2021-10-08T19:21:08.342 INFO:journalctl@ceph.mon.a.smithi112.stdout: cache_index_and_filter_blocks: 1 2021-10-08T19:21:08.342 INFO:journalctl@ceph.mon.a.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-10-08T19:21:08.343 INFO:journalctl@ceph.mon.a.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-10-08T19:21:08.343 INFO:journalctl@ceph.mon.a.smithi112.stdout: pin_top_level_index_and_filter: 1 2021-10-08T19:21:08.343 INFO:journalctl@ceph.mon.a.smithi112.stdout: index_type: 0 2021-10-08T19:21:08.344 INFO:journalctl@ceph.mon.a.smithi112.stdout: data_block_index_type: 0 2021-10-08T19:21:08.345 INFO:journalctl@ceph.mon.a.smithi112.stdout: index_shortening: 1 2021-10-08T19:21:08.345 INFO:journalctl@ceph.mon.a.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2021-10-08T19:21:08.345 INFO:journalctl@ceph.mon.a.smithi112.stdout: hash_index_allow_collision: 1 2021-10-08T19:21:08.345 INFO:journalctl@ceph.mon.a.smithi112.stdout: checksum: 1 2021-10-08T19:21:08.345 INFO:journalctl@ceph.mon.a.smithi112.stdout: no_block_cache: 0 2021-10-08T19:21:08.346 INFO:journalctl@ceph.mon.a.smithi112.stdout: block_cache: 0x55ad57be2d10 2021-10-08T19:21:08.346 INFO:journalctl@ceph.mon.a.smithi112.stdout: block_cache_name: BinnedLRUCache 2021-10-08T19:21:08.346 INFO:journalctl@ceph.mon.a.smithi112.stdout: block_cache_options: 2021-10-08T19:21:08.346 INFO:journalctl@ceph.mon.a.smithi112.stdout: capacity : 536870912 2021-10-08T19:21:08.347 INFO:journalctl@ceph.mon.a.smithi112.stdout: num_shard_bits : 4 2021-10-08T19:21:08.347 INFO:journalctl@ceph.mon.a.smithi112.stdout: strict_capacity_limit : 0 2021-10-08T19:21:08.347 INFO:journalctl@ceph.mon.a.smithi112.stdout: high_pri_pool_ratio: 0.000 2021-10-08T19:21:08.347 INFO:journalctl@ceph.mon.a.smithi112.stdout: block_cache_compressed: (nil) 2021-10-08T19:21:08.347 INFO:journalctl@ceph.mon.a.smithi112.stdout: persistent_cache: (nil) 2021-10-08T19:21:08.348 INFO:journalctl@ceph.mon.a.smithi112.stdout: block_size: 4096 2021-10-08T19:21:08.348 INFO:journalctl@ceph.mon.a.smithi112.stdout: block_size_deviation: 10 2021-10-08T19:21:08.348 INFO:journalctl@ceph.mon.a.smithi112.stdout: block_restart_interval: 16 2021-10-08T19:21:08.348 INFO:journalctl@ceph.mon.a.smithi112.stdout: index_block_restart_interval: 1 2021-10-08T19:21:08.349 INFO:journalctl@ceph.mon.a.smithi112.stdout: metadata_block_size: 4096 2021-10-08T19:21:08.349 INFO:journalctl@ceph.mon.a.smithi112.stdout: partition_filters: 0 2021-10-08T19:21:08.349 INFO:journalctl@ceph.mon.a.smithi112.stdout: use_delta_encoding: 1 2021-10-08T19:21:08.349 INFO:journalctl@ceph.mon.a.smithi112.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-10-08T19:21:08.349 INFO:journalctl@ceph.mon.a.smithi112.stdout: whole_key_filtering: 1 2021-10-08T19:21:08.350 INFO:journalctl@ceph.mon.a.smithi112.stdout: verify_compression: 0 2021-10-08T19:21:08.350 INFO:journalctl@ceph.mon.a.smithi112.stdout: read_amp_bytes_per_bit: 0 2021-10-08T19:21:08.350 INFO:journalctl@ceph.mon.a.smithi112.stdout: format_version: 4 2021-10-08T19:21:08.350 INFO:journalctl@ceph.mon.a.smithi112.stdout: enable_index_compression: 1 2021-10-08T19:21:08.351 INFO:journalctl@ceph.mon.a.smithi112.stdout: block_align: 0 2021-10-08T19:21:08.351 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.write_buffer_size: 33554432 2021-10-08T19:21:08.351 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_write_buffer_number: 2 2021-10-08T19:21:08.351 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compression: NoCompression 2021-10-08T19:21:08.351 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bottommost_compression: Disabled 2021-10-08T19:21:08.352 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.prefix_extractor: nullptr 2021-10-08T19:21:08.352 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-10-08T19:21:08.352 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.num_levels: 7 2021-10-08T19:21:08.352 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-10-08T19:21:08.352 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-10-08T19:21:08.353 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-10-08T19:21:08.353 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-10-08T19:21:08.353 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-10-08T19:21:08.353 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-10-08T19:21:08.354 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-10-08T19:21:08.354 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:21:08.354 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-10-08T19:21:08.354 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-10-08T19:21:08.354 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compression_opts.window_bits: -14 2021-10-08T19:21:08.355 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compression_opts.level: 32767 2021-10-08T19:21:08.355 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compression_opts.strategy: 0 2021-10-08T19:21:08.355 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-10-08T19:21:08.355 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:21:08.356 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-10-08T19:21:08.356 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compression_opts.enabled: false 2021-10-08T19:21:08.356 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-10-08T19:21:08.356 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-10-08T19:21:08.356 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-10-08T19:21:08.357 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.target_file_size_base: 67108864 2021-10-08T19:21:08.357 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.target_file_size_multiplier: 1 2021-10-08T19:21:08.357 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-10-08T19:21:08.357 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-10-08T19:21:08.357 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-10-08T19:21:08.358 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-10-08T19:21:08.358 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-10-08T19:21:08.358 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-10-08T19:21:08.358 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-10-08T19:21:08.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-10-08T19:21:08.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-10-08T19:21:08.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-10-08T19:21:08.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-10-08T19:21:08.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-10-08T19:21:08.360 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.arena_block_size: 4194304 2021-10-08T19:21:08.360 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-10-08T19:21:08.360 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-10-08T19:21:08.360 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-10-08T19:21:08.360 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.disable_auto_compactions: 0 2021-10-08T19:21:08.361 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-10-08T19:21:08.361 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-10-08T19:21:08.361 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-10-08T19:21:08.361 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-10-08T19:21:08.362 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-10-08T19:21:08.362 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-10-08T19:21:08.362 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-10-08T19:21:08.362 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-10-08T19:21:08.362 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-10-08T19:21:08.363 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-10-08T19:21:08.363 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.table_properties_collectors: 2021-10-08T19:21:08.363 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.inplace_update_support: 0 2021-10-08T19:21:08.363 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.inplace_update_num_locks: 10000 2021-10-08T19:21:08.364 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-10-08T19:21:08.364 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-10-08T19:21:08.364 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.memtable_huge_page_size: 0 2021-10-08T19:21:08.364 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.bloom_locality: 0 2021-10-08T19:21:08.364 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.max_successive_merges: 0 2021-10-08T19:21:08.365 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.optimize_filters_for_hits: 0 2021-10-08T19:21:08.365 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.paranoid_file_checks: 0 2021-10-08T19:21:08.365 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.force_consistency_checks: 1 2021-10-08T19:21:08.365 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.report_bg_io_stats: 0 2021-10-08T19:21:08.365 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.ttl: 2592000 2021-10-08T19:21:08.366 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.periodic_compaction_seconds: 0 2021-10-08T19:21:08.366 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.enable_blob_files: false 2021-10-08T19:21:08.366 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.min_blob_size: 0 2021-10-08T19:21:08.366 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.blob_file_size: 268435456 2021-10-08T19:21:08.367 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.blob_compression_type: NoCompression 2021-10-08T19:21:08.367 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.enable_blob_garbage_collection: false 2021-10-08T19:21:08.367 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-10-08T19:21:08.367 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-10-08T19:21:08.369 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2021-10-08T19:21:08.369 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2021-10-08T19:21:08.369 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720868111416, "job": 1, "event": "recovery_started", "wal_files": [10]} 2021-10-08T19:21:08.370 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2021-10-08T19:21:08.370 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-10-08T19:21:08.370 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720868112076, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 80929, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 79192, "index_size": 225, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10415, "raw_average_key_size": 47, "raw_value_size": 73275, "raw_average_value_size": 336, "num_data_blocks": 10, "num_entries": 218, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720868, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "f2b060d0-2d5c-4207-9656-992e0e23b312", "db_session_id": "JZP0T6YU5GE5308XN1WY"}} 2021-10-08T19:21:08.371 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2021-10-08T19:21:08.371 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720868112913, "job": 1, "event": "recovery_finished"} 2021-10-08T19:21:08.371 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-10-08T19:21:08.372 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55ad57bfea80 2021-10-08T19:21:08.372 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: DB pointer 0x55ad57c0e000 2021-10-08T19:21:08.372 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-10-08T19:21:08.373 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-10-08T19:21:08.373 INFO:journalctl@ceph.mon.a.smithi112.stdout: ** DB Stats ** 2021-10-08T19:21:08.374 INFO:journalctl@ceph.mon.a.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:21:08.374 INFO:journalctl@ceph.mon.a.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-10-08T19:21:08.375 INFO:journalctl@ceph.mon.a.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-10-08T19:21:08.375 INFO:journalctl@ceph.mon.a.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:21:08.376 INFO:journalctl@ceph.mon.a.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-10-08T19:21:08.376 INFO:journalctl@ceph.mon.a.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-10-08T19:21:08.376 INFO:journalctl@ceph.mon.a.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:21:08.377 INFO:journalctl@ceph.mon.a.smithi112.stdout: 2021-10-08T19:21:08.377 INFO:journalctl@ceph.mon.a.smithi112.stdout: ** Compaction Stats [default] ** 2021-10-08T19:21:08.377 INFO:journalctl@ceph.mon.a.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:21:08.378 INFO:journalctl@ceph.mon.a.smithi112.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:21:08.378 INFO:journalctl@ceph.mon.a.smithi112.stdout: L0 2/0 80.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 175.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:21:08.378 INFO:journalctl@ceph.mon.a.smithi112.stdout: Sum 2/0 80.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 175.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:21:08.379 INFO:journalctl@ceph.mon.a.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 175.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:21:08.379 INFO:journalctl@ceph.mon.a.smithi112.stdout: 2021-10-08T19:21:08.379 INFO:journalctl@ceph.mon.a.smithi112.stdout: ** Compaction Stats [default] ** 2021-10-08T19:21:08.380 INFO:journalctl@ceph.mon.a.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:21:08.380 INFO:journalctl@ceph.mon.a.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:21:08.381 INFO:journalctl@ceph.mon.a.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 175.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:21:08.381 INFO:journalctl@ceph.mon.a.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:21:08.381 INFO:journalctl@ceph.mon.a.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:21:08.381 INFO:journalctl@ceph.mon.a.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:21:08.382 INFO:journalctl@ceph.mon.a.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:21:08.382 INFO:journalctl@ceph.mon.a.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:21:08.382 INFO:journalctl@ceph.mon.a.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:21:08.382 INFO:journalctl@ceph.mon.a.smithi112.stdout: Cumulative compaction: 0.00 GB write, 23.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:21:08.383 INFO:journalctl@ceph.mon.a.smithi112.stdout: Interval compaction: 0.00 GB write, 23.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:21:08.383 INFO:journalctl@ceph.mon.a.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:21:08.383 INFO:journalctl@ceph.mon.a.smithi112.stdout: 2021-10-08T19:21:08.383 INFO:journalctl@ceph.mon.a.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:21:08.384 INFO:journalctl@ceph.mon.a.smithi112.stdout: 2021-10-08T19:21:08.384 INFO:journalctl@ceph.mon.a.smithi112.stdout: ** Compaction Stats [default] ** 2021-10-08T19:21:08.384 INFO:journalctl@ceph.mon.a.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:21:08.384 INFO:journalctl@ceph.mon.a.smithi112.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:21:08.384 INFO:journalctl@ceph.mon.a.smithi112.stdout: L0 2/0 80.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 175.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:21:08.385 INFO:journalctl@ceph.mon.a.smithi112.stdout: Sum 2/0 80.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 175.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:21:08.385 INFO:journalctl@ceph.mon.a.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-10-08T19:21:08.385 INFO:journalctl@ceph.mon.a.smithi112.stdout: 2021-10-08T19:21:08.386 INFO:journalctl@ceph.mon.a.smithi112.stdout: ** Compaction Stats [default] ** 2021-10-08T19:21:08.386 INFO:journalctl@ceph.mon.a.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:21:08.386 INFO:journalctl@ceph.mon.a.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:21:08.386 INFO:journalctl@ceph.mon.a.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 175.0 0.00 0.00 1 0.000 0 0 2021-10-08T19:21:08.387 INFO:journalctl@ceph.mon.a.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:21:08.387 INFO:journalctl@ceph.mon.a.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:21:08.387 INFO:journalctl@ceph.mon.a.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:21:08.387 INFO:journalctl@ceph.mon.a.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:21:08.388 INFO:journalctl@ceph.mon.a.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:21:08.388 INFO:journalctl@ceph.mon.a.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:21:08.388 INFO:journalctl@ceph.mon.a.smithi112.stdout: Cumulative compaction: 0.00 GB write, 23.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:21:08.388 INFO:journalctl@ceph.mon.a.smithi112.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:21:08.388 INFO:journalctl@ceph.mon.a.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:21:08.389 INFO:journalctl@ceph.mon.a.smithi112.stdout: 2021-10-08T19:21:08.389 INFO:journalctl@ceph.mon.a.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:21:08.389 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: starting mon.a rank 0 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:08.389 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a@-1(???) e1 preinit fsid c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:08.390 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a@-1(???).mds e1 new map 2021-10-08T19:21:08.390 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a@-1(???).mds e1 print_map 2021-10-08T19:21:08.390 INFO:journalctl@ceph.mon.a.smithi112.stdout: e1 2021-10-08T19:21:08.390 INFO:journalctl@ceph.mon.a.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:21:08.390 INFO:journalctl@ceph.mon.a.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:21:08.391 INFO:journalctl@ceph.mon.a.smithi112.stdout: legacy client fscid: -1 2021-10-08T19:21:08.391 INFO:journalctl@ceph.mon.a.smithi112.stdout: 2021-10-08T19:21:08.391 INFO:journalctl@ceph.mon.a.smithi112.stdout: No filesystems configured 2021-10-08T19:21:08.391 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:21:08.392 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:21:08.392 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:21:08.392 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:21:08.392 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-10-08T19:21:08.392 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 bash[31486]: 408633b91ca1b86e1faf90b0c84532db51b9258a21541fe41f180a52b9ea1264 2021-10-08T19:21:08.393 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 systemd[1]: Started Ceph mon.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:21:08.393 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mon.a is new leader, mons a in quorum (ranks 0) 2021-10-08T19:21:08.393 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: monmap e1: 1 mons at {a=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} 2021-10-08T19:21:08.393 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: fsmap 2021-10-08T19:21:08.394 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: osdmap e1: 0 total, 0 up, 0 in 2021-10-08T19:21:08.394 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:08 smithi112 ceph-mon[31694]: mgrmap e1: no daemons active 2021-10-08T19:21:08.577 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.571+0000 7fba3a63d700 1 Processor -- start 2021-10-08T19:21:08.577 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.572+0000 7fba3a63d700 1 -- start start 2021-10-08T19:21:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.572+0000 7fba3a63d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba340fc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.572+0000 7fba3a63d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba340fc910 con 0x7fba340fbfc0 2021-10-08T19:21:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.572+0000 7fba3963b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba340fc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.572+0000 7fba3963b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba340fc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60950/0 (socket says 172.21.15.112:60950) 2021-10-08T19:21:08.579 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.572+0000 7fba3963b700 1 -- 172.21.15.112:0/488076113 learned_addr learned my addr 172.21.15.112:0/488076113 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:08.579 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.573+0000 7fba3963b700 1 -- 172.21.15.112:0/488076113 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340fca50 con 0x7fba340fbfc0 2021-10-08T19:21:08.579 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.573+0000 7fba3963b700 1 --2- 172.21.15.112:0/488076113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba340fc3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fba3000b5f0 tx=0x7fba30006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0d6504e2932c02 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:08.579 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.573+0000 7fba23fff700 1 -- 172.21.15.112:0/488076113 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba300106d0 con 0x7fba340fbfc0 2021-10-08T19:21:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.573+0000 7fba23fff700 1 -- 172.21.15.112:0/488076113 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fba30010c60 con 0x7fba340fbfc0 2021-10-08T19:21:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.573+0000 7fba23fff700 1 -- 172.21.15.112:0/488076113 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba30011af0 con 0x7fba340fbfc0 2021-10-08T19:21:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 -- 172.21.15.112:0/488076113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 msgr2=0x7fba340fc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 --2- 172.21.15.112:0/488076113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba340fc3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fba3000b5f0 tx=0x7fba30006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 -- 172.21.15.112:0/488076113 shutdown_connections 2021-10-08T19:21:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 --2- 172.21.15.112:0/488076113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba340fc3d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 -- 172.21.15.112:0/488076113 >> 172.21.15.112:0/488076113 conn(0x7fba340f7790 msgr2=0x7fba340f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 -- 172.21.15.112:0/488076113 shutdown_connections 2021-10-08T19:21:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 -- 172.21.15.112:0/488076113 wait complete. 2021-10-08T19:21:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 Processor -- start 2021-10-08T19:21:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 -- start start 2021-10-08T19:21:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba3410aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.574+0000 7fba3a63d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3410af90 con 0x7fba340fbfc0 2021-10-08T19:21:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba3963b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba3410aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba3963b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba3410aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60952/0 (socket says 172.21.15.112:60952) 2021-10-08T19:21:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba3963b700 1 -- 172.21.15.112:0/1854016533 learned_addr learned my addr 172.21.15.112:0/1854016533 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba3963b700 1 -- 172.21.15.112:0/1854016533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3000b200 con 0x7fba340fbfc0 2021-10-08T19:21:08.584 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba3963b700 1 --2- 172.21.15.112:0/1854016533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba3410aa50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c010 tx=0x7fba30006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:08.584 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba21ffb700 1 -- 172.21.15.112:0/1854016533 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba3001b410 con 0x7fba340fbfc0 2021-10-08T19:21:08.584 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba21ffb700 1 -- 172.21.15.112:0/1854016533 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fba3001b9a0 con 0x7fba340fbfc0 2021-10-08T19:21:08.584 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba21ffb700 1 -- 172.21.15.112:0/1854016533 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba300236d0 con 0x7fba340fbfc0 2021-10-08T19:21:08.585 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3410b190 con 0x7fba340fbfc0 2021-10-08T19:21:08.585 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.575+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3410be30 con 0x7fba340fbfc0 2021-10-08T19:21:08.585 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.576+0000 7fba21ffb700 1 -- 172.21.15.112:0/1854016533 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fba3000f070 con 0x7fba340fbfc0 2021-10-08T19:21:08.585 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.576+0000 7fba21ffb700 1 -- 172.21.15.112:0/1854016533 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fba3002d600 con 0x7fba340fbfc0 2021-10-08T19:21:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.576+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3410b620 con 0x7fba340fbfc0 2021-10-08T19:21:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.578+0000 7fba21ffb700 1 -- 172.21.15.112:0/1854016533 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7fba3001b570 con 0x7fba340fbfc0 2021-10-08T19:21:08.645 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.644+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fba340fde40 con 0x7fba340fbfc0 2021-10-08T19:21:08.650 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.649+0000 7fba21ffb700 1 -- 172.21.15.112:0/1854016533 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fba3001b710 con 0x7fba340fbfc0 2021-10-08T19:21:08.651 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.650+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 msgr2=0x7fba3410aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:08.652 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.650+0000 7fba3a63d700 1 --2- 172.21.15.112:0/1854016533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba3410aa50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c010 tx=0x7fba30006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:08.652 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.650+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 shutdown_connections 2021-10-08T19:21:08.652 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.650+0000 7fba3a63d700 1 --2- 172.21.15.112:0/1854016533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba340fbfc0 0x7fba3410aa50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:08.652 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.650+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 >> 172.21.15.112:0/1854016533 conn(0x7fba340f7790 msgr2=0x7fba340f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:08.653 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.650+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 shutdown_connections 2021-10-08T19:21:08.653 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:08.650+0000 7fba3a63d700 1 -- 172.21.15.112:0/1854016533 wait complete. 2021-10-08T19:21:09.274 INFO:teuthology.orchestra.run.smithi112.stderr:Wrote config to /etc/ceph/ceph.conf 2021-10-08T19:21:09.274 INFO:teuthology.orchestra.run.smithi112.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:09.275 INFO:teuthology.orchestra.run.smithi112.stderr:Creating mgr... 2021-10-08T19:21:09.275 INFO:teuthology.orchestra.run.smithi112.stderr:Verifying port 9283 ... 2021-10-08T19:21:09.276 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl daemon-reload 2021-10-08T19:21:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl stop ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:21:09.389 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl reset-failed ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:21:09.395 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Failed to reset failed state of unit ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.y.service: Unit ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.y.service not loaded. 2021-10-08T19:21:09.395 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl enable ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:21:09.401 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: Created symlink /etc/systemd/system/ceph-c1559bde-286c-11ec-8c25-001a4aab830c.target.wants/ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.y.service → /etc/systemd/system/ceph-c1559bde-286c-11ec-8c25-001a4aab830c@.service. 2021-10-08T19:21:09.483 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl start ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.y 2021-10-08T19:21:09.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:09 smithi112 systemd[1]: Starting Ceph mgr.y for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:21:09.953 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1854016533' entity='client.admin' 2021-10-08T19:21:10.097 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:21:10.107 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: disabled 2021-10-08T19:21:10.107 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:21:10.114 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: inactive 2021-10-08T19:21:10.115 INFO:teuthology.orchestra.run.smithi112.stderr:firewalld.service is not enabled 2021-10-08T19:21:10.115 INFO:teuthology.orchestra.run.smithi112.stderr:Not possible to enable service . firewalld.service is not available 2021-10-08T19:21:10.116 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:21:10.123 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: disabled 2021-10-08T19:21:10.123 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:21:10.131 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: inactive 2021-10-08T19:21:10.132 INFO:teuthology.orchestra.run.smithi112.stderr:firewalld.service is not enabled 2021-10-08T19:21:10.132 INFO:teuthology.orchestra.run.smithi112.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-10-08T19:21:10.133 INFO:teuthology.orchestra.run.smithi112.stderr:Waiting for mgr to start... 2021-10-08T19:21:10.133 INFO:teuthology.orchestra.run.smithi112.stderr:Waiting for mgr... 2021-10-08T19:21:10.133 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:21:10.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:10 smithi112 bash[31921]: fd27f868ac0dc65fa6137f0af451ecdd1c7257c7f5f64ded33f85bf10ff6db98 2021-10-08T19:21:10.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:10 smithi112 systemd[1]: Started Ceph mgr.y for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:21:10.643 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.636+0000 7ff99651a700 1 Processor -- start 2021-10-08T19:21:10.643 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.636+0000 7ff99651a700 1 -- start start 2021-10-08T19:21:10.643 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.636+0000 7ff99651a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff990101240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:10.644 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.637+0000 7ff99651a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900fcc30 con 0x7ff9900703d0 2021-10-08T19:21:10.644 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.637+0000 7ff98ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff990101240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:10.644 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.637+0000 7ff98ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff990101240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60958/0 (socket says 172.21.15.112:60958) 2021-10-08T19:21:10.644 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.637+0000 7ff98ffff700 1 -- 172.21.15.112:0/3883620485 learned_addr learned my addr 172.21.15.112:0/3883620485 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:10.645 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.637+0000 7ff98ffff700 1 -- 172.21.15.112:0/3883620485 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff990101780 con 0x7ff9900703d0 2021-10-08T19:21:10.645 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.637+0000 7ff98ffff700 1 --2- 172.21.15.112:0/3883620485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff990101240 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff97800b5f0 tx=0x7ff978006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15af27fee64ae2d server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:10.645 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.637+0000 7ff98effd700 1 -- 172.21.15.112:0/3883620485 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9780106d0 con 0x7ff9900703d0 2021-10-08T19:21:10.645 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.637+0000 7ff98effd700 1 -- 172.21.15.112:0/3883620485 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7ff978010c60 con 0x7ff9900703d0 2021-10-08T19:21:10.646 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.638+0000 7ff98effd700 1 -- 172.21.15.112:0/3883620485 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff978011af0 con 0x7ff9900703d0 2021-10-08T19:21:10.646 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.638+0000 7ff99651a700 1 -- 172.21.15.112:0/3883620485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 msgr2=0x7ff990101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:10.646 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.638+0000 7ff99651a700 1 --2- 172.21.15.112:0/3883620485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff990101240 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff97800b5f0 tx=0x7ff978006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:10.646 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.638+0000 7ff99651a700 1 -- 172.21.15.112:0/3883620485 shutdown_connections 2021-10-08T19:21:10.647 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.638+0000 7ff99651a700 1 --2- 172.21.15.112:0/3883620485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff990101240 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:10.647 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.638+0000 7ff99651a700 1 -- 172.21.15.112:0/3883620485 >> 172.21.15.112:0/3883620485 conn(0x7ff9900f6850 msgr2=0x7ff9900f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:10.647 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.638+0000 7ff99651a700 1 -- 172.21.15.112:0/3883620485 shutdown_connections 2021-10-08T19:21:10.648 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.638+0000 7ff99651a700 1 -- 172.21.15.112:0/3883620485 wait complete. 2021-10-08T19:21:10.648 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.639+0000 7ff99651a700 1 Processor -- start 2021-10-08T19:21:10.648 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.639+0000 7ff99651a700 1 -- start start 2021-10-08T19:21:10.649 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.639+0000 7ff99651a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff99010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:10.649 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.639+0000 7ff99651a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99010d410 con 0x7ff9900703d0 2021-10-08T19:21:10.650 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.639+0000 7ff98ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff99010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:10.650 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.639+0000 7ff98ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff99010ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60960/0 (socket says 172.21.15.112:60960) 2021-10-08T19:21:10.650 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.639+0000 7ff98ffff700 1 -- 172.21.15.112:0/731101284 learned_addr learned my addr 172.21.15.112:0/731101284 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:10.650 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.639+0000 7ff98ffff700 1 -- 172.21.15.112:0/731101284 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97800b200 con 0x7ff9900703d0 2021-10-08T19:21:10.650 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.640+0000 7ff98ffff700 1 --2- 172.21.15.112:0/731101284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff99010ced0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff97800c010 tx=0x7ff978006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:10.651 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.640+0000 7ff98cff9700 1 -- 172.21.15.112:0/731101284 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff97801b410 con 0x7ff9900703d0 2021-10-08T19:21:10.651 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.640+0000 7ff98cff9700 1 -- 172.21.15.112:0/731101284 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7ff97801b9a0 con 0x7ff9900703d0 2021-10-08T19:21:10.651 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.640+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99010d610 con 0x7ff9900703d0 2021-10-08T19:21:10.651 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.640+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99010e170 con 0x7ff9900703d0 2021-10-08T19:21:10.652 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.640+0000 7ff98cff9700 1 -- 172.21.15.112:0/731101284 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9780236b0 con 0x7ff9900703d0 2021-10-08T19:21:10.652 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.640+0000 7ff98cff9700 1 -- 172.21.15.112:0/731101284 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7ff97800f070 con 0x7ff9900703d0 2021-10-08T19:21:10.652 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.640+0000 7ff98cff9700 1 -- 172.21.15.112:0/731101284 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff97802d650 con 0x7ff9900703d0 2021-10-08T19:21:10.652 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.641+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff974004de0 con 0x7ff9900703d0 2021-10-08T19:21:10.653 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.643+0000 7ff98cff9700 1 -- 172.21.15.112:0/731101284 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7ff97801bb10 con 0x7ff9900703d0 2021-10-08T19:21:10.724 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.714+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff974005360 con 0x7ff9900703d0 2021-10-08T19:21:10.724 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.714+0000 7ff98cff9700 1 -- 172.21.15.112:0/731101284 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1250 (secure 0 0 0) 0x7ff97801bcf0 con 0x7ff9900703d0 2021-10-08T19:21:10.725 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.725 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: { 2021-10-08T19:21:10.725 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "fsid": "c1559bde-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:21:10.726 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:21:10.726 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:21:10.726 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:21:10.726 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:21:10.727 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:10.727 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:21:10.727 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:21:10.727 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 0 2021-10-08T19:21:10.728 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:10.728 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:21:10.728 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "a" 2021-10-08T19:21:10.728 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:10.729 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum_age": -1697382628, 2021-10-08T19:21:10.729 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:21:10.729 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:10.729 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:21:10.730 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:21:10.730 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:10.731 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:21:10.731 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:10.732 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:21:10.732 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:21:10.732 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:21:10.733 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:21:10.733 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:21:10.733 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:21:10.733 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:10.734 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:21:10.734 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:21:10.734 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:21:10.735 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:21:10.735 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:21:10.735 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:21:10.736 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:21:10.736 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:21:10.736 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:21:10.736 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:10.737 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:21:10.737 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:10.737 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:21:10.738 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:21:10.738 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:10.738 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:21:10.738 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "available": false, 2021-10-08T19:21:10.739 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:21:10.739 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:21:10.739 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:21:10.739 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:21:10.739 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:21:10.740 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:10.740 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:21:10.740 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:10.740 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:21:10.741 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:10.741 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:21:03.408765+0000", 2021-10-08T19:21:10.741 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:21:10.741 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:10.742 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:21:10.742 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: } 2021-10-08T19:21:10.742 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.715+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 msgr2=0x7ff99010ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:10.742 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.715+0000 7ff99651a700 1 --2- 172.21.15.112:0/731101284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff99010ced0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff97800c010 tx=0x7ff978006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:10.743 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.715+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 shutdown_connections 2021-10-08T19:21:10.743 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.715+0000 7ff99651a700 1 --2- 172.21.15.112:0/731101284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9900703d0 0x7ff99010ced0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:10.743 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.715+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 >> 172.21.15.112:0/731101284 conn(0x7ff9900f6850 msgr2=0x7ff9900f75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:10.743 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.715+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 shutdown_connections 2021-10-08T19:21:10.743 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:10.716+0000 7ff99651a700 1 -- 172.21.15.112:0/731101284 wait complete. 2021-10-08T19:21:11.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/731101284' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:21:11.371 INFO:teuthology.orchestra.run.smithi112.stderr:mgr not available, waiting (1/15)... 2021-10-08T19:21:13.374 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:21:13.872 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.870+0000 7f1996be7700 1 Processor -- start 2021-10-08T19:21:13.872 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.870+0000 7f1996be7700 1 -- start start 2021-10-08T19:21:13.872 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.870+0000 7f1996be7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.870+0000 7f1996be7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19900ff340 con 0x7f1990070410 2021-10-08T19:21:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.870+0000 7f1994983700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.870+0000 7f1994983700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60962/0 (socket says 172.21.15.112:60962) 2021-10-08T19:21:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.870+0000 7f1994983700 1 -- 172.21.15.112:0/469419882 learned_addr learned my addr 172.21.15.112:0/469419882 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:13.873 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.871+0000 7f1994983700 1 -- 172.21.15.112:0/469419882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900ff480 con 0x7f1990070410 2021-10-08T19:21:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.871+0000 7f1994983700 1 --2- 172.21.15.112:0/469419882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fee00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f198400b5f0 tx=0x7f1984006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c65616636260a52 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.871+0000 7f198f7fe700 1 -- 172.21.15.112:0/469419882 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19840106d0 con 0x7f1990070410 2021-10-08T19:21:13.874 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.871+0000 7f198f7fe700 1 -- 172.21.15.112:0/469419882 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f1984010c60 con 0x7f1990070410 2021-10-08T19:21:13.876 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.871+0000 7f198f7fe700 1 -- 172.21.15.112:0/469419882 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1984011af0 con 0x7f1990070410 2021-10-08T19:21:13.876 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 -- 172.21.15.112:0/469419882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 msgr2=0x7f19900fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:13.876 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 --2- 172.21.15.112:0/469419882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fee00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f198400b5f0 tx=0x7f1984006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 -- 172.21.15.112:0/469419882 shutdown_connections 2021-10-08T19:21:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 --2- 172.21.15.112:0/469419882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fee00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 -- 172.21.15.112:0/469419882 >> 172.21.15.112:0/469419882 conn(0x7f19900f6850 msgr2=0x7f19900f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:13.877 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 -- 172.21.15.112:0/469419882 shutdown_connections 2021-10-08T19:21:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 -- 172.21.15.112:0/469419882 wait complete. 2021-10-08T19:21:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 Processor -- start 2021-10-08T19:21:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.872+0000 7f1996be7700 1 -- start start 2021-10-08T19:21:13.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1996be7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1996be7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19900fad00 con 0x7f1990070410 2021-10-08T19:21:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1994983700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1994983700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60964/0 (socket says 172.21.15.112:60964) 2021-10-08T19:21:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1994983700 1 -- 172.21.15.112:0/2969790752 learned_addr learned my addr 172.21.15.112:0/2969790752 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1994983700 1 -- 172.21.15.112:0/2969790752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198400b200 con 0x7f1990070410 2021-10-08T19:21:13.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1994983700 1 --2- 172.21.15.112:0/2969790752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fc880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f198400b5c0 tx=0x7f1984006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:13.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f198d7fa700 1 -- 172.21.15.112:0/2969790752 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f198401b410 con 0x7f1990070410 2021-10-08T19:21:13.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19900faf00 con 0x7f1990070410 2021-10-08T19:21:13.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f198d7fa700 1 -- 172.21.15.112:0/2969790752 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f198401b9a0 con 0x7f1990070410 2021-10-08T19:21:13.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f198d7fa700 1 -- 172.21.15.112:0/2969790752 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1984023610 con 0x7f1990070410 2021-10-08T19:21:13.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.873+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19900fb390 con 0x7f1990070410 2021-10-08T19:21:13.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.874+0000 7f198d7fa700 1 -- 172.21.15.112:0/2969790752 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f198400f070 con 0x7f1990070410 2021-10-08T19:21:13.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.874+0000 7f198d7fa700 1 -- 172.21.15.112:0/2969790752 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f198402d5c0 con 0x7f1990070410 2021-10-08T19:21:13.882 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.874+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199005a9f0 con 0x7f1990070410 2021-10-08T19:21:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.877+0000 7f198d7fa700 1 -- 172.21.15.112:0/2969790752 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70233 (secure 0 0 0) 0x7f198401bd10 con 0x7f1990070410 2021-10-08T19:21:13.954 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.947+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f19901000d0 con 0x7f1990070410 2021-10-08T19:21:13.955 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.947+0000 7f198d7fa700 1 -- 172.21.15.112:0/2969790752 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f198401b570 con 0x7f1990070410 2021-10-08T19:21:13.955 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.955 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: { 2021-10-08T19:21:13.955 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "fsid": "c1559bde-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:21:13.956 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:21:13.956 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:21:13.956 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:21:13.956 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:21:13.957 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:13.957 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:21:13.957 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:21:13.957 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 0 2021-10-08T19:21:13.958 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:13.958 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:21:13.958 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "a" 2021-10-08T19:21:13.958 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:13.958 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum_age": 1534702958, 2021-10-08T19:21:13.959 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:21:13.959 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:13.959 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:21:13.959 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:21:13.959 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:13.960 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:21:13.960 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:13.960 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:21:13.960 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:21:13.960 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:21:13.961 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:21:13.961 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:21:13.961 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:21:13.961 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:13.962 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:21:13.962 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:21:13.962 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:21:13.962 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:21:13.962 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:21:13.963 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:21:13.963 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:21:13.963 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:21:13.963 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:21:13.964 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:13.964 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:21:13.964 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:13.964 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:21:13.964 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:21:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:21:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "available": false, 2021-10-08T19:21:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:21:13.965 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:21:13.966 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:21:13.966 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:21:13.966 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:21:13.966 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:13.966 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:21:13.967 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:13.967 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:21:13.973 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:13.973 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:21:03.408765+0000", 2021-10-08T19:21:13.973 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:21:13.973 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:13.974 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:21:13.974 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: } 2021-10-08T19:21:13.974 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.948+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 msgr2=0x7f19900fc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:13.974 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.948+0000 7f1996be7700 1 --2- 172.21.15.112:0/2969790752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fc880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f198400b5c0 tx=0x7f1984006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:13.975 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.948+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 shutdown_connections 2021-10-08T19:21:13.975 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.948+0000 7f1996be7700 1 --2- 172.21.15.112:0/2969790752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1990070410 0x7f19900fc880 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:13.975 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.948+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 >> 172.21.15.112:0/2969790752 conn(0x7f19900f6850 msgr2=0x7f19900f75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:13.975 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.948+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 shutdown_connections 2021-10-08T19:21:13.975 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:13.948+0000 7f1996be7700 1 -- 172.21.15.112:0/2969790752 wait complete. 2021-10-08T19:21:14.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2969790752' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:21:14.611 INFO:teuthology.orchestra.run.smithi112.stderr:mgr not available, waiting (2/15)... 2021-10-08T19:21:16.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: Activating manager daemon y 2021-10-08T19:21:16.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: mgrmap e2: y(active, starting, since 0.00257663s) 2021-10-08T19:21:16.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:21:16.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:21:16.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:21:16.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:21:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:21:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: Manager daemon y is now available 2021-10-08T19:21:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' 2021-10-08T19:21:16.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:15 smithi112 ceph-mon[31694]: from='mgr.14100 172.21.15.112:0/2763345289' entity='mgr.y' 2021-10-08T19:21:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf status -f json-pretty 2021-10-08T19:21:17.060 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.055+0000 7f1119a78700 1 Processor -- start 2021-10-08T19:21:17.060 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.055+0000 7f1119a78700 1 -- start start 2021-10-08T19:21:17.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.055+0000 7f1119a78700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f11140fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:17.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.055+0000 7f1119a78700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11140ff300 con 0x7f1114070450 2021-10-08T19:21:17.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.055+0000 7f11137fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f11140fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:17.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.056+0000 7f11137fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f11140fedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60990/0 (socket says 172.21.15.112:60990) 2021-10-08T19:21:17.061 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.056+0000 7f11137fe700 1 -- 172.21.15.112:0/2165832354 learned_addr learned my addr 172.21.15.112:0/2165832354 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:17.062 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.056+0000 7f11137fe700 1 -- 172.21.15.112:0/2165832354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140ff440 con 0x7f1114070450 2021-10-08T19:21:17.062 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.056+0000 7f11137fe700 1 --2- 172.21.15.112:0/2165832354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f11140fedc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f110400b5f0 tx=0x7f1104006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916e7cca93ce12c1 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:17.062 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.056+0000 7f1112ffd700 1 -- 172.21.15.112:0/2165832354 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11040106d0 con 0x7f1114070450 2021-10-08T19:21:17.062 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.056+0000 7f1112ffd700 1 -- 172.21.15.112:0/2165832354 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f1104010c60 con 0x7f1114070450 2021-10-08T19:21:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.056+0000 7f1112ffd700 1 -- 172.21.15.112:0/2165832354 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1104011af0 con 0x7f1114070450 2021-10-08T19:21:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 -- 172.21.15.112:0/2165832354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 msgr2=0x7f11140fedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 --2- 172.21.15.112:0/2165832354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f11140fedc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f110400b5f0 tx=0x7f1104006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 -- 172.21.15.112:0/2165832354 shutdown_connections 2021-10-08T19:21:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 --2- 172.21.15.112:0/2165832354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f11140fedc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 -- 172.21.15.112:0/2165832354 >> 172.21.15.112:0/2165832354 conn(0x7f11140f6850 msgr2=0x7f11140f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 -- 172.21.15.112:0/2165832354 shutdown_connections 2021-10-08T19:21:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 -- 172.21.15.112:0/2165832354 wait complete. 2021-10-08T19:21:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 Processor -- start 2021-10-08T19:21:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.057+0000 7f1119a78700 1 -- start start 2021-10-08T19:21:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f1119a78700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f111410abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f1119a78700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111410b110 con 0x7f1114070450 2021-10-08T19:21:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f11137fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f111410abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f11137fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f111410abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60992/0 (socket says 172.21.15.112:60992) 2021-10-08T19:21:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f11137fe700 1 -- 172.21.15.112:0/757930125 learned_addr learned my addr 172.21.15.112:0/757930125 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f11137fe700 1 -- 172.21.15.112:0/757930125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110400b200 con 0x7f1114070450 2021-10-08T19:21:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f11137fe700 1 --2- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f111410abd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f110400c010 tx=0x7f1104006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f1110ff9700 1 -- 172.21.15.112:0/757930125 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f110401b410 con 0x7f1114070450 2021-10-08T19:21:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111410b370 con 0x7f1114070450 2021-10-08T19:21:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f1110ff9700 1 -- 172.21.15.112:0/757930125 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f110401b9a0 con 0x7f1114070450 2021-10-08T19:21:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f1110ff9700 1 -- 172.21.15.112:0/757930125 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1104023640 con 0x7f1114070450 2021-10-08T19:21:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.058+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111410bfb0 con 0x7f1114070450 2021-10-08T19:21:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.059+0000 7f1110ff9700 1 -- 172.21.15.112:0/757930125 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 3) v1 ==== 40364+0+0 (secure 0 0 0) 0x7f110400f070 con 0x7f1114070450 2021-10-08T19:21:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.059+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111405a9f0 con 0x7f1114070450 2021-10-08T19:21:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.059+0000 7f1110ff9700 1 --2- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f10f40334e0 0x7f10f4035990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.059+0000 7f1110ff9700 1 -- 172.21.15.112:0/757930125 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1104046450 con 0x7f1114070450 2021-10-08T19:21:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.059+0000 7f110affd700 1 --2- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f10f40334e0 0x7f10f4035990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.060+0000 7f110affd700 1 --2- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f10f40334e0 0x7f10f4035990 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0096a0 tx=0x7f10fc006b40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.064+0000 7f1110ff9700 1 -- 172.21.15.112:0/757930125 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f11040223a0 con 0x7f1114070450 2021-10-08T19:21:17.288 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.280+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f11140472f0 con 0x7f1114070450 2021-10-08T19:21:17.288 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.280+0000 7f1110ff9700 1 -- 172.21.15.112:0/757930125 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f110402bb80 con 0x7f1114070450 2021-10-08T19:21:17.288 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.289 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: { 2021-10-08T19:21:17.289 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "fsid": "c1559bde-286c-11ec-8c25-001a4aab830c", 2021-10-08T19:21:17.289 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "health": { 2021-10-08T19:21:17.289 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-10-08T19:21:17.290 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "checks": {}, 2021-10-08T19:21:17.290 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "mutes": [] 2021-10-08T19:21:17.290 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:17.290 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-10-08T19:21:17.290 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum": [ 2021-10-08T19:21:17.291 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 0 2021-10-08T19:21:17.291 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:17.291 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum_names": [ 2021-10-08T19:21:17.291 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "a" 2021-10-08T19:21:17.292 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:17.292 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "quorum_age": 572402131, 2021-10-08T19:21:17.292 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "monmap": { 2021-10-08T19:21:17.292 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:17.294 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-10-08T19:21:17.294 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_mons": 1 2021-10-08T19:21:17.295 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:17.295 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osdmap": { 2021-10-08T19:21:17.295 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:17.295 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_osds": 0, 2021-10-08T19:21:17.295 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-10-08T19:21:17.296 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-10-08T19:21:17.296 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-10-08T19:21:17.296 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-10-08T19:21:17.296 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-10-08T19:21:17.296 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:17.297 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "pgmap": { 2021-10-08T19:21:17.297 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-10-08T19:21:17.297 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-10-08T19:21:17.297 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_pools": 0, 2021-10-08T19:21:17.298 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_objects": 0, 2021-10-08T19:21:17.298 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-10-08T19:21:17.298 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-10-08T19:21:17.298 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-10-08T19:21:17.298 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "bytes_total": 0 2021-10-08T19:21:17.299 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:17.299 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "fsmap": { 2021-10-08T19:21:17.299 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:17.299 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "by_rank": [], 2021-10-08T19:21:17.300 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "up:standby": 0 2021-10-08T19:21:17.300 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:17.300 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "mgrmap": { 2021-10-08T19:21:17.300 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:21:17.301 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-10-08T19:21:17.302 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "modules": [ 2021-10-08T19:21:17.302 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "iostat", 2021-10-08T19:21:17.302 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "nfs", 2021-10-08T19:21:17.302 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "restful" 2021-10-08T19:21:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ], 2021-10-08T19:21:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:21:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "servicemap": { 2021-10-08T19:21:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 1, 2021-10-08T19:21:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "modified": "2021-10-08T19:21:03.408765+0000", 2021-10-08T19:21:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "services": {} 2021-10-08T19:21:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: }, 2021-10-08T19:21:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "progress_events": {} 2021-10-08T19:21:17.305 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: } 2021-10-08T19:21:17.305 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f10f40334e0 msgr2=0x7f10f4035990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:17.305 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 --2- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f10f40334e0 0x7f10f4035990 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0096a0 tx=0x7f10fc006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:17.305 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 msgr2=0x7f111410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:17.306 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 --2- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f111410abd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f110400c010 tx=0x7f1104006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:17.306 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 shutdown_connections 2021-10-08T19:21:17.306 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 --2- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f10f40334e0 0x7f10f4035990 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:17.306 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 --2- 172.21.15.112:0/757930125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1114070450 0x7f111410abd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:17.307 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 >> 172.21.15.112:0/757930125 conn(0x7f11140f6850 msgr2=0x7f11140f75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:17.307 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 shutdown_connections 2021-10-08T19:21:17.307 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:17.282+0000 7f1119a78700 1 -- 172.21.15.112:0/757930125 wait complete. 2021-10-08T19:21:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:mgr is available 2021-10-08T19:21:17.855 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z -v /tmp/tmp0bwekm24:/var/lib/ceph/user.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config assimilate-conf -i /var/lib/ceph/user.conf 2021-10-08T19:21:17.866 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:17 smithi112 ceph-mon[31694]: mgrmap e3: y(active, since 1.00533s) 2021-10-08T19:21:17.866 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/757930125' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-10-08T19:21:18.269 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ef143700 1 Processor -- start 2021-10-08T19:21:18.269 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ef143700 1 -- start start 2021-10-08T19:21:18.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ef143700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e80fc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:18.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ef143700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80fcab0 con 0x7fe3e80fc160 2021-10-08T19:21:18.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ecedf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e80fc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:18.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ecedf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e80fc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60996/0 (socket says 172.21.15.112:60996) 2021-10-08T19:21:18.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ecedf700 1 -- 172.21.15.112:0/1527129109 learned_addr learned my addr 172.21.15.112:0/1527129109 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:18.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ecedf700 1 -- 172.21.15.112:0/1527129109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80fcbf0 con 0x7fe3e80fc160 2021-10-08T19:21:18.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3ecedf700 1 --2- 172.21.15.112:0/1527129109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e80fc570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009960 tx=0x7fe3d80092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95e4d3ef6ccf041 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:18.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3e77fe700 1 -- 172.21.15.112:0/1527129109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d800b860 con 0x7fe3e80fc160 2021-10-08T19:21:18.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3e77fe700 1 -- 172.21.15.112:0/1527129109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fe3d800bdf0 con 0x7fe3e80fc160 2021-10-08T19:21:18.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.265+0000 7fe3e77fe700 1 -- 172.21.15.112:0/1527129109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d8011be0 con 0x7fe3e80fc160 2021-10-08T19:21:18.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.266+0000 7fe3ef143700 1 -- 172.21.15.112:0/1527129109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 msgr2=0x7fe3e80fc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:18.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.266+0000 7fe3ef143700 1 --2- 172.21.15.112:0/1527129109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e80fc570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009960 tx=0x7fe3d80092d0 comp rx=0 tx=0).stop 2021-10-08T19:21:18.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.266+0000 7fe3ef143700 1 -- 172.21.15.112:0/1527129109 shutdown_connections 2021-10-08T19:21:18.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.266+0000 7fe3ef143700 1 --2- 172.21.15.112:0/1527129109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e80fc570 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:18.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.266+0000 7fe3ef143700 1 -- 172.21.15.112:0/1527129109 >> 172.21.15.112:0/1527129109 conn(0x7fe3e80f7910 msgr2=0x7fe3e80f9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:18.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.266+0000 7fe3ef143700 1 -- 172.21.15.112:0/1527129109 shutdown_connections 2021-10-08T19:21:18.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.266+0000 7fe3ef143700 1 -- 172.21.15.112:0/1527129109 wait complete. 2021-10-08T19:21:18.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.266+0000 7fe3ef143700 1 Processor -- start 2021-10-08T19:21:18.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3ef143700 1 -- start start 2021-10-08T19:21:18.274 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3ef143700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e810abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:18.274 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3ef143700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e810b110 con 0x7fe3e80fc160 2021-10-08T19:21:18.274 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3ecedf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e810abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:18.274 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3ecedf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e810abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60998/0 (socket says 172.21.15.112:60998) 2021-10-08T19:21:18.275 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3ecedf700 1 -- 172.21.15.112:0/2469867682 learned_addr learned my addr 172.21.15.112:0/2469867682 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:18.275 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3ecedf700 1 -- 172.21.15.112:0/2469867682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d8009570 con 0x7fe3e80fc160 2021-10-08T19:21:18.275 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3ecedf700 1 --2- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e810abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009930 tx=0x7fe3d80092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:18.275 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.267+0000 7fe3e57fa700 1 -- 172.21.15.112:0/2469867682 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d801a740 con 0x7fe3e80fc160 2021-10-08T19:21:18.275 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.268+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e810b310 con 0x7fe3e80fc160 2021-10-08T19:21:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.268+0000 7fe3e57fa700 1 -- 172.21.15.112:0/2469867682 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fe3d801acd0 con 0x7fe3e80fc160 2021-10-08T19:21:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.268+0000 7fe3e57fa700 1 -- 172.21.15.112:0/2469867682 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80229b0 con 0x7fe3e80fc160 2021-10-08T19:21:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.268+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e810bfb0 con 0x7fe3e80fc160 2021-10-08T19:21:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.268+0000 7fe3e57fa700 1 -- 172.21.15.112:0/2469867682 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 40444+0+0 (secure 0 0 0) 0x7fe3d802a070 con 0x7fe3e80fc160 2021-10-08T19:21:18.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.268+0000 7fe3e57fa700 1 --2- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fe3c8033560 0x7fe3c8035a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.268+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e810b7a0 con 0x7fe3e80fc160 2021-10-08T19:21:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.268+0000 7fe3e57fa700 1 -- 172.21.15.112:0/2469867682 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe3d8045f10 con 0x7fe3e80fc160 2021-10-08T19:21:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.269+0000 7fe3e7fff700 1 --2- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fe3c8033560 0x7fe3c8035a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:18.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.269+0000 7fe3e7fff700 1 --2- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fe3c8033560 0x7fe3c8035a10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00096a0 tx=0x7fe3d0006b40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:18.278 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.273+0000 7fe3e57fa700 1 -- 172.21.15.112:0/2469867682 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fe3d801e020 con 0x7fe3e80fc160 2021-10-08T19:21:18.430 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.430+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe3e805a9f0 con 0x7fe3e80fc160 2021-10-08T19:21:18.433 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.431+0000 7fe3e57fa700 1 -- 172.21.15.112:0/2469867682 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+282 (secure 0 0 0) 0x7fe3d8045130 con 0x7fe3e80fc160 2021-10-08T19:21:18.434 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.434 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: [global] 2021-10-08T19:21:18.434 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: fsid = c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:18.434 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-10-08T19:21:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-10-08T19:21:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-10-08T19:21:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-10-08T19:21:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: [mgr] 2021-10-08T19:21:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-10-08T19:21:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: [osd] 2021-10-08T19:21:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-10-08T19:21:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-10-08T19:21:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fe3c8033560 msgr2=0x7fe3c8035a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 --2- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fe3c8033560 0x7fe3c8035a10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00096a0 tx=0x7fe3d0006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 msgr2=0x7fe3e810abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:18.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 --2- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e810abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009930 tx=0x7fe3d80092d0 comp rx=0 tx=0).stop 2021-10-08T19:21:18.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 shutdown_connections 2021-10-08T19:21:18.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 --2- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fe3c8033560 0x7fe3c8035a10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:18.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 --2- 172.21.15.112:0/2469867682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3e80fc160 0x7fe3e810abd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:18.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 >> 172.21.15.112:0/2469867682 conn(0x7fe3e80f7910 msgr2=0x7fe3e80f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:18.439 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 shutdown_connections 2021-10-08T19:21:18.439 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:18.432+0000 7fe3ef143700 1 -- 172.21.15.112:0/2469867682 wait complete. 2021-10-08T19:21:18.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:18 smithi112 ceph-mon[31694]: mgrmap e4: y(active, since 2s) 2021-10-08T19:21:18.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2469867682' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-10-08T19:21:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:Enabling cephadm module... 2021-10-08T19:21:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr module enable cephadm 2021-10-08T19:21:19.437 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.433+0000 7fa19bd5e700 1 Processor -- start 2021-10-08T19:21:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.433+0000 7fa19bd5e700 1 -- start start 2021-10-08T19:21:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa19bd5e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa194070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa19bd5e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa194072920 con 0x7fa194072510 2021-10-08T19:21:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa199afa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa194070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:19.438 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa199afa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa194070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32770/0 (socket says 172.21.15.112:32770) 2021-10-08T19:21:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa199afa700 1 -- 172.21.15.112:0/971461009 learned_addr learned my addr 172.21.15.112:0/971461009 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa199afa700 1 -- 172.21.15.112:0/971461009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194070ff0 con 0x7fa194072510 2021-10-08T19:21:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa199afa700 1 --2- 172.21.15.112:0/971461009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa194070ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa19000b5f0 tx=0x7fa190006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6162b144a73ef770 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:19.439 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa198af8700 1 -- 172.21.15.112:0/971461009 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1900106d0 con 0x7fa194072510 2021-10-08T19:21:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa198af8700 1 -- 172.21.15.112:0/971461009 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fa190010c60 con 0x7fa194072510 2021-10-08T19:21:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.434+0000 7fa198af8700 1 -- 172.21.15.112:0/971461009 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa190011af0 con 0x7fa194072510 2021-10-08T19:21:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.435+0000 7fa19bd5e700 1 -- 172.21.15.112:0/971461009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 msgr2=0x7fa194070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:19.440 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.435+0000 7fa19bd5e700 1 --2- 172.21.15.112:0/971461009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa194070ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa19000b5f0 tx=0x7fa190006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.435+0000 7fa19bd5e700 1 -- 172.21.15.112:0/971461009 shutdown_connections 2021-10-08T19:21:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.435+0000 7fa19bd5e700 1 --2- 172.21.15.112:0/971461009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa194070ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.435+0000 7fa19bd5e700 1 -- 172.21.15.112:0/971461009 >> 172.21.15.112:0/971461009 conn(0x7fa1940f7910 msgr2=0x7fa1940f9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.435+0000 7fa19bd5e700 1 -- 172.21.15.112:0/971461009 shutdown_connections 2021-10-08T19:21:19.441 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.435+0000 7fa19bd5e700 1 -- 172.21.15.112:0/971461009 wait complete. 2021-10-08T19:21:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa19bd5e700 1 Processor -- start 2021-10-08T19:21:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa19bd5e700 1 -- start start 2021-10-08T19:21:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa19bd5e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa19410cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:19.442 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa19bd5e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19410d400 con 0x7fa194072510 2021-10-08T19:21:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa199afa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa19410cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa199afa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa19410cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32772/0 (socket says 172.21.15.112:32772) 2021-10-08T19:21:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa199afa700 1 -- 172.21.15.112:0/272478243 learned_addr learned my addr 172.21.15.112:0/272478243 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:19.443 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa199afa700 1 -- 172.21.15.112:0/272478243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19000b200 con 0x7fa194072510 2021-10-08T19:21:19.444 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa199afa700 1 --2- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa19410cec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa19000c010 tx=0x7fa190006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:19.444 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa1827fc700 1 -- 172.21.15.112:0/272478243 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa19001b410 con 0x7fa194072510 2021-10-08T19:21:19.444 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa1827fc700 1 -- 172.21.15.112:0/272478243 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fa19001b9a0 con 0x7fa194072510 2021-10-08T19:21:19.444 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19410d600 con 0x7fa194072510 2021-10-08T19:21:19.445 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa1827fc700 1 -- 172.21.15.112:0/272478243 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1900236b0 con 0x7fa194072510 2021-10-08T19:21:19.445 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.436+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19410e160 con 0x7fa194072510 2021-10-08T19:21:19.445 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.437+0000 7fa1827fc700 1 -- 172.21.15.112:0/272478243 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) v1 ==== 40444+0+0 (secure 0 0 0) 0x7fa19000f070 con 0x7fa194072510 2021-10-08T19:21:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.437+0000 7fa1827fc700 1 --2- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fa17c033560 0x7fa17c035a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.437+0000 7fa1827fc700 1 -- 172.21.15.112:0/272478243 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa1900464d0 con 0x7fa194072510 2021-10-08T19:21:19.446 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.437+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19405a9f0 con 0x7fa194072510 2021-10-08T19:21:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.437+0000 7fa1992f9700 1 --2- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fa17c033560 0x7fa17c035a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.438+0000 7fa1992f9700 1 --2- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fa17c033560 0x7fa17c035a10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1840096a0 tx=0x7fa184006b40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:19.447 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.442+0000 7fa1827fc700 1 -- 172.21.15.112:0/272478243 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fa19002b960 con 0x7fa194072510 2021-10-08T19:21:19.645 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.645+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa1940008d0 con 0x7fa194072510 2021-10-08T19:21:19.697 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.697+0000 7fa1827fc700 1 -- 172.21.15.112:0/272478243 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 5) v1 ==== 40455+0+0 (secure 0 0 0) 0x7fa19002d440 con 0x7fa194072510 2021-10-08T19:21:19.698 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.698+0000 7fa1827fc700 1 -- 172.21.15.112:0/272478243 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa1900223a0 con 0x7fa194072510 2021-10-08T19:21:19.702 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fa17c033560 msgr2=0x7fa17c035a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:19.702 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 --2- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fa17c033560 0x7fa17c035a10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1840096a0 tx=0x7fa184006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 msgr2=0x7fa19410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 --2- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa19410cec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa19000c010 tx=0x7fa190006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 shutdown_connections 2021-10-08T19:21:19.703 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 --2- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fa17c033560 0x7fa17c035a10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 --2- 172.21.15.112:0/272478243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa194072510 0x7fa19410cec0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 >> 172.21.15.112:0/272478243 conn(0x7fa1940f7910 msgr2=0x7fa1940f86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 shutdown_connections 2021-10-08T19:21:19.704 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:19.701+0000 7fa19bd5e700 1 -- 172.21.15.112:0/272478243 wait complete. 2021-10-08T19:21:20.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/272478243' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-10-08T19:21:20.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:19 smithi112 conmon[32108]: ignoring --setuser ceph since I am not root 2021-10-08T19:21:20.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:19 smithi112 conmon[32108]: ignoring --setgroup ceph since I am not root 2021-10-08T19:21:20.227 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr stat 2021-10-08T19:21:20.680 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.674+0000 7fb31f59e700 1 Processor -- start 2021-10-08T19:21:20.680 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.674+0000 7fb31f59e700 1 -- start start 2021-10-08T19:21:20.680 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.674+0000 7fb31f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200fc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:20.680 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.674+0000 7fb31f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200fc8d0 con 0x7fb3200fbf80 2021-10-08T19:21:20.681 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.674+0000 7fb31e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:20.681 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.674+0000 7fb31e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200fc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32786/0 (socket says 172.21.15.112:32786) 2021-10-08T19:21:20.681 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.674+0000 7fb31e59c700 1 -- 172.21.15.112:0/1688886923 learned_addr learned my addr 172.21.15.112:0/1688886923 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:20.681 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.674+0000 7fb31e59c700 1 -- 172.21.15.112:0/1688886923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200fca10 con 0x7fb3200fbf80 2021-10-08T19:21:20.681 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.675+0000 7fb31e59c700 1 --2- 172.21.15.112:0/1688886923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200fc390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb31000b5f0 tx=0x7fb310006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e54aa2f179aa64 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:20.682 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.675+0000 7fb31d59a700 1 -- 172.21.15.112:0/1688886923 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3100106d0 con 0x7fb3200fbf80 2021-10-08T19:21:20.682 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.675+0000 7fb31d59a700 1 -- 172.21.15.112:0/1688886923 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fb310010c60 con 0x7fb3200fbf80 2021-10-08T19:21:20.682 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.675+0000 7fb31d59a700 1 -- 172.21.15.112:0/1688886923 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb310011af0 con 0x7fb3200fbf80 2021-10-08T19:21:20.682 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.675+0000 7fb31f59e700 1 -- 172.21.15.112:0/1688886923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 msgr2=0x7fb3200fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:20.683 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.675+0000 7fb31f59e700 1 --2- 172.21.15.112:0/1688886923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200fc390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb31000b5f0 tx=0x7fb310006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:20.683 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 -- 172.21.15.112:0/1688886923 shutdown_connections 2021-10-08T19:21:20.683 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 --2- 172.21.15.112:0/1688886923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200fc390 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:20.683 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 -- 172.21.15.112:0/1688886923 >> 172.21.15.112:0/1688886923 conn(0x7fb3200f7770 msgr2=0x7fb3200f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:20.684 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 -- 172.21.15.112:0/1688886923 shutdown_connections 2021-10-08T19:21:20.684 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 -- 172.21.15.112:0/1688886923 wait complete. 2021-10-08T19:21:20.684 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 Processor -- start 2021-10-08T19:21:20.685 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 -- start start 2021-10-08T19:21:20.685 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200725b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:20.686 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320070a30 con 0x7fb3200fbf80 2021-10-08T19:21:20.686 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:20.686 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32788/0 (socket says 172.21.15.112:32788) 2021-10-08T19:21:20.687 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.676+0000 7fb31e59c700 1 -- 172.21.15.112:0/3922092556 learned_addr learned my addr 172.21.15.112:0/3922092556 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:20.687 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.677+0000 7fb31e59c700 1 -- 172.21.15.112:0/3922092556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31000b200 con 0x7fb3200fbf80 2021-10-08T19:21:20.687 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.677+0000 7fb31e59c700 1 --2- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200725b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb31000b5c0 tx=0x7fb310006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:20.688 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.677+0000 7fb30effd700 1 -- 172.21.15.112:0/3922092556 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb310010b00 con 0x7fb3200fbf80 2021-10-08T19:21:20.688 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.677+0000 7fb30effd700 1 -- 172.21.15.112:0/3922092556 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fb31001ba50 con 0x7fb3200fbf80 2021-10-08T19:21:20.688 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.677+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb320070c30 con 0x7fb3200fbf80 2021-10-08T19:21:20.688 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.677+0000 7fb30effd700 1 -- 172.21.15.112:0/3922092556 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb310023760 con 0x7fb3200fbf80 2021-10-08T19:21:20.689 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.677+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3200710c0 con 0x7fb3200fbf80 2021-10-08T19:21:20.689 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.678+0000 7fb30effd700 1 -- 172.21.15.112:0/3922092556 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 40455+0+0 (secure 0 0 0) 0x7fb31000f070 con 0x7fb3200fbf80 2021-10-08T19:21:20.689 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.678+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32005a9f0 con 0x7fb3200fbf80 2021-10-08T19:21:20.689 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.678+0000 7fb30effd700 1 --2- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fb3040335b0 0x7fb304035a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:20.690 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.678+0000 7fb31dd9b700 1 -- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fb3040335b0 msgr2=0x7fb304035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1703752479 2021-10-08T19:21:20.690 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.678+0000 7fb30effd700 1 -- 172.21.15.112:0/3922092556 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb3100466f0 con 0x7fb3200fbf80 2021-10-08T19:21:20.690 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.678+0000 7fb31dd9b700 1 --2- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fb3040335b0 0x7fb304035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:21:20.691 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.683+0000 7fb30effd700 1 -- 172.21.15.112:0/3922092556 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb31002d960 con 0x7fb3200fbf80 2021-10-08T19:21:20.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.879+0000 7fb31dd9b700 1 -- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fb3040335b0 msgr2=0x7fb304035a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1703752479 2021-10-08T19:21:20.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.879+0000 7fb31dd9b700 1 --2- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fb3040335b0 0x7fb304035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:21:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.885+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb3200713a0 con 0x7fb3200fbf80 2021-10-08T19:21:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.885+0000 7fb30effd700 1 -- 172.21.15.112:0/3922092556 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb31001ab90 con 0x7fb3200fbf80 2021-10-08T19:21:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: { 2021-10-08T19:21:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 5, 2021-10-08T19:21:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:21:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "active_name": "y", 2021-10-08T19:21:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_standby": 0 2021-10-08T19:21:20.888 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: } 2021-10-08T19:21:20.889 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.887+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fb3040335b0 msgr2=0x7fb304035a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:21:20.889 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.887+0000 7fb31f59e700 1 --2- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fb3040335b0 0x7fb304035a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.887+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 msgr2=0x7fb3200725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.887+0000 7fb31f59e700 1 --2- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200725b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb31000b5c0 tx=0x7fb310006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.887+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 shutdown_connections 2021-10-08T19:21:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.887+0000 7fb31f59e700 1 --2- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7fb3040335b0 0x7fb304035a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:20.891 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.887+0000 7fb31f59e700 1 --2- 172.21.15.112:0/3922092556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3200fbf80 0x7fb3200725b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:20.891 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.887+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 >> 172.21.15.112:0/3922092556 conn(0x7fb3200f7770 msgr2=0x7fb3200f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:20.891 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.888+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 shutdown_connections 2021-10-08T19:21:20.891 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:20.888+0000 7fb31f59e700 1 -- 172.21.15.112:0/3922092556 wait complete. 2021-10-08T19:21:21.036 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/272478243' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-10-08T19:21:21.037 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:20 smithi112 ceph-mon[31694]: mgrmap e5: y(active, since 4s) 2021-10-08T19:21:21.464 INFO:teuthology.orchestra.run.smithi112.stderr:Waiting for the mgr to restart... 2021-10-08T19:21:21.465 INFO:teuthology.orchestra.run.smithi112.stderr:Waiting for mgr epoch 5... 2021-10-08T19:21:21.465 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf tell mgr mgr_status 2021-10-08T19:21:21.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3922092556' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-10-08T19:21:21.873 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.868+0000 7f73bca8c700 1 Processor -- start 2021-10-08T19:21:21.874 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.868+0000 7f73bca8c700 1 -- start start 2021-10-08T19:21:21.874 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.868+0000 7f73bca8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b80fb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:21.874 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.868+0000 7f73bca8c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80fb9b0 con 0x7f73b80fb060 2021-10-08T19:21:21.874 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.869+0000 7f73b659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b80fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:21.875 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.869+0000 7f73b659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b80fb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32796/0 (socket says 172.21.15.112:32796) 2021-10-08T19:21:21.875 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.869+0000 7f73b659c700 1 -- 172.21.15.112:0/3023574867 learned_addr learned my addr 172.21.15.112:0/3023574867 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:21.875 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.869+0000 7f73b659c700 1 -- 172.21.15.112:0/3023574867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b80fbaf0 con 0x7f73b80fb060 2021-10-08T19:21:21.875 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.869+0000 7f73b659c700 1 --2- 172.21.15.112:0/3023574867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b80fb470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00b5f0 tx=0x7f73ac006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6719ea071040ed06 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:21.876 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.869+0000 7f73b559a700 1 -- 172.21.15.112:0/3023574867 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73ac0106d0 con 0x7f73b80fb060 2021-10-08T19:21:21.876 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.869+0000 7f73b559a700 1 -- 172.21.15.112:0/3023574867 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f73ac010c60 con 0x7f73b80fb060 2021-10-08T19:21:21.876 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.869+0000 7f73b559a700 1 -- 172.21.15.112:0/3023574867 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73ac011af0 con 0x7f73b80fb060 2021-10-08T19:21:21.876 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 -- 172.21.15.112:0/3023574867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 msgr2=0x7f73b80fb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:21.876 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 --2- 172.21.15.112:0/3023574867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b80fb470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00b5f0 tx=0x7f73ac006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:21.877 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 -- 172.21.15.112:0/3023574867 shutdown_connections 2021-10-08T19:21:21.877 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 --2- 172.21.15.112:0/3023574867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b80fb470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:21.877 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 -- 172.21.15.112:0/3023574867 >> 172.21.15.112:0/3023574867 conn(0x7f73b80f6850 msgr2=0x7f73b80f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:21.877 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 -- 172.21.15.112:0/3023574867 shutdown_connections 2021-10-08T19:21:21.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 -- 172.21.15.112:0/3023574867 wait complete. 2021-10-08T19:21:21.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 Processor -- start 2021-10-08T19:21:21.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.870+0000 7f73bca8c700 1 -- start start 2021-10-08T19:21:21.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73bca8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b81089e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:21.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73bca8c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b8108f20 con 0x7f73b80fb060 2021-10-08T19:21:21.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73b659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b81089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:21.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73b659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b81089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32798/0 (socket says 172.21.15.112:32798) 2021-10-08T19:21:21.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73b659c700 1 -- 172.21.15.112:0/2108539525 learned_addr learned my addr 172.21.15.112:0/2108539525 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:21.879 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73b659c700 1 -- 172.21.15.112:0/2108539525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac00b200 con 0x7f73b80fb060 2021-10-08T19:21:21.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73b659c700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b81089e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00c010 tx=0x7f73ac006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:21.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73ac01b410 con 0x7f73b80fb060 2021-10-08T19:21:21.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b8109120 con 0x7f73b80fb060 2021-10-08T19:21:21.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f73ac01b9a0 con 0x7f73b80fb060 2021-10-08T19:21:21.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b8109dc0 con 0x7f73b80fb060 2021-10-08T19:21:21.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.871+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73ac0236d0 con 0x7f73b80fb060 2021-10-08T19:21:21.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.872+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 40455+0+0 (secure 0 0 0) 0x7f73ac00f070 con 0x7f73b80fb060 2021-10-08T19:21:21.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.873+0000 7f73a6ffd700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 0x7f739c037cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:21.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.873+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 --> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f739c0383c0 con 0x7f739c035800 2021-10-08T19:21:21.882 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.873+0000 7f73b5d9b700 1 -- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 msgr2=0x7f739c037cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1703752479 2021-10-08T19:21:21.882 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.873+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f73ac0464e0 con 0x7f73b80fb060 2021-10-08T19:21:21.882 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:21.873+0000 7f73b5d9b700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 0x7f739c037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:21:22.074 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:22.074+0000 7f73b5d9b700 1 -- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 msgr2=0x7f739c037cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1703752479 2021-10-08T19:21:22.075 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:22.074+0000 7f73b5d9b700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 0x7f739c037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:21:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:22.475+0000 7f73b5d9b700 1 -- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 msgr2=0x7f739c037cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1703752479 2021-10-08T19:21:22.476 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:22.475+0000 7f73b5d9b700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 0x7f739c037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2021-10-08T19:21:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:23.276+0000 7f73b5d9b700 1 -- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 msgr2=0x7f739c037cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1703752479 2021-10-08T19:21:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:23.276+0000 7f73b5d9b700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 0x7f739c037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2021-10-08T19:21:24.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:24.877+0000 7f73b5d9b700 1 -- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 msgr2=0x7f739c037cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1703752479 2021-10-08T19:21:24.878 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:24.877+0000 7f73b5d9b700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 0x7f739c037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2021-10-08T19:21:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:25.287+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mgrmap(e 6) v1 ==== 40265+0+0 (secure 0 0 0) 0x7f73ac02d960 con 0x7f73b80fb060 2021-10-08T19:21:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:25.288+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 msgr2=0x7f739c037cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:21:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:25.288+0000 7f73a6ffd700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 0x7f739c037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:25.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:25 smithi112 ceph-mon[31694]: Active manager daemon y restarted 2021-10-08T19:21:25.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:25 smithi112 ceph-mon[31694]: Activating manager daemon y 2021-10-08T19:21:25.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:25 smithi112 ceph-mon[31694]: osdmap e2: 0 total, 0 up, 0 in 2021-10-08T19:21:26.299 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.297+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 7) v1 ==== 40375+0+0 (secure 0 0 0) 0x7f73ac0479f0 con 0x7f73b80fb060 2021-10-08T19:21:26.300 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.297+0000 7f73a6ffd700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f739c039110 0x7f739c03b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:26.300 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.297+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f739c0383c0 con 0x7f739c039110 2021-10-08T19:21:26.300 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.298+0000 7f73b5d9b700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f739c039110 0x7f739c03b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:26.301 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.298+0000 7f73b5d9b700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f739c039110 0x7f739c03b4f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f73a8006fd0 tx=0x7f73a8006cf0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:26.301 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.299+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mgr.14118 v2:172.21.15.112:6800/1294788170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6424 (secure 0 0 0) 0x7f739c0383c0 con 0x7f739c039110 2021-10-08T19:21:26.307 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.305+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f73940022f0 con 0x7f739c039110 2021-10-08T19:21:26.307 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.305+0000 7f73a6ffd700 1 -- 172.21.15.112:0/2108539525 <== mgr.14118 v2:172.21.15.112:6800/1294788170 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f73940022f0 con 0x7f739c039110 2021-10-08T19:21:26.308 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: { 2021-10-08T19:21:26.308 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-10-08T19:21:26.308 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "initialized": true 2021-10-08T19:21:26.308 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: } 2021-10-08T19:21:26.308 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.305+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f739c039110 msgr2=0x7f739c03b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f739c039110 0x7f739c03b4f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f73a8006fd0 tx=0x7f73a8006cf0 comp rx=0 tx=0).stop 2021-10-08T19:21:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 msgr2=0x7f73b81089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b81089e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00c010 tx=0x7f73ac006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:26.309 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 shutdown_connections 2021-10-08T19:21:26.310 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f739c039110 0x7f739c03b4f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:26.310 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73b80fb060 0x7f73b81089e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:26.310 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 --2- 172.21.15.112:0/2108539525 >> [v2:172.21.15.112:6800/1703752479,v1:172.21.15.112:6801/1703752479] conn(0x7f739c035800 0x7f739c037cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:26.310 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 >> 172.21.15.112:0/2108539525 conn(0x7f73b80f6850 msgr2=0x7f73b80ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:26.311 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 shutdown_connections 2021-10-08T19:21:26.311 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:26.306+0000 7f73bca8c700 1 -- 172.21.15.112:0/2108539525 wait complete. 2021-10-08T19:21:26.570 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:26 smithi112 conmon[32108]: [08/Oct/2021:19:21:26] ENGINE Bus STARTING 2021-10-08T19:21:26.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: mgrmap e6: y(active, starting, since 0.0523254s) 2021-10-08T19:21:26.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:21:26.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:21:26.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:21:26.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:21:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:21:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: Manager daemon y is now available 2021-10-08T19:21:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:26.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:26 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:26.903 INFO:teuthology.orchestra.run.smithi112.stderr:mgr epoch 5 is available 2021-10-08T19:21:26.904 INFO:teuthology.orchestra.run.smithi112.stderr:Setting orchestrator backend to cephadm... 2021-10-08T19:21:26.904 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch set backend cephadm 2021-10-08T19:21:26.940 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:26 smithi112 conmon[32108]: [08/Oct/2021:19:21:26] ENGINE Serving on https://172.21.15.112:8499 2021-10-08T19:21:26.941 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:26 smithi112 conmon[32108]: [08/Oct/2021:19:21:26] ENGINE Bus STARTED 2021-10-08T19:21:27.338 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.334+0000 7fb5a515d700 1 Processor -- start 2021-10-08T19:21:27.339 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.334+0000 7fb5a515d700 1 -- start start 2021-10-08T19:21:27.339 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.334+0000 7fb5a515d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a00fc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:27.339 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.334+0000 7fb5a515d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00fc910 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.339 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.334+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a00fc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.334+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a00fc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32844/0 (socket says 172.21.15.112:32844) 2021-10-08T19:21:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.334+0000 7fb59ffff700 1 -- 172.21.15.112:0/358622051 learned_addr learned my addr 172.21.15.112:0/358622051 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.334+0000 7fb59ffff700 1 -- 172.21.15.112:0/358622051 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00fca50 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb59ffff700 1 --2- 172.21.15.112:0/358622051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a00fc3d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b5f0 tx=0x7fb590006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92d5ee53eafa9fa server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:27.340 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb59effd700 1 -- 172.21.15.112:0/358622051 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5900106d0 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb59effd700 1 -- 172.21.15.112:0/358622051 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fb590010c60 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb59effd700 1 -- 172.21.15.112:0/358622051 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb590011af0 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb5a515d700 1 -- 172.21.15.112:0/358622051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 msgr2=0x7fb5a00fc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb5a515d700 1 --2- 172.21.15.112:0/358622051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a00fc3d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b5f0 tx=0x7fb590006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:27.341 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb5a515d700 1 -- 172.21.15.112:0/358622051 shutdown_connections 2021-10-08T19:21:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb5a515d700 1 --2- 172.21.15.112:0/358622051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a00fc3d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb5a515d700 1 -- 172.21.15.112:0/358622051 >> 172.21.15.112:0/358622051 conn(0x7fb5a00f7790 msgr2=0x7fb5a00f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb5a515d700 1 -- 172.21.15.112:0/358622051 shutdown_connections 2021-10-08T19:21:27.342 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.335+0000 7fb5a515d700 1 -- 172.21.15.112:0/358622051 wait complete. 2021-10-08T19:21:27.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.336+0000 7fb5a515d700 1 Processor -- start 2021-10-08T19:21:27.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.336+0000 7fb5a515d700 1 -- start start 2021-10-08T19:21:27.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.336+0000 7fb5a515d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a010aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:27.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.336+0000 7fb5a515d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a010af90 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.336+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a010aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.336+0000 7fb59ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a010aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32846/0 (socket says 172.21.15.112:32846) 2021-10-08T19:21:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.336+0000 7fb59ffff700 1 -- 172.21.15.112:0/1843543223 learned_addr learned my addr 172.21.15.112:0/1843543223 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.337+0000 7fb59ffff700 1 -- 172.21.15.112:0/1843543223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59000b200 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.344 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.337+0000 7fb59ffff700 1 --2- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a010aa50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b5c0 tx=0x7fb590006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.337+0000 7fb59cff9700 1 -- 172.21.15.112:0/1843543223 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb590010b00 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.337+0000 7fb59cff9700 1 -- 172.21.15.112:0/1843543223 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fb59001ba50 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.337+0000 7fb59cff9700 1 -- 172.21.15.112:0/1843543223 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb590023760 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.337+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a010b190 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.337+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a010be30 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.338+0000 7fb59cff9700 1 -- 172.21.15.112:0/1843543223 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7fb59000f070 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.338+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a010b620 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.338+0000 7fb59cff9700 1 --2- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fb58c0336a0 0x7fb58c035b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:27.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.338+0000 7fb59cff9700 1 -- 172.21.15.112:0/1843543223 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb590046ab0 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.338+0000 7fb59f7fe700 1 --2- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fb58c0336a0 0x7fb58c035b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:27.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.338+0000 7fb59f7fe700 1 --2- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fb58c0336a0 0x7fb58c035b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb5940096a0 tx=0x7fb594006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:27.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.342+0000 7fb59cff9700 1 -- 172.21.15.112:0/1843543223 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb59002d960 con 0x7fb5a00fbfc0 2021-10-08T19:21:27.511 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.510+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5a00f8af0 con 0x7fb58c0336a0 2021-10-08T19:21:27.516 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.516+0000 7fb59cff9700 1 -- 172.21.15.112:0/1843543223 <== mgr.14118 v2:172.21.15.112:6800/1294788170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb5a00f8af0 con 0x7fb58c0336a0 2021-10-08T19:21:27.518 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.517+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fb58c0336a0 msgr2=0x7fb58c035b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:27.519 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.517+0000 7fb5a515d700 1 --2- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fb58c0336a0 0x7fb58c035b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb5940096a0 tx=0x7fb594006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:27.519 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.517+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 msgr2=0x7fb5a010aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:27.519 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.517+0000 7fb5a515d700 1 --2- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a010aa50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b5c0 tx=0x7fb590006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:27.519 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.517+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 shutdown_connections 2021-10-08T19:21:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.517+0000 7fb5a515d700 1 --2- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fb58c0336a0 0x7fb58c035b50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.517+0000 7fb5a515d700 1 --2- 172.21.15.112:0/1843543223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5a00fbfc0 0x7fb5a010aa50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.517+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 >> 172.21.15.112:0/1843543223 conn(0x7fb5a00f7790 msgr2=0x7fb5a00f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:27.520 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.518+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 shutdown_connections 2021-10-08T19:21:27.521 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:27.518+0000 7fb5a515d700 1 -- 172.21.15.112:0/1843543223 wait complete. 2021-10-08T19:21:27.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:27 smithi112 ceph-mon[31694]: mgrmap e7: y(active, since 1.06327s) 2021-10-08T19:21:27.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:27 smithi112 ceph-mon[31694]: Starting cherrypy engine... 2021-10-08T19:21:27.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:27 smithi112 ceph-mon[31694]: [08/Oct/2021:19:21:26] ENGINE Bus STARTING 2021-10-08T19:21:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:27 smithi112 ceph-mon[31694]: [08/Oct/2021:19:21:26] ENGINE Serving on https://172.21.15.112:8499 2021-10-08T19:21:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:27 smithi112 ceph-mon[31694]: [08/Oct/2021:19:21:26] ENGINE Bus STARTED 2021-10-08T19:21:27.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:27 smithi112 ceph-mon[31694]: Cherrypy engine started. 2021-10-08T19:21:28.138 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm set-user root 2021-10-08T19:21:28.360 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:28 smithi112 ceph-mon[31694]: mgrmap e8: y(active, since 2s) 2021-10-08T19:21:28.360 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:28 smithi112 ceph-mon[31694]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:28.361 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:28 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:28.361 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:28 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:28.602 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99bb59e700 1 Processor -- start 2021-10-08T19:21:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99bb59e700 1 -- start start 2021-10-08T19:21:28.603 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99bb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc0fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99bb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0fb7f0 con 0x7f99bc0faea0 2021-10-08T19:21:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99ba59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc0fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99ba59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc0fb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32850/0 (socket says 172.21.15.112:32850) 2021-10-08T19:21:28.604 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99ba59c700 1 -- 172.21.15.112:0/2966304211 learned_addr learned my addr 172.21.15.112:0/2966304211 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:28.605 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99ba59c700 1 -- 172.21.15.112:0/2966304211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0fb930 con 0x7f99bc0faea0 2021-10-08T19:21:28.605 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.597+0000 7f99ba59c700 1 --2- 172.21.15.112:0/2966304211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc0fb2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b870 tx=0x7f99ac006f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569db4343cce541f server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99b959a700 1 -- 172.21.15.112:0/2966304211 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99ac00d8c0 con 0x7f99bc0faea0 2021-10-08T19:21:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99b959a700 1 -- 172.21.15.112:0/2966304211 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f99ac00de50 con 0x7f99bc0faea0 2021-10-08T19:21:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99b959a700 1 -- 172.21.15.112:0/2966304211 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99ac010d80 con 0x7f99bc0faea0 2021-10-08T19:21:28.606 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99bb59e700 1 -- 172.21.15.112:0/2966304211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 msgr2=0x7f99bc0fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99bb59e700 1 --2- 172.21.15.112:0/2966304211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc0fb2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b870 tx=0x7f99ac006f70 comp rx=0 tx=0).stop 2021-10-08T19:21:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99bb59e700 1 -- 172.21.15.112:0/2966304211 shutdown_connections 2021-10-08T19:21:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99bb59e700 1 --2- 172.21.15.112:0/2966304211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc0fb2b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:28.607 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99bb59e700 1 -- 172.21.15.112:0/2966304211 >> 172.21.15.112:0/2966304211 conn(0x7f99bc0f6670 msgr2=0x7f99bc0f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99bb59e700 1 -- 172.21.15.112:0/2966304211 shutdown_connections 2021-10-08T19:21:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.598+0000 7f99bb59e700 1 -- 172.21.15.112:0/2966304211 wait complete. 2021-10-08T19:21:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99bb59e700 1 Processor -- start 2021-10-08T19:21:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99bb59e700 1 -- start start 2021-10-08T19:21:28.608 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99bb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc1087c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99bb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc108d00 con 0x7f99bc0faea0 2021-10-08T19:21:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99ba59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc1087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:28.609 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99ba59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc1087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32852/0 (socket says 172.21.15.112:32852) 2021-10-08T19:21:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99ba59c700 1 -- 172.21.15.112:0/631958288 learned_addr learned my addr 172.21.15.112:0/631958288 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99ba59c700 1 -- 172.21.15.112:0/631958288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac00b480 con 0x7f99bc0faea0 2021-10-08T19:21:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.599+0000 7f99ba59c700 1 --2- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc1087c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b840 tx=0x7f99ac01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:28.610 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.600+0000 7f99aaffd700 1 -- 172.21.15.112:0/631958288 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99ac01f040 con 0x7f99bc0faea0 2021-10-08T19:21:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.600+0000 7f99aaffd700 1 -- 172.21.15.112:0/631958288 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f99ac018ae0 con 0x7f99bc0faea0 2021-10-08T19:21:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.600+0000 7f99aaffd700 1 -- 172.21.15.112:0/631958288 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99ac0249a0 con 0x7f99bc0faea0 2021-10-08T19:21:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.600+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc108f00 con 0x7f99bc0faea0 2021-10-08T19:21:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.600+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc109330 con 0x7f99bc0faea0 2021-10-08T19:21:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.600+0000 7f99aaffd700 1 -- 172.21.15.112:0/631958288 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7f99ac024c10 con 0x7f99bc0faea0 2021-10-08T19:21:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.600+0000 7f99aaffd700 1 --2- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f99a00336a0 0x7f99a0035b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.601+0000 7f99aaffd700 1 -- 172.21.15.112:0/631958288 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f99ac014070 con 0x7f99bc0faea0 2021-10-08T19:21:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.601+0000 7f99b9d9b700 1 --2- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f99a00336a0 0x7f99a0035b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.601+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc05a9f0 con 0x7f99bc0faea0 2021-10-08T19:21:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.601+0000 7f99b9d9b700 1 --2- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f99a00336a0 0x7f99a0035b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f99b00096a0 tx=0x7f99b0006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.605+0000 7f99aaffd700 1 -- 172.21.15.112:0/631958288 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f99ac016320 con 0x7f99bc0faea0 2021-10-08T19:21:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.764+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f99bc101d20 con 0x7f99a00336a0 2021-10-08T19:21:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.765+0000 7f99aaffd700 1 -- 172.21.15.112:0/631958288 <== mgr.14118 v2:172.21.15.112:6800/1294788170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f99bc101d20 con 0x7f99a00336a0 2021-10-08T19:21:28.766 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: value unchanged 2021-10-08T19:21:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.766+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f99a00336a0 msgr2=0x7f99a0035b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.766+0000 7f99bb59e700 1 --2- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f99a00336a0 0x7f99a0035b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f99b00096a0 tx=0x7f99b0006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.766+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 msgr2=0x7f99bc1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:28.768 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.766+0000 7f99bb59e700 1 --2- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc1087c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b840 tx=0x7f99ac01c040 comp rx=0 tx=0).stop 2021-10-08T19:21:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.766+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 shutdown_connections 2021-10-08T19:21:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.766+0000 7f99bb59e700 1 --2- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f99a00336a0 0x7f99a0035b50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.766+0000 7f99bb59e700 1 --2- 172.21.15.112:0/631958288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99bc0faea0 0x7f99bc1087c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.766+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 >> 172.21.15.112:0/631958288 conn(0x7f99bc0f6670 msgr2=0x7f99bc0ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:28.769 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.767+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 shutdown_connections 2021-10-08T19:21:28.770 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:28.767+0000 7f99bb59e700 1 -- 172.21.15.112:0/631958288 wait complete. 2021-10-08T19:21:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:Generating ssh key... 2021-10-08T19:21:29.375 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm generate-key 2021-10-08T19:21:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.797+0000 7f472e1c1700 1 Processor -- start 2021-10-08T19:21:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.797+0000 7f472e1c1700 1 -- start start 2021-10-08T19:21:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.797+0000 7f472e1c1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f47280fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:29.803 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.797+0000 7f472e1c1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47280fe130 con 0x7f47280fd7e0 2021-10-08T19:21:29.803 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.797+0000 7f47277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f47280fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:29.803 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.797+0000 7f47277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f47280fdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32856/0 (socket says 172.21.15.112:32856) 2021-10-08T19:21:29.803 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.797+0000 7f47277fe700 1 -- 172.21.15.112:0/3642676474 learned_addr learned my addr 172.21.15.112:0/3642676474 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:29.803 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f47277fe700 1 -- 172.21.15.112:0/3642676474 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280fe270 con 0x7f47280fd7e0 2021-10-08T19:21:29.804 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f47277fe700 1 --2- 172.21.15.112:0/3642676474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f47280fdbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f471800b5f0 tx=0x7f4718006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3600489ac13d087f server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:29.804 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f4726ffd700 1 -- 172.21.15.112:0/3642676474 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47180106d0 con 0x7f47280fd7e0 2021-10-08T19:21:29.804 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f4726ffd700 1 -- 172.21.15.112:0/3642676474 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f4718010c60 con 0x7f47280fd7e0 2021-10-08T19:21:29.804 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f4726ffd700 1 -- 172.21.15.112:0/3642676474 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4718011af0 con 0x7f47280fd7e0 2021-10-08T19:21:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f472e1c1700 1 -- 172.21.15.112:0/3642676474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 msgr2=0x7f47280fdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f472e1c1700 1 --2- 172.21.15.112:0/3642676474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f47280fdbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f471800b5f0 tx=0x7f4718006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f472e1c1700 1 -- 172.21.15.112:0/3642676474 shutdown_connections 2021-10-08T19:21:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f472e1c1700 1 --2- 172.21.15.112:0/3642676474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f47280fdbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:29.805 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.798+0000 7f472e1c1700 1 -- 172.21.15.112:0/3642676474 >> 172.21.15.112:0/3642676474 conn(0x7f47280f5f70 msgr2=0x7f47280f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:29.806 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f472e1c1700 1 -- 172.21.15.112:0/3642676474 shutdown_connections 2021-10-08T19:21:29.806 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f472e1c1700 1 -- 172.21.15.112:0/3642676474 wait complete. 2021-10-08T19:21:29.806 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f472e1c1700 1 Processor -- start 2021-10-08T19:21:29.807 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f472e1c1700 1 -- start start 2021-10-08T19:21:29.807 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f472e1c1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f472810abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:29.807 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f472e1c1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472810b120 con 0x7f47280fd7e0 2021-10-08T19:21:29.808 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f47277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f472810abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:29.808 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f47277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f472810abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32858/0 (socket says 172.21.15.112:32858) 2021-10-08T19:21:29.808 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.799+0000 7f47277fe700 1 -- 172.21.15.112:0/1121462378 learned_addr learned my addr 172.21.15.112:0/1121462378 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:29.808 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.800+0000 7f47277fe700 1 -- 172.21.15.112:0/1121462378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471800b200 con 0x7f47280fd7e0 2021-10-08T19:21:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.800+0000 7f47277fe700 1 --2- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f472810abe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f471800c010 tx=0x7f4718006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.800+0000 7f4724ff9700 1 -- 172.21.15.112:0/1121462378 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f471801b410 con 0x7f47280fd7e0 2021-10-08T19:21:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.800+0000 7f4724ff9700 1 -- 172.21.15.112:0/1121462378 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f471801b9a0 con 0x7f47280fd7e0 2021-10-08T19:21:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.800+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472810b320 con 0x7f47280fd7e0 2021-10-08T19:21:29.809 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.800+0000 7f4724ff9700 1 -- 172.21.15.112:0/1121462378 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4718023680 con 0x7f47280fd7e0 2021-10-08T19:21:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.800+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472810bfc0 con 0x7f47280fd7e0 2021-10-08T19:21:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.801+0000 7f4724ff9700 1 -- 172.21.15.112:0/1121462378 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7f471800f070 con 0x7f47280fd7e0 2021-10-08T19:21:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.801+0000 7f4724ff9700 1 --2- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f47080336e0 0x7f4708035b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.801+0000 7f4724ff9700 1 -- 172.21.15.112:0/1121462378 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4718046940 con 0x7f47280fd7e0 2021-10-08T19:21:29.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.801+0000 7f471effd700 1 --2- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f47080336e0 0x7f4708035b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.801+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472810b7b0 con 0x7f47280fd7e0 2021-10-08T19:21:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.801+0000 7f471effd700 1 --2- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f47080336e0 0x7f4708035b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f47100096a0 tx=0x7f4710006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:29.811 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.805+0000 7f4724ff9700 1 -- 172.21.15.112:0/1121462378 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f471802d440 con 0x7f47280fd7e0 2021-10-08T19:21:29.965 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:29.965+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f47280fad10 con 0x7f47080336e0 2021-10-08T19:21:30.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:29 smithi112 ceph-mon[31694]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:30.128 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.127+0000 7f4724ff9700 1 -- 172.21.15.112:0/1121462378 <== mgr.14118 v2:172.21.15.112:6800/1294788170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f47280fad10 con 0x7f47080336e0 2021-10-08T19:21:30.130 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.129+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f47080336e0 msgr2=0x7f4708035b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.129+0000 7f472e1c1700 1 --2- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f47080336e0 0x7f4708035b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f47100096a0 tx=0x7f4710006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.129+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 msgr2=0x7f472810abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.129+0000 7f472e1c1700 1 --2- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f472810abe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f471800c010 tx=0x7f4718006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:30.131 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.129+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 shutdown_connections 2021-10-08T19:21:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.129+0000 7f472e1c1700 1 --2- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f47080336e0 0x7f4708035b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.129+0000 7f472e1c1700 1 --2- 172.21.15.112:0/1121462378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47280fd7e0 0x7f472810abe0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.129+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 >> 172.21.15.112:0/1121462378 conn(0x7f47280f5f70 msgr2=0x7f47280ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:30.132 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.130+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 shutdown_connections 2021-10-08T19:21:30.133 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:30.130+0000 7f472e1c1700 1 -- 172.21.15.112:0/1121462378 wait complete. 2021-10-08T19:21:30.570 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: Generating public/private rsa key pair. 2021-10-08T19:21:30.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: Your identification has been saved in /tmp/tmpojzlcvcb/key. 2021-10-08T19:21:30.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: Your public key has been saved in /tmp/tmpojzlcvcb/key.pub. 2021-10-08T19:21:30.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: The key fingerprint is: 2021-10-08T19:21:30.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: SHA256:5pFFCCw3TvFfwoT3Pmt2Z5Ugc8APr47APnWWDsDryRk ceph-c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:30.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: The key's randomart image is: 2021-10-08T19:21:30.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: +---[RSA 3072]----+ 2021-10-08T19:21:30.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | .oo o+ | 2021-10-08T19:21:30.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | . =.o+.+ | 2021-10-08T19:21:30.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | =....+.* | 2021-10-08T19:21:30.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | .o + =.= | 2021-10-08T19:21:30.575 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | . S ..* . .| 2021-10-08T19:21:30.576 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | E + =o ..| 2021-10-08T19:21:30.576 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | + B B o .| 2021-10-08T19:21:30.576 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | B . o+ . o| 2021-10-08T19:21:30.577 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: | . o . o | 2021-10-08T19:21:30.577 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:30 smithi112 conmon[32108]: +----[SHA256]-----+ 2021-10-08T19:21:30.810 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf cephadm get-pub-key 2021-10-08T19:21:31.227 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.222+0000 7fe035aa3700 1 Processor -- start 2021-10-08T19:21:31.228 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.222+0000 7fe035aa3700 1 -- start start 2021-10-08T19:21:31.228 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.222+0000 7fe035aa3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe0300fb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:31.228 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.222+0000 7fe035aa3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300fb810 con 0x7fe0300faec0 2021-10-08T19:21:31.229 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.222+0000 7fe034aa1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe0300fb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:31.229 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.222+0000 7fe034aa1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe0300fb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32862/0 (socket says 172.21.15.112:32862) 2021-10-08T19:21:31.229 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.222+0000 7fe034aa1700 1 -- 172.21.15.112:0/2792959079 learned_addr learned my addr 172.21.15.112:0/2792959079 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:31.229 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.222+0000 7fe034aa1700 1 -- 172.21.15.112:0/2792959079 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0300fb950 con 0x7fe0300faec0 2021-10-08T19:21:31.229 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe034aa1700 1 --2- 172.21.15.112:0/2792959079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe0300fb2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe02400b5f0 tx=0x7fe024006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce92e854e377b0d server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:31.230 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe02f7fe700 1 -- 172.21.15.112:0/2792959079 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0240106d0 con 0x7fe0300faec0 2021-10-08T19:21:31.230 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe02f7fe700 1 -- 172.21.15.112:0/2792959079 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fe024010c60 con 0x7fe0300faec0 2021-10-08T19:21:31.230 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe02f7fe700 1 -- 172.21.15.112:0/2792959079 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe024011af0 con 0x7fe0300faec0 2021-10-08T19:21:31.230 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe035aa3700 1 -- 172.21.15.112:0/2792959079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 msgr2=0x7fe0300fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:31.231 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe035aa3700 1 --2- 172.21.15.112:0/2792959079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe0300fb2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe02400b5f0 tx=0x7fe024006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:31.231 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe035aa3700 1 -- 172.21.15.112:0/2792959079 shutdown_connections 2021-10-08T19:21:31.231 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe035aa3700 1 --2- 172.21.15.112:0/2792959079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe0300fb2d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:31.231 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.223+0000 7fe035aa3700 1 -- 172.21.15.112:0/2792959079 >> 172.21.15.112:0/2792959079 conn(0x7fe0300f6670 msgr2=0x7fe0300f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:31.232 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.224+0000 7fe035aa3700 1 -- 172.21.15.112:0/2792959079 shutdown_connections 2021-10-08T19:21:31.232 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.224+0000 7fe035aa3700 1 -- 172.21.15.112:0/2792959079 wait complete. 2021-10-08T19:21:31.232 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.224+0000 7fe035aa3700 1 Processor -- start 2021-10-08T19:21:31.232 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.224+0000 7fe035aa3700 1 -- start start 2021-10-08T19:21:31.232 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.224+0000 7fe035aa3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe03010d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:31.233 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.224+0000 7fe035aa3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe030070470 con 0x7fe0300faec0 2021-10-08T19:21:31.233 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.224+0000 7fe034aa1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe03010d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:31.233 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe034aa1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe03010d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32864/0 (socket says 172.21.15.112:32864) 2021-10-08T19:21:31.233 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe034aa1700 1 -- 172.21.15.112:0/3169902781 learned_addr learned my addr 172.21.15.112:0/3169902781 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:31.234 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe034aa1700 1 -- 172.21.15.112:0/3169902781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02400b200 con 0x7fe0300faec0 2021-10-08T19:21:31.234 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe034aa1700 1 --2- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe03010d750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe02400b5c0 tx=0x7fe024006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:31.234 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe02d7fa700 1 -- 172.21.15.112:0/3169902781 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe024010b00 con 0x7fe0300faec0 2021-10-08T19:21:31.234 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe02d7fa700 1 -- 172.21.15.112:0/3169902781 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7fe02401ba50 con 0x7fe0300faec0 2021-10-08T19:21:31.234 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe02d7fa700 1 -- 172.21.15.112:0/3169902781 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe024023760 con 0x7fe0300faec0 2021-10-08T19:21:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe030070670 con 0x7fe0300faec0 2021-10-08T19:21:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.225+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03010de50 con 0x7fe0300faec0 2021-10-08T19:21:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.226+0000 7fe02d7fa700 1 -- 172.21.15.112:0/3169902781 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7fe02400f070 con 0x7fe0300faec0 2021-10-08T19:21:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.226+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03005a9f0 con 0x7fe0300faec0 2021-10-08T19:21:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.226+0000 7fe02d7fa700 1 --2- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fe0140336a0 0x7fe014035b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.226+0000 7fe02d7fa700 1 -- 172.21.15.112:0/3169902781 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe024046ab0 con 0x7fe0300faec0 2021-10-08T19:21:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.226+0000 7fe02ffff700 1 --2- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fe0140336a0 0x7fe014035b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.227+0000 7fe02ffff700 1 --2- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fe0140336a0 0x7fe014035b50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0096a0 tx=0x7fe01c006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:31.238 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.230+0000 7fe02d7fa700 1 -- 172.21.15.112:0/3169902781 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fe02401bdc0 con 0x7fe0300faec0 2021-10-08T19:21:31.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:31 smithi112 ceph-mon[31694]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:31.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:31 smithi112 ceph-mon[31694]: Generating ssh key... 2021-10-08T19:21:31.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:31 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:31.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:31 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:31.391 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.390+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0300f7a40 con 0x7fe0140336a0 2021-10-08T19:21:31.391 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.391+0000 7fe02d7fa700 1 -- 172.21.15.112:0/3169902781 <== mgr.14118 v2:172.21.15.112:6800/1294788170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fe0300f7a40 con 0x7fe0140336a0 2021-10-08T19:21:31.392 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3uXfp/weXgJn9hAEmJ+4Cz/gM0hGNMkzE3KGU8JfPXLga6x4AEp0ZdHMojZEAj26OTYDvQHgIDNYJ47WMaqmLgpwjBWd1NGJfd7tJubQ8cTBul3rgcdm2+DLdL5oMorz4rILhLC6n/r9C7qfpR+S/LBHrjDeWjotIP1WhaoPHQcz0oNHUMAFcmottTu3ACo31XmPKKU5bDjxGrD483Vu8Ho7EMTfsdezhyVnxAxqNVd/5WsQxbz0J2f+ELPSzrZcx2QUQureLXKhn4UuK0YJluTdZt2YEehAv15BD5m3a306t4bbxPhdj6JuX6WhXIfHUATgN08J90sNbe7LR7UJIv5V+xZTYOw4HCPgRBlrTVzAj2+L5uDu5e5Nl66Ivb+1E95ze5NOc7h36FiqDI2PY2xH++KLq0nPnNjFDYJoRbIBYCIN4BGiYbvFmZKDM2D2ZXmac+Ngh54xH0c8GnfERx/cBx5wjHGJwvZ+DumV/DSC0/Vk3t8tlmm+o22f3GDk= ceph-c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fe0140336a0 msgr2=0x7fe014035b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 --2- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fe0140336a0 0x7fe014035b50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0096a0 tx=0x7fe01c006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:31.394 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 msgr2=0x7fe03010d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 --2- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe03010d750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe02400b5c0 tx=0x7fe024006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:31.395 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 shutdown_connections 2021-10-08T19:21:31.396 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 --2- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7fe0140336a0 0x7fe014035b50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:31.396 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 --2- 172.21.15.112:0/3169902781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300faec0 0x7fe03010d750 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:31.397 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 >> 172.21.15.112:0/3169902781 conn(0x7fe0300f6670 msgr2=0x7fe0300f7330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:31.397 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 shutdown_connections 2021-10-08T19:21:31.397 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:31.393+0000 7fe035aa3700 1 -- 172.21.15.112:0/3169902781 wait complete. 2021-10-08T19:21:31.946 INFO:teuthology.orchestra.run.smithi112.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2021-10-08T19:21:31.946 INFO:teuthology.orchestra.run.smithi112.stderr:Adding key to root@localhost authorized_keys... 2021-10-08T19:21:31.947 INFO:teuthology.orchestra.run.smithi112.stderr:Adding host smithi112... 2021-10-08T19:21:31.947 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch host add smithi112 172.21.15.112 2021-10-08T19:21:32.192 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:32 smithi112 ceph-mon[31694]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:32.421 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.415+0000 7f0007994700 1 Processor -- start 2021-10-08T19:21:32.421 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.415+0000 7f0007994700 1 -- start start 2021-10-08T19:21:32.421 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.415+0000 7f0007994700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f00001011f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.415+0000 7f0007994700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000fcbe0 con 0x7f0000070430 2021-10-08T19:21:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.415+0000 7f0005730700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f00001011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.416+0000 7f0005730700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f00001011f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32868/0 (socket says 172.21.15.112:32868) 2021-10-08T19:21:32.422 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.416+0000 7f0005730700 1 -- 172.21.15.112:0/192831976 learned_addr learned my addr 172.21.15.112:0/192831976 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.416+0000 7f0005730700 1 -- 172.21.15.112:0/192831976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000101730 con 0x7f0000070430 2021-10-08T19:21:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.416+0000 7f0005730700 1 --2- 172.21.15.112:0/192831976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f00001011f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efffc009960 tx=0x7efffc0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a6860a2cbb8f74 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:32.423 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.416+0000 7effeffff700 1 -- 172.21.15.112:0/192831976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efffc00b860 con 0x7f0000070430 2021-10-08T19:21:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.416+0000 7effeffff700 1 -- 172.21.15.112:0/192831976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7efffc00bdf0 con 0x7f0000070430 2021-10-08T19:21:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.416+0000 7effeffff700 1 -- 172.21.15.112:0/192831976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efffc011be0 con 0x7f0000070430 2021-10-08T19:21:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 -- 172.21.15.112:0/192831976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 msgr2=0x7f00001011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 --2- 172.21.15.112:0/192831976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f00001011f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efffc009960 tx=0x7efffc0092d0 comp rx=0 tx=0).stop 2021-10-08T19:21:32.424 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 -- 172.21.15.112:0/192831976 shutdown_connections 2021-10-08T19:21:32.425 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 --2- 172.21.15.112:0/192831976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f00001011f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:32.425 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 -- 172.21.15.112:0/192831976 >> 172.21.15.112:0/192831976 conn(0x7f00000f6800 msgr2=0x7f00000f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:32.425 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 -- 172.21.15.112:0/192831976 shutdown_connections 2021-10-08T19:21:32.425 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 -- 172.21.15.112:0/192831976 wait complete. 2021-10-08T19:21:32.426 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 Processor -- start 2021-10-08T19:21:32.426 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.417+0000 7f0007994700 1 -- start start 2021-10-08T19:21:32.426 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7f0007994700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f000010cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:32.426 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7f0007994700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000010d400 con 0x7f0000070430 2021-10-08T19:21:32.427 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7f0005730700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f000010cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:32.427 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7f0005730700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f000010cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32870/0 (socket says 172.21.15.112:32870) 2021-10-08T19:21:32.427 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7f0005730700 1 -- 172.21.15.112:0/1190859181 learned_addr learned my addr 172.21.15.112:0/1190859181 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:32.427 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7f0005730700 1 -- 172.21.15.112:0/1190859181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc009570 con 0x7f0000070430 2021-10-08T19:21:32.427 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7f0005730700 1 --2- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f000010cec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efffc0117a0 tx=0x7efffc0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:32.428 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7effedffb700 1 -- 172.21.15.112:0/1190859181 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efffc011ea0 con 0x7f0000070430 2021-10-08T19:21:32.428 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7effedffb700 1 -- 172.21.15.112:0/1190859181 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7efffc01aaa0 con 0x7f0000070430 2021-10-08T19:21:32.428 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7effedffb700 1 -- 172.21.15.112:0/1190859181 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efffc0226f0 con 0x7f0000070430 2021-10-08T19:21:32.428 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.418+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000010d600 con 0x7f0000070430 2021-10-08T19:21:32.429 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.419+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000010e1c0 con 0x7f0000070430 2021-10-08T19:21:32.429 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.419+0000 7effedffb700 1 -- 172.21.15.112:0/1190859181 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7efffc02a070 con 0x7f0000070430 2021-10-08T19:21:32.429 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.419+0000 7effedffb700 1 --2- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7effe8033650 0x7effe8035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:32.430 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.419+0000 7effedffb700 1 -- 172.21.15.112:0/1190859181 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7efffc046220 con 0x7f0000070430 2021-10-08T19:21:32.430 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.420+0000 7f0004f2f700 1 --2- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7effe8033650 0x7effe8035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:32.430 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.420+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000005a9f0 con 0x7f0000070430 2021-10-08T19:21:32.430 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.420+0000 7f0004f2f700 1 --2- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7effe8033650 0x7effe8035b00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efff00096a0 tx=0x7efff0006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:32.431 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.424+0000 7effedffb700 1 -- 172.21.15.112:0/1190859181 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7efffc01e080 con 0x7f0000070430 2021-10-08T19:21:32.583 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:32.583+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi112", "addr": "172.21.15.112", "target": ["mon-mgr", ""]}) v1 -- 0x7f00001023d0 con 0x7effe8033650 2021-10-08T19:21:33.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:33 smithi112 ceph-mon[31694]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "addr": "172.21.15.112", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:33.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:33 smithi112 ceph-mon[31694]: poll took 7258.815 ms: 1 events 2021-10-08T19:21:33.547 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: Added host 'smithi112' with addr '172.21.15.112' 2021-10-08T19:21:33.547 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.545+0000 7effedffb700 1 -- 172.21.15.112:0/1190859181 <== mgr.14118 v2:172.21.15.112:6800/1294788170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f00001023d0 con 0x7effe8033650 2021-10-08T19:21:33.549 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.548+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7effe8033650 msgr2=0x7effe8035b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:33.549 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.548+0000 7f0007994700 1 --2- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7effe8033650 0x7effe8035b00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efff00096a0 tx=0x7efff0006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:33.549 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.548+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 msgr2=0x7f000010cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:33.549 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.548+0000 7f0007994700 1 --2- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f000010cec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efffc0117a0 tx=0x7efffc0092d0 comp rx=0 tx=0).stop 2021-10-08T19:21:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.548+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 shutdown_connections 2021-10-08T19:21:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.548+0000 7f0007994700 1 --2- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7effe8033650 0x7effe8035b00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.548+0000 7f0007994700 1 --2- 172.21.15.112:0/1190859181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0000070430 0x7f000010cec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.548+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 >> 172.21.15.112:0/1190859181 conn(0x7f00000f6800 msgr2=0x7f00000f75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:33.551 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.549+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 shutdown_connections 2021-10-08T19:21:33.551 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:33.549+0000 7f0007994700 1 -- 172.21.15.112:0/1190859181 wait complete. 2021-10-08T19:21:34.284 INFO:teuthology.orchestra.run.smithi112.stderr:Deploying unmanaged mon service... 2021-10-08T19:21:34.284 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch apply mon --unmanaged 2021-10-08T19:21:34.802 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.792+0000 7eff9e616700 1 Processor -- start 2021-10-08T19:21:34.802 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.792+0000 7eff9e616700 1 -- start start 2021-10-08T19:21:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.792+0000 7eff9e616700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff980fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.792+0000 7eff9e616700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff980ff330 con 0x7eff98070430 2021-10-08T19:21:34.803 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.792+0000 7eff97fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff980fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:34.804 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.792+0000 7eff97fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff980fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32884/0 (socket says 172.21.15.112:32884) 2021-10-08T19:21:34.804 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.792+0000 7eff97fff700 1 -- 172.21.15.112:0/1056289835 learned_addr learned my addr 172.21.15.112:0/1056289835 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:34.805 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff97fff700 1 -- 172.21.15.112:0/1056289835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980ff470 con 0x7eff98070430 2021-10-08T19:21:34.805 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff97fff700 1 --2- 172.21.15.112:0/1056289835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff980fedf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff8800b5f0 tx=0x7eff88006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a026c3b6215d6613 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff96ffd700 1 -- 172.21.15.112:0/1056289835 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff880106d0 con 0x7eff98070430 2021-10-08T19:21:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff96ffd700 1 -- 172.21.15.112:0/1056289835 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7eff88010c60 con 0x7eff98070430 2021-10-08T19:21:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff96ffd700 1 -- 172.21.15.112:0/1056289835 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff88011af0 con 0x7eff98070430 2021-10-08T19:21:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff9e616700 1 -- 172.21.15.112:0/1056289835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 msgr2=0x7eff980fedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff9e616700 1 --2- 172.21.15.112:0/1056289835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff980fedf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff8800b5f0 tx=0x7eff88006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:34.808 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff9e616700 1 -- 172.21.15.112:0/1056289835 shutdown_connections 2021-10-08T19:21:34.808 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff9e616700 1 --2- 172.21.15.112:0/1056289835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff980fedf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:34.809 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff9e616700 1 -- 172.21.15.112:0/1056289835 >> 172.21.15.112:0/1056289835 conn(0x7eff980f6800 msgr2=0x7eff980f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:34.809 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.793+0000 7eff9e616700 1 -- 172.21.15.112:0/1056289835 shutdown_connections 2021-10-08T19:21:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.794+0000 7eff9e616700 1 -- 172.21.15.112:0/1056289835 wait complete. 2021-10-08T19:21:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.794+0000 7eff9e616700 1 Processor -- start 2021-10-08T19:21:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.794+0000 7eff9e616700 1 -- start start 2021-10-08T19:21:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.794+0000 7eff9e616700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff9810ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.794+0000 7eff9e616700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9810b220 con 0x7eff98070430 2021-10-08T19:21:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.794+0000 7eff97fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff9810ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff97fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff9810ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32886/0 (socket says 172.21.15.112:32886) 2021-10-08T19:21:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff97fff700 1 -- 172.21.15.112:0/2901053204 learned_addr learned my addr 172.21.15.112:0/2901053204 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff97fff700 1 -- 172.21.15.112:0/2901053204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8800b200 con 0x7eff98070430 2021-10-08T19:21:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff97fff700 1 --2- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff9810ace0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff8800b5c0 tx=0x7eff88006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff94ff9700 1 -- 172.21.15.112:0/2901053204 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff8801b410 con 0x7eff98070430 2021-10-08T19:21:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9810b420 con 0x7eff98070430 2021-10-08T19:21:34.812 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff94ff9700 1 -- 172.21.15.112:0/2901053204 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7eff8801b9a0 con 0x7eff98070430 2021-10-08T19:21:34.813 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff94ff9700 1 -- 172.21.15.112:0/2901053204 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff88023610 con 0x7eff98070430 2021-10-08T19:21:34.813 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.795+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9810bf80 con 0x7eff98070430 2021-10-08T19:21:34.813 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.796+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9805a9f0 con 0x7eff98070430 2021-10-08T19:21:34.813 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.796+0000 7eff94ff9700 1 -- 172.21.15.112:0/2901053204 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7eff8800f070 con 0x7eff98070430 2021-10-08T19:21:34.813 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.796+0000 7eff94ff9700 1 --2- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7eff84033650 0x7eff84035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.796+0000 7eff94ff9700 1 -- 172.21.15.112:0/2901053204 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7eff880469f0 con 0x7eff98070430 2021-10-08T19:21:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.796+0000 7eff977fe700 1 --2- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7eff84033650 0x7eff84035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.797+0000 7eff977fe700 1 --2- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7eff84033650 0x7eff84035b00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0096a0 tx=0x7eff8c006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.800+0000 7eff94ff9700 1 -- 172.21.15.112:0/2901053204 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7eff88048e60 con 0x7eff98070430 2021-10-08T19:21:34.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:34 smithi112 ceph-mon[31694]: Deploying cephadm binary to smithi112 2021-10-08T19:21:34.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:34 smithi112 ceph-mon[31694]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.155 seconds 2021-10-08T19:21:34.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:34 smithi112 ceph-mon[31694]: Executing took 0.145 seconds 2021-10-08T19:21:34.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:34 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:34.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:34 smithi112 ceph-mon[31694]: Added host smithi112 2021-10-08T19:21:34.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:34 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:34.986 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.985+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7eff980f7cb0 con 0x7eff84033650 2021-10-08T19:21:34.990 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.990+0000 7eff94ff9700 1 -- 172.21.15.112:0/2901053204 <== mgr.14118 v2:172.21.15.112:6800/1294788170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7eff980f7cb0 con 0x7eff84033650 2021-10-08T19:21:34.990 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: Scheduled mon update... 2021-10-08T19:21:34.992 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.991+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7eff84033650 msgr2=0x7eff84035b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.991+0000 7eff9e616700 1 --2- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7eff84033650 0x7eff84035b00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0096a0 tx=0x7eff8c006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.991+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 msgr2=0x7eff9810ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.991+0000 7eff9e616700 1 --2- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff9810ace0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff8800b5c0 tx=0x7eff88006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:34.993 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.992+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 shutdown_connections 2021-10-08T19:21:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.992+0000 7eff9e616700 1 --2- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7eff84033650 0x7eff84035b00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.992+0000 7eff9e616700 1 --2- 172.21.15.112:0/2901053204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff98070430 0x7eff9810ace0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.992+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 >> 172.21.15.112:0/2901053204 conn(0x7eff980f6800 msgr2=0x7eff980f75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:34.994 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.992+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 shutdown_connections 2021-10-08T19:21:34.995 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:34.992+0000 7eff9e616700 1 -- 172.21.15.112:0/2901053204 wait complete. 2021-10-08T19:21:35.820 INFO:teuthology.orchestra.run.smithi112.stderr:Deploying unmanaged mgr service... 2021-10-08T19:21:35.820 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf orch apply mgr --unmanaged 2021-10-08T19:21:36.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:35 smithi112 ceph-mon[31694]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:36.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:35 smithi112 ceph-mon[31694]: Saving service mon spec with placement count:5 2021-10-08T19:21:36.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:35 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:36.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.340+0000 7f8eb89c6700 1 Processor -- start 2021-10-08T19:21:36.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.341+0000 7f8eb89c6700 1 -- start start 2021-10-08T19:21:36.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.341+0000 7f8eb89c6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:36.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.341+0000 7f8eb89c6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4072920 con 0x7f8eb4072510 2021-10-08T19:21:36.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.341+0000 7f8eb259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.341+0000 7f8eb259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb4070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32890/0 (socket says 172.21.15.112:32890) 2021-10-08T19:21:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.341+0000 7f8eb259c700 1 -- 172.21.15.112:0/2392579064 learned_addr learned my addr 172.21.15.112:0/2392579064 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.341+0000 7f8eb259c700 1 -- 172.21.15.112:0/2392579064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4070ff0 con 0x7f8eb4072510 2021-10-08T19:21:36.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.341+0000 7f8eb259c700 1 --2- 172.21.15.112:0/2392579064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb4070ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b5f0 tx=0x7f8ea4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b861b3794c72cf server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb159a700 1 -- 172.21.15.112:0/2392579064 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ea40106d0 con 0x7f8eb4072510 2021-10-08T19:21:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb159a700 1 -- 172.21.15.112:0/2392579064 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f8ea4010c60 con 0x7f8eb4072510 2021-10-08T19:21:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb159a700 1 -- 172.21.15.112:0/2392579064 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4011af0 con 0x7f8eb4072510 2021-10-08T19:21:36.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb89c6700 1 -- 172.21.15.112:0/2392579064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 msgr2=0x7f8eb4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb89c6700 1 --2- 172.21.15.112:0/2392579064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb4070ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b5f0 tx=0x7f8ea4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb89c6700 1 -- 172.21.15.112:0/2392579064 shutdown_connections 2021-10-08T19:21:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb89c6700 1 --2- 172.21.15.112:0/2392579064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb4070ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb89c6700 1 -- 172.21.15.112:0/2392579064 >> 172.21.15.112:0/2392579064 conn(0x7f8eb40f7910 msgr2=0x7f8eb40f9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:36.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb89c6700 1 -- 172.21.15.112:0/2392579064 shutdown_connections 2021-10-08T19:21:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.342+0000 7f8eb89c6700 1 -- 172.21.15.112:0/2392579064 wait complete. 2021-10-08T19:21:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb89c6700 1 Processor -- start 2021-10-08T19:21:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb89c6700 1 -- start start 2021-10-08T19:21:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb89c6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb410cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:36.351 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb89c6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb410d400 con 0x7f8eb4072510 2021-10-08T19:21:36.351 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb410cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:36.351 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb410cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32892/0 (socket says 172.21.15.112:32892) 2021-10-08T19:21:36.351 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb259c700 1 -- 172.21.15.112:0/3239242296 learned_addr learned my addr 172.21.15.112:0/3239242296 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:36.351 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb259c700 1 -- 172.21.15.112:0/3239242296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea400b200 con 0x7f8eb4072510 2021-10-08T19:21:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8eb259c700 1 --2- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb410cec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b5c0 tx=0x7f8ea4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.343+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3239242296 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4010b00 con 0x7f8eb4072510 2021-10-08T19:21:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.344+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3239242296 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 951+0+0 (secure 0 0 0) 0x7f8ea401ba50 con 0x7f8eb4072510 2021-10-08T19:21:36.352 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.344+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3239242296 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4023680 con 0x7f8eb4072510 2021-10-08T19:21:36.353 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.344+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb410d600 con 0x7f8eb4072510 2021-10-08T19:21:36.353 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.344+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb410e160 con 0x7f8eb4072510 2021-10-08T19:21:36.353 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.344+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb405a9f0 con 0x7f8eb4072510 2021-10-08T19:21:36.353 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.344+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3239242296 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7f8ea400f070 con 0x7f8eb4072510 2021-10-08T19:21:36.353 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.345+0000 7f8ea2ffd700 1 --2- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f8e980336a0 0x7f8e98035b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:36.354 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.345+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3239242296 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8ea4046b20 con 0x7f8eb4072510 2021-10-08T19:21:36.355 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.346+0000 7f8eb1d9b700 1 --2- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f8e980336a0 0x7f8e98035b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:36.355 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.346+0000 7f8eb1d9b700 1 --2- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f8e980336a0 0x7f8e98035b50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80096a0 tx=0x7f8ea8006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:36.355 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.349+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3239242296 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f8ea401b620 con 0x7f8eb4072510 2021-10-08T19:21:36.518 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.518+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8eb40f8e00 con 0x7f8e980336a0 2021-10-08T19:21:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.521+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3239242296 <== mgr.14118 v2:172.21.15.112:6800/1294788170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8eb40f8e00 con 0x7f8e980336a0 2021-10-08T19:21:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: Scheduled mgr update... 2021-10-08T19:21:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.523+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f8e980336a0 msgr2=0x7f8e98035b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.523+0000 7f8eb89c6700 1 --2- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f8e980336a0 0x7f8e98035b50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80096a0 tx=0x7f8ea8006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.523+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 msgr2=0x7f8eb410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.523+0000 7f8eb89c6700 1 --2- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb410cec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b5c0 tx=0x7f8ea4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.523+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 shutdown_connections 2021-10-08T19:21:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.523+0000 7f8eb89c6700 1 --2- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f8e980336a0 0x7f8e98035b50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.523+0000 7f8eb89c6700 1 --2- 172.21.15.112:0/3239242296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8eb4072510 0x7f8eb410cec0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.523+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 >> 172.21.15.112:0/3239242296 conn(0x7f8eb40f7910 msgr2=0x7f8eb40f86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.524+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 shutdown_connections 2021-10-08T19:21:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:36.524+0000 7f8eb89c6700 1 -- 172.21.15.112:0/3239242296 wait complete. 2021-10-08T19:21:37.360 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mgr mgr/cephadm/container_init True --force 2021-10-08T19:21:37.807 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:37 smithi112 ceph-mon[31694]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:37.807 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:37 smithi112 ceph-mon[31694]: Saving service mgr spec with placement count:2 2021-10-08T19:21:37.808 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:37 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:37.808 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:37 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:37.850 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.846+0000 7f3a9a1e8700 1 Processor -- start 2021-10-08T19:21:37.850 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.846+0000 7f3a9a1e8700 1 -- start start 2021-10-08T19:21:37.850 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.847+0000 7f3a9a1e8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a940fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:37.851 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.847+0000 7f3a9a1e8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940fb100 con 0x7f3a940fa7b0 2021-10-08T19:21:37.851 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.847+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a940fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:37.851 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.847+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a940fabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32896/0 (socket says 172.21.15.112:32896) 2021-10-08T19:21:37.851 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.847+0000 7f3a937fe700 1 -- 172.21.15.112:0/1881831512 learned_addr learned my addr 172.21.15.112:0/1881831512 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:37.852 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.847+0000 7f3a937fe700 1 -- 172.21.15.112:0/1881831512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940fb240 con 0x7f3a940fa7b0 2021-10-08T19:21:37.852 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.847+0000 7f3a937fe700 1 --2- 172.21.15.112:0/1881831512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a940fabc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400d900 tx=0x7f3a84006e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb20d8fc86ab5d7 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:37.852 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a927fc700 1 -- 172.21.15.112:0/1881831512 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a8400baf0 con 0x7f3a940fa7b0 2021-10-08T19:21:37.852 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a927fc700 1 -- 172.21.15.112:0/1881831512 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3a8400bc50 con 0x7f3a940fa7b0 2021-10-08T19:21:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a927fc700 1 -- 172.21.15.112:0/1881831512 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a84016530 con 0x7f3a940fa7b0 2021-10-08T19:21:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/1881831512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 msgr2=0x7f3a940fabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a9a1e8700 1 --2- 172.21.15.112:0/1881831512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a940fabc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400d900 tx=0x7f3a84006e70 comp rx=0 tx=0).stop 2021-10-08T19:21:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/1881831512 shutdown_connections 2021-10-08T19:21:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a9a1e8700 1 --2- 172.21.15.112:0/1881831512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a940fabc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/1881831512 >> 172.21.15.112:0/1881831512 conn(0x7f3a940f5f60 msgr2=0x7f3a940f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/1881831512 shutdown_connections 2021-10-08T19:21:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.848+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/1881831512 wait complete. 2021-10-08T19:21:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.849+0000 7f3a9a1e8700 1 Processor -- start 2021-10-08T19:21:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.849+0000 7f3a9a1e8700 1 -- start start 2021-10-08T19:21:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.849+0000 7f3a9a1e8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a94108a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.849+0000 7f3a9a1e8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a94108f80 con 0x7f3a940fa7b0 2021-10-08T19:21:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.849+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a94108a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:37.857 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a94108a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32898/0 (socket says 172.21.15.112:32898) 2021-10-08T19:21:37.857 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a937fe700 1 -- 172.21.15.112:0/302964081 learned_addr learned my addr 172.21.15.112:0/302964081 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:37.857 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a937fe700 1 -- 172.21.15.112:0/302964081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8400d510 con 0x7f3a940fa7b0 2021-10-08T19:21:37.857 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a937fe700 1 --2- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a94108a40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400b6d0 tx=0x7f3a84006e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:37.858 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a7bfff700 1 -- 172.21.15.112:0/302964081 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a8400baf0 con 0x7f3a940fa7b0 2021-10-08T19:21:37.858 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a7bfff700 1 -- 172.21.15.112:0/302964081 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3a84016d90 con 0x7f3a940fa7b0 2021-10-08T19:21:37.858 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a94109180 con 0x7f3a940fa7b0 2021-10-08T19:21:37.858 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a7bfff700 1 -- 172.21.15.112:0/302964081 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a8400cea0 con 0x7f3a940fa7b0 2021-10-08T19:21:37.859 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.850+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a94109e20 con 0x7f3a940fa7b0 2021-10-08T19:21:37.859 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.851+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a94109610 con 0x7f3a940fa7b0 2021-10-08T19:21:37.859 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.852+0000 7f3a7bfff700 1 -- 172.21.15.112:0/302964081 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7f3a8402f070 con 0x7f3a940fa7b0 2021-10-08T19:21:37.859 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.852+0000 7f3a7bfff700 1 --2- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f3a800336a0 0x7f3a80035b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:37.860 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.852+0000 7f3a7bfff700 1 -- 172.21.15.112:0/302964081 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3a84048a10 con 0x7f3a940fa7b0 2021-10-08T19:21:37.860 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.853+0000 7f3a92ffd700 1 --2- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f3a800336a0 0x7f3a80035b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:37.860 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.853+0000 7f3a92ffd700 1 --2- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f3a800336a0 0x7f3a80035b50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a880096a0 tx=0x7f3a88006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:37.860 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:37.856+0000 7f3a7bfff700 1 -- 172.21.15.112:0/302964081 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3a84027590 con 0x7f3a940fa7b0 2021-10-08T19:21:38.023 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.022+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f3a9405a9f0 con 0x7f3a940fa7b0 2021-10-08T19:21:38.025 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.025+0000 7f3a7bfff700 1 -- 172.21.15.112:0/302964081 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f3a84023030 con 0x7f3a940fa7b0 2021-10-08T19:21:38.028 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f3a800336a0 msgr2=0x7f3a80035b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:38.028 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 --2- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f3a800336a0 0x7f3a80035b50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a880096a0 tx=0x7f3a88006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:38.029 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 msgr2=0x7f3a94108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:38.029 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 --2- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a94108a40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400b6d0 tx=0x7f3a84006e70 comp rx=0 tx=0).stop 2021-10-08T19:21:38.029 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 shutdown_connections 2021-10-08T19:21:38.029 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 --2- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f3a800336a0 0x7f3a80035b50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:38.030 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 --2- 172.21.15.112:0/302964081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a940fa7b0 0x7f3a94108a40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:38.030 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 >> 172.21.15.112:0/302964081 conn(0x7f3a940f5f60 msgr2=0x7f3a940ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:38.030 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 shutdown_connections 2021-10-08T19:21:38.030 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:38.027+0000 7f3a9a1e8700 1 -- 172.21.15.112:0/302964081 wait complete. 2021-10-08T19:21:38.697 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config set mgr mgr/dashboard/ssl_server_port 8443 2021-10-08T19:21:38.901 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: poll took 3157.145 ms: 1 events 2021-10-08T19:21:38.901 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:38.902 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:38.902 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:38.902 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' 2021-10-08T19:21:38.902 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:38.903 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]: dispatch 2021-10-08T19:21:38.903 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: from='mgr.14118 172.21.15.112:0/627942070' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]': finished 2021-10-08T19:21:38.903 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/302964081' entity='client.admin' 2021-10-08T19:21:39.155 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.149+0000 7f1ada84c700 1 Processor -- start 2021-10-08T19:21:39.155 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.149+0000 7f1ada84c700 1 -- start start 2021-10-08T19:21:39.156 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ada84c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad4101210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:39.156 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ada84c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40fcc00 con 0x7f1ad4070430 2021-10-08T19:21:39.156 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ad3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad4101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:39.156 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ad3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad4101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32902/0 (socket says 172.21.15.112:32902) 2021-10-08T19:21:39.156 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ad3fff700 1 -- 172.21.15.112:0/940702560 learned_addr learned my addr 172.21.15.112:0/940702560 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:39.157 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ad3fff700 1 -- 172.21.15.112:0/940702560 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4101750 con 0x7f1ad4070430 2021-10-08T19:21:39.157 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ad3fff700 1 --2- 172.21.15.112:0/940702560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad4101210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400b5f0 tx=0x7f1ac4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50e0d74c6f62dda server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:39.157 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ad2ffd700 1 -- 172.21.15.112:0/940702560 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40106d0 con 0x7f1ad4070430 2021-10-08T19:21:39.157 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ad2ffd700 1 -- 172.21.15.112:0/940702560 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1ac4010c80 con 0x7f1ad4070430 2021-10-08T19:21:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.150+0000 7f1ad2ffd700 1 -- 172.21.15.112:0/940702560 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac4011b30 con 0x7f1ad4070430 2021-10-08T19:21:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.151+0000 7f1ada84c700 1 -- 172.21.15.112:0/940702560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 msgr2=0x7f1ad4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.151+0000 7f1ada84c700 1 --2- 172.21.15.112:0/940702560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad4101210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400b5f0 tx=0x7f1ac4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.151+0000 7f1ada84c700 1 -- 172.21.15.112:0/940702560 shutdown_connections 2021-10-08T19:21:39.158 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.151+0000 7f1ada84c700 1 --2- 172.21.15.112:0/940702560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad4101210 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.151+0000 7f1ada84c700 1 -- 172.21.15.112:0/940702560 >> 172.21.15.112:0/940702560 conn(0x7f1ad40f6840 msgr2=0x7f1ad40f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.151+0000 7f1ada84c700 1 -- 172.21.15.112:0/940702560 shutdown_connections 2021-10-08T19:21:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.151+0000 7f1ada84c700 1 -- 172.21.15.112:0/940702560 wait complete. 2021-10-08T19:21:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.152+0000 7f1ada84c700 1 Processor -- start 2021-10-08T19:21:39.159 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.152+0000 7f1ada84c700 1 -- start start 2021-10-08T19:21:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.152+0000 7f1ada84c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad410ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.152+0000 7f1ada84c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad410d410 con 0x7f1ad4070430 2021-10-08T19:21:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.152+0000 7f1ad3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad410ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:39.160 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.152+0000 7f1ad3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad410ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32904/0 (socket says 172.21.15.112:32904) 2021-10-08T19:21:39.161 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.152+0000 7f1ad3fff700 1 -- 172.21.15.112:0/1394265193 learned_addr learned my addr 172.21.15.112:0/1394265193 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:39.161 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.152+0000 7f1ad3fff700 1 -- 172.21.15.112:0/1394265193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac400b200 con 0x7f1ad4070430 2021-10-08T19:21:39.161 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.153+0000 7f1ad3fff700 1 --2- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad410ced0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400c010 tx=0x7f1ac4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:39.161 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.153+0000 7f1ad0ff9700 1 -- 172.21.15.112:0/1394265193 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac401b410 con 0x7f1ad4070430 2021-10-08T19:21:39.161 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.153+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad410d610 con 0x7f1ad4070430 2021-10-08T19:21:39.162 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.153+0000 7f1ad0ff9700 1 -- 172.21.15.112:0/1394265193 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1ac401b9c0 con 0x7f1ad4070430 2021-10-08T19:21:39.162 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.153+0000 7f1ad0ff9700 1 -- 172.21.15.112:0/1394265193 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40236e0 con 0x7f1ad4070430 2021-10-08T19:21:39.162 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.153+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad410e2b0 con 0x7f1ad4070430 2021-10-08T19:21:39.162 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.153+0000 7f1ad0ff9700 1 -- 172.21.15.112:0/1394265193 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7f1ac400f070 con 0x7f1ad4070430 2021-10-08T19:21:39.162 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.154+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad410daa0 con 0x7f1ad4070430 2021-10-08T19:21:39.163 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.154+0000 7f1ad0ff9700 1 --2- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f1ac0033650 0x7f1ac0035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:39.163 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.154+0000 7f1ad0ff9700 1 -- 172.21.15.112:0/1394265193 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1ac4046910 con 0x7f1ad4070430 2021-10-08T19:21:39.163 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.154+0000 7f1ad37fe700 1 --2- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f1ac0033650 0x7f1ac0035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:39.163 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.154+0000 7f1ad37fe700 1 --2- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f1ac0033650 0x7f1ac0035b00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80096a0 tx=0x7f1ac8006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:39.164 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.158+0000 7f1ad0ff9700 1 -- 172.21.15.112:0/1394265193 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1ac402d440 con 0x7f1ad4070430 2021-10-08T19:21:39.316 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.316+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f1ad4102420 con 0x7f1ad4070430 2021-10-08T19:21:39.319 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.319+0000 7f1ad0ff9700 1 -- 172.21.15.112:0/1394265193 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1ad4102420 con 0x7f1ad4070430 2021-10-08T19:21:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f1ac0033650 msgr2=0x7f1ac0035b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 --2- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f1ac0033650 0x7f1ac0035b00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80096a0 tx=0x7f1ac8006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:39.323 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 msgr2=0x7f1ad410ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:39.324 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 --2- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad410ced0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400c010 tx=0x7f1ac4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:39.324 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 shutdown_connections 2021-10-08T19:21:39.324 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 --2- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f1ac0033650 0x7f1ac0035b00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:39.324 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 --2- 172.21.15.112:0/1394265193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad4070430 0x7f1ad410ced0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:39.324 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 >> 172.21.15.112:0/1394265193 conn(0x7f1ad40f6840 msgr2=0x7f1ad40f7640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:39.325 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 shutdown_connections 2021-10-08T19:21:39.326 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:39.321+0000 7f1ada84c700 1 -- 172.21.15.112:0/1394265193 wait complete. 2021-10-08T19:21:39.832 INFO:teuthology.orchestra.run.smithi112.stderr:Enabling the dashboard module... 2021-10-08T19:21:39.853 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr module enable dashboard 2021-10-08T19:21:39.941 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:39 smithi112 ceph-mon[31694]: Deploying daemon agent.smithi112 on smithi112 2021-10-08T19:21:39.942 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:39 smithi112 ceph-mon[31694]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.174 seconds 2021-10-08T19:21:39.942 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1394265193' entity='client.admin' 2021-10-08T19:21:40.269 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.264+0000 7ff609afe700 1 Processor -- start 2021-10-08T19:21:40.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.264+0000 7ff609afe700 1 -- start start 2021-10-08T19:21:40.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.264+0000 7ff609afe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff604101230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:40.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.264+0000 7ff609afe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040fcc20 con 0x7ff6040703f0 2021-10-08T19:21:40.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.265+0000 7ff6037fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff604101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:40.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.265+0000 7ff6037fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff604101230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32908/0 (socket says 172.21.15.112:32908) 2021-10-08T19:21:40.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.265+0000 7ff6037fe700 1 -- 172.21.15.112:0/3392226994 learned_addr learned my addr 172.21.15.112:0/3392226994 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:40.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.265+0000 7ff6037fe700 1 -- 172.21.15.112:0/3392226994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604101770 con 0x7ff6040703f0 2021-10-08T19:21:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.265+0000 7ff6037fe700 1 --2- 172.21.15.112:0/3392226994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff604101230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400b5f0 tx=0x7ff5f4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a29805cccb11b8f server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.265+0000 7ff6027fc700 1 -- 172.21.15.112:0/3392226994 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5f40106d0 con 0x7ff6040703f0 2021-10-08T19:21:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.265+0000 7ff6027fc700 1 -- 172.21.15.112:0/3392226994 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff5f4010c80 con 0x7ff6040703f0 2021-10-08T19:21:40.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.265+0000 7ff6027fc700 1 -- 172.21.15.112:0/3392226994 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5f4011b30 con 0x7ff6040703f0 2021-10-08T19:21:40.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.266+0000 7ff609afe700 1 -- 172.21.15.112:0/3392226994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 msgr2=0x7ff604101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:40.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.266+0000 7ff609afe700 1 --2- 172.21.15.112:0/3392226994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff604101230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400b5f0 tx=0x7ff5f4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:40.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.266+0000 7ff609afe700 1 -- 172.21.15.112:0/3392226994 shutdown_connections 2021-10-08T19:21:40.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.266+0000 7ff609afe700 1 --2- 172.21.15.112:0/3392226994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff604101230 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:40.273 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.266+0000 7ff609afe700 1 -- 172.21.15.112:0/3392226994 >> 172.21.15.112:0/3392226994 conn(0x7ff6040f6800 msgr2=0x7ff6040f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:40.274 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.266+0000 7ff609afe700 1 -- 172.21.15.112:0/3392226994 shutdown_connections 2021-10-08T19:21:40.274 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.266+0000 7ff609afe700 1 -- 172.21.15.112:0/3392226994 wait complete. 2021-10-08T19:21:40.274 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.266+0000 7ff609afe700 1 Processor -- start 2021-10-08T19:21:40.275 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff609afe700 1 -- start start 2021-10-08T19:21:40.275 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff609afe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff60410cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:40.275 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff609afe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60410d400 con 0x7ff6040703f0 2021-10-08T19:21:40.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff6037fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff60410cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:40.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff6037fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff60410cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32910/0 (socket says 172.21.15.112:32910) 2021-10-08T19:21:40.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff6037fe700 1 -- 172.21.15.112:0/1133139409 learned_addr learned my addr 172.21.15.112:0/1133139409 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:40.276 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff6037fe700 1 -- 172.21.15.112:0/1133139409 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f400b200 con 0x7ff6040703f0 2021-10-08T19:21:40.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff6037fe700 1 --2- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff60410cec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400c010 tx=0x7ff5f4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:40.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff5ebfff700 1 -- 172.21.15.112:0/1133139409 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5f401b410 con 0x7ff6040703f0 2021-10-08T19:21:40.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff5ebfff700 1 -- 172.21.15.112:0/1133139409 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff5f401b9c0 con 0x7ff6040703f0 2021-10-08T19:21:40.277 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60410d600 con 0x7ff6040703f0 2021-10-08T19:21:40.278 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff5ebfff700 1 -- 172.21.15.112:0/1133139409 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5f40236a0 con 0x7ff6040703f0 2021-10-08T19:21:40.278 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.267+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60410e2a0 con 0x7ff6040703f0 2021-10-08T19:21:40.278 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.268+0000 7ff5ebfff700 1 -- 172.21.15.112:0/1133139409 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 8) v1 ==== 40497+0+0 (secure 0 0 0) 0x7ff5f400f070 con 0x7ff6040703f0 2021-10-08T19:21:40.278 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.268+0000 7ff5ebfff700 1 --2- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7ff5f00336a0 0x7ff5f0035b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:40.278 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.268+0000 7ff5ebfff700 1 -- 172.21.15.112:0/1133139409 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff5f4046a60 con 0x7ff6040703f0 2021-10-08T19:21:40.279 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.268+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60410da90 con 0x7ff6040703f0 2021-10-08T19:21:40.279 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.268+0000 7ff602ffd700 1 --2- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7ff5f00336a0 0x7ff5f0035b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:40.279 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.269+0000 7ff602ffd700 1 --2- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7ff5f00336a0 0x7ff5f0035b50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80096a0 tx=0x7ff5f8006b40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:40.280 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.273+0000 7ff5ebfff700 1 -- 172.21.15.112:0/1133139409 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7ff5f402d440 con 0x7ff6040703f0 2021-10-08T19:21:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.473+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ff60405a9f0 con 0x7ff6040703f0 2021-10-08T19:21:40.624 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.624+0000 7ff5ebfff700 1 -- 172.21.15.112:0/1133139409 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 9) v1 ==== 40510+0+0 (secure 0 0 0) 0x7ff5f401bb30 con 0x7ff6040703f0 2021-10-08T19:21:40.625 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.625+0000 7ff5ebfff700 1 -- 172.21.15.112:0/1133139409 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7ff5f4023910 con 0x7ff6040703f0 2021-10-08T19:21:40.629 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7ff5f00336a0 msgr2=0x7ff5f0035b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:40.629 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 --2- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7ff5f00336a0 0x7ff5f0035b50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80096a0 tx=0x7ff5f8006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:40.629 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 msgr2=0x7ff60410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:40.629 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 --2- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff60410cec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400c010 tx=0x7ff5f4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:40.630 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 shutdown_connections 2021-10-08T19:21:40.630 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 --2- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7ff5f00336a0 0x7ff5f0035b50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:40.630 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 --2- 172.21.15.112:0/1133139409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6040703f0 0x7ff60410cec0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:40.630 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 >> 172.21.15.112:0/1133139409 conn(0x7ff6040f6800 msgr2=0x7ff6040f75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:40.631 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 shutdown_connections 2021-10-08T19:21:40.631 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:40.628+0000 7ff609afe700 1 -- 172.21.15.112:0/1133139409 wait complete. 2021-10-08T19:21:41.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1133139409' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-10-08T19:21:41.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:40 smithi112 conmon[32108]: ignoring --setuser ceph since I am not root 2021-10-08T19:21:41.072 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:40 smithi112 conmon[32108]: ignoring --setgroup ceph since I am not root 2021-10-08T19:21:41.167 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf mgr stat 2021-10-08T19:21:41.626 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.623+0000 7f80085ec700 1 Processor -- start 2021-10-08T19:21:41.626 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.623+0000 7f80085ec700 1 -- start start 2021-10-08T19:21:41.627 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.624+0000 7f80085ec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f80000fc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:41.627 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.624+0000 7f80085ec700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000fcb60 con 0x7f80000fc180 2021-10-08T19:21:41.627 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.624+0000 7f8006388700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f80000fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:41.627 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.624+0000 7f8006388700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f80000fc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32924/0 (socket says 172.21.15.112:32924) 2021-10-08T19:21:41.627 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.624+0000 7f8006388700 1 -- 172.21.15.112:0/3352253916 learned_addr learned my addr 172.21.15.112:0/3352253916 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:41.628 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.624+0000 7f8006388700 1 -- 172.21.15.112:0/3352253916 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000fcca0 con 0x7f80000fc180 2021-10-08T19:21:41.628 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.624+0000 7f8006388700 1 --2- 172.21.15.112:0/3352253916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f80000fc590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b5f0 tx=0x7f7ffc006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ae29030554b8ae server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:41.628 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.625+0000 7f8005386700 1 -- 172.21.15.112:0/3352253916 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ffc0106d0 con 0x7f80000fc180 2021-10-08T19:21:41.628 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.625+0000 7f8005386700 1 -- 172.21.15.112:0/3352253916 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f7ffc010c80 con 0x7f80000fc180 2021-10-08T19:21:41.629 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.625+0000 7f8005386700 1 -- 172.21.15.112:0/3352253916 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ffc011b30 con 0x7f80000fc180 2021-10-08T19:21:41.631 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.626+0000 7f80085ec700 1 -- 172.21.15.112:0/3352253916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 msgr2=0x7f80000fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:41.632 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.626+0000 7f80085ec700 1 --2- 172.21.15.112:0/3352253916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f80000fc590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b5f0 tx=0x7f7ffc006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:41.632 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.626+0000 7f80085ec700 1 -- 172.21.15.112:0/3352253916 shutdown_connections 2021-10-08T19:21:41.632 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.626+0000 7f80085ec700 1 --2- 172.21.15.112:0/3352253916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f80000fc590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:41.632 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.626+0000 7f80085ec700 1 -- 172.21.15.112:0/3352253916 >> 172.21.15.112:0/3352253916 conn(0x7f80000f7890 msgr2=0x7f80000f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:41.632 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.626+0000 7f80085ec700 1 -- 172.21.15.112:0/3352253916 shutdown_connections 2021-10-08T19:21:41.633 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.626+0000 7f80085ec700 1 -- 172.21.15.112:0/3352253916 wait complete. 2021-10-08T19:21:41.633 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f80085ec700 1 Processor -- start 2021-10-08T19:21:41.633 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f80085ec700 1 -- start start 2021-10-08T19:21:41.633 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f80085ec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f800010ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:41.634 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f80085ec700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800010b280 con 0x7f80000fc180 2021-10-08T19:21:41.634 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f8006388700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f800010ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:41.635 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f8006388700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f800010ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32926/0 (socket says 172.21.15.112:32926) 2021-10-08T19:21:41.635 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f8006388700 1 -- 172.21.15.112:0/4176129895 learned_addr learned my addr 172.21.15.112:0/4176129895 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:41.635 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f8006388700 1 -- 172.21.15.112:0/4176129895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc00b200 con 0x7f80000fc180 2021-10-08T19:21:41.635 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.627+0000 7f8006388700 1 --2- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f800010ad40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b5c0 tx=0x7f7ffc006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:41.635 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.628+0000 7f7feeffd700 1 -- 172.21.15.112:0/4176129895 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ffc010b00 con 0x7f80000fc180 2021-10-08T19:21:41.636 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.628+0000 7f7feeffd700 1 -- 172.21.15.112:0/4176129895 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f7ffc01ba70 con 0x7f80000fc180 2021-10-08T19:21:41.636 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.628+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800010b480 con 0x7f80000fc180 2021-10-08T19:21:41.636 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.628+0000 7f7feeffd700 1 -- 172.21.15.112:0/4176129895 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ffc023710 con 0x7f80000fc180 2021-10-08T19:21:41.636 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.628+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800010bfe0 con 0x7f80000fc180 2021-10-08T19:21:41.637 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.628+0000 7f7feeffd700 1 -- 172.21.15.112:0/4176129895 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 9) v1 ==== 40510+0+0 (secure 0 0 0) 0x7f7ffc00f070 con 0x7f80000fc180 2021-10-08T19:21:41.637 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.629+0000 7f7feeffd700 1 --2- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f7fe80336e0 0x7f7fe8035b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:41.637 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.629+0000 7f7feeffd700 1 -- 172.21.15.112:0/4176129895 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7ffc046a20 con 0x7f80000fc180 2021-10-08T19:21:41.637 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.629+0000 7f8005b87700 1 -- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f7fe80336e0 msgr2=0x7f7fe8035b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1294788170 2021-10-08T19:21:41.637 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.629+0000 7f8005b87700 1 --2- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f7fe80336e0 0x7f7fe8035b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:21:41.638 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.629+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800005a9f0 con 0x7f80000fc180 2021-10-08T19:21:41.638 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.633+0000 7f7feeffd700 1 -- 172.21.15.112:0/4176129895 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7ffc02d440 con 0x7f80000fc180 2021-10-08T19:21:41.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1133139409' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-10-08T19:21:41.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:41 smithi112 ceph-mon[31694]: mgrmap e9: y(active, since 15s) 2021-10-08T19:21:41.831 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.830+0000 7f8005b87700 1 -- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f7fe80336e0 msgr2=0x7f7fe8035b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1294788170 2021-10-08T19:21:41.831 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.830+0000 7f8005b87700 1 --2- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f7fe80336e0 0x7f7fe8035b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:21:41.849 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.843+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f80000fdfd0 con 0x7f80000fc180 2021-10-08T19:21:41.850 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.844+0000 7f7feeffd700 1 -- 172.21.15.112:0/4176129895 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f7ffc00f300 con 0x7f80000fc180 2021-10-08T19:21:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: { 2021-10-08T19:21:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "epoch": 9, 2021-10-08T19:21:41.851 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "available": true, 2021-10-08T19:21:41.852 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "active_name": "y", 2021-10-08T19:21:41.852 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "num_standby": 0 2021-10-08T19:21:41.853 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: } 2021-10-08T19:21:41.853 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f7fe80336e0 msgr2=0x7f7fe8035b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:21:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 --2- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f7fe80336e0 0x7f7fe8035b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 msgr2=0x7f800010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:41.854 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 --2- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f800010ad40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b5c0 tx=0x7f7ffc006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 shutdown_connections 2021-10-08T19:21:41.855 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 --2- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f7fe80336e0 0x7f7fe8035b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:41.856 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 --2- 172.21.15.112:0/4176129895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80000fc180 0x7f800010ad40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:41.856 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 >> 172.21.15.112:0/4176129895 conn(0x7f80000f7890 msgr2=0x7f80000f86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:41.857 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 shutdown_connections 2021-10-08T19:21:41.859 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:41.846+0000 7f80085ec700 1 -- 172.21.15.112:0/4176129895 wait complete. 2021-10-08T19:21:42.403 INFO:teuthology.orchestra.run.smithi112.stderr:Waiting for the mgr to restart... 2021-10-08T19:21:42.403 INFO:teuthology.orchestra.run.smithi112.stderr:Waiting for mgr epoch 9... 2021-10-08T19:21:42.403 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf tell mgr mgr_status 2021-10-08T19:21:42.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4176129895' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-10-08T19:21:42.880 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.880+0000 7f730714a700 1 Processor -- start 2021-10-08T19:21:42.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.880+0000 7f730714a700 1 -- start start 2021-10-08T19:21:42.881 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.880+0000 7f730714a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73000faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:42.882 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.880+0000 7f730714a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73000faf50 con 0x7f73000fa600 2021-10-08T19:21:42.882 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.881+0000 7f7306148700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73000faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:42.882 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.881+0000 7f7306148700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73000faa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32934/0 (socket says 172.21.15.112:32934) 2021-10-08T19:21:42.882 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.881+0000 7f7306148700 1 -- 172.21.15.112:0/3870328567 learned_addr learned my addr 172.21.15.112:0/3870328567 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:42.884 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.884+0000 7f7306148700 1 -- 172.21.15.112:0/3870328567 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000fb090 con 0x7f73000fa600 2021-10-08T19:21:42.885 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.884+0000 7f7306148700 1 --2- 172.21.15.112:0/3870328567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73000faa10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00d900 tx=0x7f72fc006e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5624c1d535d1a72d server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:42.885 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.885+0000 7f7305146700 1 -- 172.21.15.112:0/3870328567 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc00baf0 con 0x7f73000fa600 2021-10-08T19:21:42.886 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.885+0000 7f7305146700 1 -- 172.21.15.112:0/3870328567 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f72fc00bc50 con 0x7f73000fa600 2021-10-08T19:21:42.886 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.885+0000 7f7305146700 1 -- 172.21.15.112:0/3870328567 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc016530 con 0x7f73000fa600 2021-10-08T19:21:42.886 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.885+0000 7f730714a700 1 -- 172.21.15.112:0/3870328567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 msgr2=0x7f73000faa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:42.886 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.885+0000 7f730714a700 1 --2- 172.21.15.112:0/3870328567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73000faa10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00d900 tx=0x7f72fc006e70 comp rx=0 tx=0).stop 2021-10-08T19:21:42.887 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.886+0000 7f730714a700 1 -- 172.21.15.112:0/3870328567 shutdown_connections 2021-10-08T19:21:42.888 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.886+0000 7f730714a700 1 --2- 172.21.15.112:0/3870328567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73000faa10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:42.888 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.886+0000 7f730714a700 1 -- 172.21.15.112:0/3870328567 >> 172.21.15.112:0/3870328567 conn(0x7f73000f5df0 msgr2=0x7f73000f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:42.888 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.886+0000 7f730714a700 1 -- 172.21.15.112:0/3870328567 shutdown_connections 2021-10-08T19:21:42.888 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.886+0000 7f730714a700 1 -- 172.21.15.112:0/3870328567 wait complete. 2021-10-08T19:21:42.888 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.887+0000 7f730714a700 1 Processor -- start 2021-10-08T19:21:42.889 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.887+0000 7f730714a700 1 -- start start 2021-10-08T19:21:42.889 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.887+0000 7f730714a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73001088c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:42.889 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.887+0000 7f730714a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300108e00 con 0x7f73000fa600 2021-10-08T19:21:42.890 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.888+0000 7f7306148700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73001088c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:42.891 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.888+0000 7f7306148700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73001088c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32936/0 (socket says 172.21.15.112:32936) 2021-10-08T19:21:42.891 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.888+0000 7f7306148700 1 -- 172.21.15.112:0/267969115 learned_addr learned my addr 172.21.15.112:0/267969115 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:42.891 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.888+0000 7f7306148700 1 -- 172.21.15.112:0/267969115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc00d510 con 0x7f73000fa600 2021-10-08T19:21:42.891 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.889+0000 7f7306148700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73001088c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c5f0 tx=0x7f72fc006e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:42.892 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.890+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc009040 con 0x7f73000fa600 2021-10-08T19:21:42.892 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.890+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f72fc016d40 con 0x7f73000fa600 2021-10-08T19:21:42.892 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.890+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7300109000 con 0x7f73000fa600 2021-10-08T19:21:42.892 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.890+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc017630 con 0x7f73000fa600 2021-10-08T19:21:42.892 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.890+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7300109430 con 0x7f73000fa600 2021-10-08T19:21:42.893 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.892+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 9) v1 ==== 40510+0+0 (secure 0 0 0) 0x7f72fc025060 con 0x7f73000fa600 2021-10-08T19:21:42.893 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.892+0000 7f72eeffd700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 0x7f72e8035c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:42.894 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.892+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 --> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72e8036360 con 0x7f72e80337a0 2021-10-08T19:21:42.894 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.892+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f72fc045a70 con 0x7f73000fa600 2021-10-08T19:21:42.895 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.892+0000 7f7305947700 1 -- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 msgr2=0x7f72e8035c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1294788170 2021-10-08T19:21:42.895 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:42.892+0000 7f7305947700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 0x7f72e8035c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:21:43.093 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:43.093+0000 7f7305947700 1 -- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 msgr2=0x7f72e8035c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1294788170 2021-10-08T19:21:43.094 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:43.093+0000 7f7305947700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 0x7f72e8035c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:21:43.494 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:43.494+0000 7f7305947700 1 -- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 msgr2=0x7f72e8035c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1294788170 2021-10-08T19:21:43.495 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:43.494+0000 7f7305947700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 0x7f72e8035c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2021-10-08T19:21:44.296 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:44.295+0000 7f7305947700 1 -- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 msgr2=0x7f72e8035c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1294788170 2021-10-08T19:21:44.296 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:44.295+0000 7f7305947700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 0x7f72e8035c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2021-10-08T19:21:45.897 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:45.896+0000 7f7305947700 1 -- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 msgr2=0x7f72e8035c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/1294788170 2021-10-08T19:21:45.897 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:45.896+0000 7f7305947700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 0x7f72e8035c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2021-10-08T19:21:46.266 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:46.265+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mgrmap(e 10) v1 ==== 40278+0+0 (secure 0 0 0) 0x7f72fc017790 con 0x7f73000fa600 2021-10-08T19:21:46.266 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:46.265+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 msgr2=0x7f72e8035c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:21:46.266 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:46.265+0000 7f72eeffd700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 0x7f72e8035c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:47.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.269+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 11) v1 ==== 40388+0+0 (secure 0 0 0) 0x7f72fc024b50 con 0x7f73000fa600 2021-10-08T19:21:47.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.269+0000 7f72eeffd700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f72e80372c0 0x7f72e80396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:47.270 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.269+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72e8036360 con 0x7f72e80372c0 2021-10-08T19:21:47.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.269+0000 7f7305947700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f72e80372c0 0x7f72e80396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:47.271 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.270+0000 7f7305947700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f72e80372c0 0x7f72e80396a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72f0006fd0 tx=0x7f72f0006e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:47.272 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.270+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6424 (secure 0 0 0) 0x7f72e8036360 con 0x7f72e80372c0 2021-10-08T19:21:47.278 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.276+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f73000472f0 con 0x7f72e80372c0 2021-10-08T19:21:47.278 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.276+0000 7f72eeffd700 1 -- 172.21.15.112:0/267969115 <== mgr.14150 v2:172.21.15.112:6800/3200748374 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f73000472f0 con 0x7f72e80372c0 2021-10-08T19:21:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: { 2021-10-08T19:21:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-10-08T19:21:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: "initialized": true 2021-10-08T19:21:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: } 2021-10-08T19:21:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f72e80372c0 msgr2=0x7f72e80396a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f72e80372c0 0x7f72e80396a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72f0006fd0 tx=0x7f72f0006e30 comp rx=0 tx=0).stop 2021-10-08T19:21:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 msgr2=0x7f73001088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:47.280 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73001088c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c5f0 tx=0x7f72fc006e70 comp rx=0 tx=0).stop 2021-10-08T19:21:47.281 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 shutdown_connections 2021-10-08T19:21:47.281 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f72e80372c0 0x7f72e80396a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:47.281 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73000fa600 0x7f73001088c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:47.281 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 --2- 172.21.15.112:0/267969115 >> [v2:172.21.15.112:6800/1294788170,v1:172.21.15.112:6801/1294788170] conn(0x7f72e80337a0 0x7f72e8035c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 >> 172.21.15.112:0/267969115 conn(0x7f73000f5df0 msgr2=0x7f73000ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 shutdown_connections 2021-10-08T19:21:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:47.277+0000 7f730714a700 1 -- 172.21.15.112:0/267969115 wait complete. 2021-10-08T19:21:47.301 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:47 smithi112 conmon[32108]: [08/Oct/2021:19:21:47] ENGINE Bus STARTING 2021-10-08T19:21:47.301 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:47 smithi112 conmon[32108]: [08/Oct/2021:19:21:47] ENGINE Serving on https://172.21.15.112:8499 2021-10-08T19:21:47.302 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:21:47 smithi112 conmon[32108]: [08/Oct/2021:19:21:47] ENGINE Bus STARTED 2021-10-08T19:21:47.302 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: Active manager daemon y restarted 2021-10-08T19:21:47.302 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: Activating manager daemon y 2021-10-08T19:21:47.303 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: osdmap e3: 0 total, 0 up, 0 in 2021-10-08T19:21:47.303 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: mgrmap e10: y(active, starting, since 0.0530094s) 2021-10-08T19:21:47.303 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:21:47.303 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:21:47.303 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:21:47.304 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:21:47.304 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:21:47.304 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: Manager daemon y is now available 2021-10-08T19:21:47.304 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:47.305 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:47.305 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:47.305 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:21:47.305 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:47.306 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:47.306 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: Delaying applying agent spec until cephadm endpoint root cert created 2021-10-08T19:21:47.306 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:47.306 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:21:47.306 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:47.307 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:47.307 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: Delaying applying agent spec until cephadm endpoint root cert created 2021-10-08T19:21:47.307 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:21:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:mgr epoch 9 is available 2021-10-08T19:21:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:Generating a dashboard self-signed certificate... 2021-10-08T19:21:47.944 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf dashboard create-self-signed-cert 2021-10-08T19:21:48.385 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.377+0000 7f9400040700 1 Processor -- start 2021-10-08T19:21:48.385 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.377+0000 7f9400040700 1 -- start start 2021-10-08T19:21:48.386 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f9400040700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f81011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:48.386 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f9400040700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80fcbb0 con 0x7f93f8070450 2021-10-08T19:21:48.386 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f93fdddc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f81011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:48.386 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f93fdddc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f81011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32982/0 (socket says 172.21.15.112:32982) 2021-10-08T19:21:48.387 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f93fdddc700 1 -- 172.21.15.112:0/3696458603 learned_addr learned my addr 172.21.15.112:0/3696458603 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:48.387 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f93fdddc700 1 -- 172.21.15.112:0/3696458603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8101700 con 0x7f93f8070450 2021-10-08T19:21:48.387 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f93fdddc700 1 --2- 172.21.15.112:0/3696458603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f81011c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93f400b5f0 tx=0x7f93f4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c2660edc6ef775 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:48.387 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f93fcdda700 1 -- 172.21.15.112:0/3696458603 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93f40106d0 con 0x7f93f8070450 2021-10-08T19:21:48.388 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f93fcdda700 1 -- 172.21.15.112:0/3696458603 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f93f4010c80 con 0x7f93f8070450 2021-10-08T19:21:48.388 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.378+0000 7f93fcdda700 1 -- 172.21.15.112:0/3696458603 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93f4011b30 con 0x7f93f8070450 2021-10-08T19:21:48.388 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.379+0000 7f9400040700 1 -- 172.21.15.112:0/3696458603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 msgr2=0x7f93f81011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:48.388 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.379+0000 7f9400040700 1 --2- 172.21.15.112:0/3696458603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f81011c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93f400b5f0 tx=0x7f93f4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:48.389 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.379+0000 7f9400040700 1 -- 172.21.15.112:0/3696458603 shutdown_connections 2021-10-08T19:21:48.389 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.379+0000 7f9400040700 1 --2- 172.21.15.112:0/3696458603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f81011c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:48.389 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.379+0000 7f9400040700 1 -- 172.21.15.112:0/3696458603 >> 172.21.15.112:0/3696458603 conn(0x7f93f80f6850 msgr2=0x7f93f80f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:48.389 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.379+0000 7f9400040700 1 -- 172.21.15.112:0/3696458603 shutdown_connections 2021-10-08T19:21:48.390 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.379+0000 7f9400040700 1 -- 172.21.15.112:0/3696458603 wait complete. 2021-10-08T19:21:48.390 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f9400040700 1 Processor -- start 2021-10-08T19:21:48.390 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f9400040700 1 -- start start 2021-10-08T19:21:48.390 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f9400040700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f810ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:48.391 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f9400040700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f810d3f0 con 0x7f93f8070450 2021-10-08T19:21:48.391 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f93fdddc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f810ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:48.391 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f93fdddc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f810ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32984/0 (socket says 172.21.15.112:32984) 2021-10-08T19:21:48.391 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f93fdddc700 1 -- 172.21.15.112:0/2982336971 learned_addr learned my addr 172.21.15.112:0/2982336971 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:48.391 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f93fdddc700 1 -- 172.21.15.112:0/2982336971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f400b200 con 0x7f93f8070450 2021-10-08T19:21:48.392 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f93fdddc700 1 --2- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f810ceb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93f400b5c0 tx=0x7f93f4006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:48.392 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f93e67fc700 1 -- 172.21.15.112:0/2982336971 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93f4010b00 con 0x7f93f8070450 2021-10-08T19:21:48.392 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f93e67fc700 1 -- 172.21.15.112:0/2982336971 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f93f401ba70 con 0x7f93f8070450 2021-10-08T19:21:48.392 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f93e67fc700 1 -- 172.21.15.112:0/2982336971 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93f40236a0 con 0x7f93f8070450 2021-10-08T19:21:48.393 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f810d650 con 0x7f93f8070450 2021-10-08T19:21:48.393 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.380+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f810e1b0 con 0x7f93f8070450 2021-10-08T19:21:48.393 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.381+0000 7f93e67fc700 1 -- 172.21.15.112:0/2982336971 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 11) v1 ==== 40388+0+0 (secure 0 0 0) 0x7f93f400f070 con 0x7f93f8070450 2021-10-08T19:21:48.393 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.381+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f805a9f0 con 0x7f93f8070450 2021-10-08T19:21:48.393 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.381+0000 7f93e67fc700 1 --2- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f93e00335d0 0x7f93e0035a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:48.394 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.382+0000 7f93e67fc700 1 -- 172.21.15.112:0/2982336971 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f93f4046890 con 0x7f93f8070450 2021-10-08T19:21:48.394 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.382+0000 7f93fd5db700 1 --2- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f93e00335d0 0x7f93e0035a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:48.394 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.382+0000 7f93fd5db700 1 --2- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f93e00335d0 0x7f93e0035a80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93e80096a0 tx=0x7f93e8006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:48.395 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.386+0000 7f93e67fc700 1 -- 172.21.15.112:0/2982336971 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f93f401b620 con 0x7f93f8070450 2021-10-08T19:21:48.549 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.549+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f93f80f7d40 con 0x7f93e00335d0 2021-10-08T19:21:48.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:48 smithi112 ceph-mon[31694]: Starting cherrypy engine... 2021-10-08T19:21:48.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:48 smithi112 ceph-mon[31694]: [08/Oct/2021:19:21:47] ENGINE Bus STARTING 2021-10-08T19:21:48.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:48 smithi112 ceph-mon[31694]: [08/Oct/2021:19:21:47] ENGINE Serving on https://172.21.15.112:8499 2021-10-08T19:21:48.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:48 smithi112 ceph-mon[31694]: [08/Oct/2021:19:21:47] ENGINE Bus STARTED 2021-10-08T19:21:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:48 smithi112 ceph-mon[31694]: Cherrypy engine started. 2021-10-08T19:21:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:48 smithi112 ceph-mon[31694]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-10-08T19:21:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:48 smithi112 ceph-mon[31694]: mgrmap e11: y(active, since 1.05798s) 2021-10-08T19:21:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:48 smithi112 ceph-mon[31694]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-10-08T19:21:48.730 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.729+0000 7f93e67fc700 1 -- 172.21.15.112:0/2982336971 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f93f80f7d40 con 0x7f93e00335d0 2021-10-08T19:21:48.731 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: Self-signed certificate created 2021-10-08T19:21:48.733 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.731+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f93e00335d0 msgr2=0x7f93e0035a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:48.733 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.731+0000 7f9400040700 1 --2- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f93e00335d0 0x7f93e0035a80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93e80096a0 tx=0x7f93e8006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.731+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 msgr2=0x7f93f810ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:48.734 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.731+0000 7f9400040700 1 --2- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f810ceb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93f400b5c0 tx=0x7f93f4006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:48.735 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.731+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 shutdown_connections 2021-10-08T19:21:48.735 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.731+0000 7f9400040700 1 --2- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f93e00335d0 0x7f93e0035a80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:48.736 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.731+0000 7f9400040700 1 --2- 172.21.15.112:0/2982336971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f8070450 0x7f93f810ceb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:48.736 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.731+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 >> 172.21.15.112:0/2982336971 conn(0x7f93f80f6850 msgr2=0x7f93f80f7630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:48.737 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.732+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 shutdown_connections 2021-10-08T19:21:48.737 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:48.732+0000 7f9400040700 1 -- 172.21.15.112:0/2982336971 wait complete. 2021-10-08T19:21:49.381 INFO:teuthology.orchestra.run.smithi112.stderr:Creating initial admin user... 2021-10-08T19:21:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpszolaww9:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-10-08T19:21:49.557 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:49 smithi112 ceph-mon[31694]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:49.557 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:49 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:49.558 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:49 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:49.558 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:49 smithi112 ceph-mon[31694]: mgrmap e12: y(active, since 2s) 2021-10-08T19:21:49.829 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.823+0000 7f7d7ebb3700 1 Processor -- start 2021-10-08T19:21:49.829 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.823+0000 7f7d7ebb3700 1 -- start start 2021-10-08T19:21:49.830 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.823+0000 7f7d7ebb3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d780fc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:49.830 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.823+0000 7f7d7ebb3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780fca90 con 0x7f7d780fc140 2021-10-08T19:21:49.830 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.823+0000 7f7d7c94f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d780fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:49.830 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.823+0000 7f7d7c94f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d780fc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32988/0 (socket says 172.21.15.112:32988) 2021-10-08T19:21:49.831 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.823+0000 7f7d7c94f700 1 -- 172.21.15.112:0/445651144 learned_addr learned my addr 172.21.15.112:0/445651144 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:49.831 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.823+0000 7f7d7c94f700 1 -- 172.21.15.112:0/445651144 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780fcbd0 con 0x7f7d780fc140 2021-10-08T19:21:49.831 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d7c94f700 1 --2- 172.21.15.112:0/445651144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d780fc550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00b5f0 tx=0x7f7d6c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303f0fb7b7462654 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d777fe700 1 -- 172.21.15.112:0/445651144 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d6c0106d0 con 0x7f7d780fc140 2021-10-08T19:21:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d777fe700 1 -- 172.21.15.112:0/445651144 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f7d6c010c80 con 0x7f7d780fc140 2021-10-08T19:21:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d777fe700 1 -- 172.21.15.112:0/445651144 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d6c011b30 con 0x7f7d780fc140 2021-10-08T19:21:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/445651144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 msgr2=0x7f7d780fc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d7ebb3700 1 --2- 172.21.15.112:0/445651144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d780fc550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00b5f0 tx=0x7f7d6c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/445651144 shutdown_connections 2021-10-08T19:21:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d7ebb3700 1 --2- 172.21.15.112:0/445651144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d780fc550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:49.833 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/445651144 >> 172.21.15.112:0/445651144 conn(0x7f7d780f7910 msgr2=0x7f7d780f9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/445651144 shutdown_connections 2021-10-08T19:21:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.824+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/445651144 wait complete. 2021-10-08T19:21:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.825+0000 7f7d7ebb3700 1 Processor -- start 2021-10-08T19:21:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.825+0000 7f7d7ebb3700 1 -- start start 2021-10-08T19:21:49.834 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.825+0000 7f7d7ebb3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d7810acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.825+0000 7f7d7ebb3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7810b230 con 0x7f7d780fc140 2021-10-08T19:21:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.825+0000 7f7d7c94f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d7810acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.825+0000 7f7d7c94f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d7810acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32990/0 (socket says 172.21.15.112:32990) 2021-10-08T19:21:49.835 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.825+0000 7f7d7c94f700 1 -- 172.21.15.112:0/1058923819 learned_addr learned my addr 172.21.15.112:0/1058923819 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:49.836 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.826+0000 7f7d7c94f700 1 -- 172.21.15.112:0/1058923819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c00b200 con 0x7f7d780fc140 2021-10-08T19:21:49.836 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.826+0000 7f7d7c94f700 1 --2- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d7810acf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00c010 tx=0x7f7d6c006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:49.836 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.826+0000 7f7d757fa700 1 -- 172.21.15.112:0/1058923819 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d6c01b410 con 0x7f7d780fc140 2021-10-08T19:21:49.836 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.826+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7810b430 con 0x7f7d780fc140 2021-10-08T19:21:49.837 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.826+0000 7f7d757fa700 1 -- 172.21.15.112:0/1058923819 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f7d6c01b9c0 con 0x7f7d780fc140 2021-10-08T19:21:49.837 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.826+0000 7f7d757fa700 1 -- 172.21.15.112:0/1058923819 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d6c023750 con 0x7f7d780fc140 2021-10-08T19:21:49.837 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.826+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7810bf90 con 0x7f7d780fc140 2021-10-08T19:21:49.837 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.827+0000 7f7d757fa700 1 -- 172.21.15.112:0/1058923819 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 12) v1 ==== 40510+0+0 (secure 0 0 0) 0x7f7d6c00f070 con 0x7f7d780fc140 2021-10-08T19:21:49.838 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.827+0000 7f7d757fa700 1 --2- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f7d5c0336a0 0x7f7d5c035b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:49.838 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.827+0000 7f7d757fa700 1 -- 172.21.15.112:0/1058923819 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7d6c046b20 con 0x7f7d780fc140 2021-10-08T19:21:49.838 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.827+0000 7f7d77fff700 1 --2- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f7d5c0336a0 0x7f7d5c035b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:49.838 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.827+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7810b800 con 0x7f7d780fc140 2021-10-08T19:21:49.839 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.827+0000 7f7d77fff700 1 --2- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f7d5c0336a0 0x7f7d5c035b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d640096a0 tx=0x7f7d64006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:49.839 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:49.831+0000 7f7d757fa700 1 -- 172.21.15.112:0/1058923819 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f7d6c0223a0 con 0x7f7d780fc140 2021-10-08T19:21:50.007 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.005+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7d780473a0 con 0x7f7d5c0336a0 2021-10-08T19:21:50.223 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.222+0000 7f7d757fa700 1 -- 172.21.15.112:0/1058923819 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f7d780473a0 con 0x7f7d5c0336a0 2021-10-08T19:21:50.223 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$qDjHNx.IzndlswC9SMko7..CuF5MPuR1H.h409xfl9kgtJnPoxg7C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1633720910, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-10-08T19:21:50.225 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f7d5c0336a0 msgr2=0x7f7d5c035b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:50.225 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 --2- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f7d5c0336a0 0x7f7d5c035b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d640096a0 tx=0x7f7d64006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:50.226 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 msgr2=0x7f7d7810acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:50.226 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 --2- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d7810acf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00c010 tx=0x7f7d6c006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:50.226 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 shutdown_connections 2021-10-08T19:21:50.226 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 --2- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f7d5c0336a0 0x7f7d5c035b50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:50.227 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 --2- 172.21.15.112:0/1058923819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d780fc140 0x7f7d7810acf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:50.227 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 >> 172.21.15.112:0/1058923819 conn(0x7f7d780f7910 msgr2=0x7f7d780f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:50.227 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 shutdown_connections 2021-10-08T19:21:50.227 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:50.224+0000 7f7d7ebb3700 1 -- 172.21.15.112:0/1058923819 wait complete. 2021-10-08T19:21:50.919 INFO:teuthology.orchestra.run.smithi112.stderr:Fetching dashboard port number... 2021-10-08T19:21:50.920 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf -e NODE_NAME=smithi112 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/c1559bde-286c-11ec-8c25-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp4twfpjyx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpd8r45a1j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf config get mgr mgr/dashboard/ssl_server_port 2021-10-08T19:21:51.342 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.338+0000 7f87b4e6e700 1 Processor -- start 2021-10-08T19:21:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.338+0000 7f87b4e6e700 1 -- start start 2021-10-08T19:21:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.339+0000 7f87b4e6e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b00fb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.339+0000 7f87b4e6e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00fb9b0 con 0x7f87b00fb060 2021-10-08T19:21:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.339+0000 7f87ae59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b00fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:51.344 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.339+0000 7f87ae59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b00fb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32994/0 (socket says 172.21.15.112:32994) 2021-10-08T19:21:51.344 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.339+0000 7f87ae59c700 1 -- 172.21.15.112:0/795987626 learned_addr learned my addr 172.21.15.112:0/795987626 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:51.344 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.339+0000 7f87ae59c700 1 -- 172.21.15.112:0/795987626 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00fbaf0 con 0x7f87b00fb060 2021-10-08T19:21:51.344 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.339+0000 7f87ae59c700 1 --2- 172.21.15.112:0/795987626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b00fb470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f879800b5f0 tx=0x7f8798006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99100cd7f538a6fc server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:51.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87ad59a700 1 -- 172.21.15.112:0/795987626 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87980106d0 con 0x7f87b00fb060 2021-10-08T19:21:51.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87ad59a700 1 -- 172.21.15.112:0/795987626 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8798010c80 con 0x7f87b00fb060 2021-10-08T19:21:51.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87ad59a700 1 -- 172.21.15.112:0/795987626 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8798011b30 con 0x7f87b00fb060 2021-10-08T19:21:51.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87b4e6e700 1 -- 172.21.15.112:0/795987626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 msgr2=0x7f87b00fb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:51.345 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87b4e6e700 1 --2- 172.21.15.112:0/795987626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b00fb470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f879800b5f0 tx=0x7f8798006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:51.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87b4e6e700 1 -- 172.21.15.112:0/795987626 shutdown_connections 2021-10-08T19:21:51.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87b4e6e700 1 --2- 172.21.15.112:0/795987626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b00fb470 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:51.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87b4e6e700 1 -- 172.21.15.112:0/795987626 >> 172.21.15.112:0/795987626 conn(0x7f87b00f6850 msgr2=0x7f87b00f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:51.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87b4e6e700 1 -- 172.21.15.112:0/795987626 shutdown_connections 2021-10-08T19:21:51.346 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.340+0000 7f87b4e6e700 1 -- 172.21.15.112:0/795987626 wait complete. 2021-10-08T19:21:51.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.341+0000 7f87b4e6e700 1 Processor -- start 2021-10-08T19:21:51.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.341+0000 7f87b4e6e700 1 -- start start 2021-10-08T19:21:51.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.341+0000 7f87b4e6e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b010ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:51.347 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.341+0000 7f87b4e6e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b010d3c0 con 0x7f87b00fb060 2021-10-08T19:21:51.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.341+0000 7f87ae59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b010ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:51.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.341+0000 7f87ae59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b010ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32996/0 (socket says 172.21.15.112:32996) 2021-10-08T19:21:51.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.341+0000 7f87ae59c700 1 -- 172.21.15.112:0/2305018067 learned_addr learned my addr 172.21.15.112:0/2305018067 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:51.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.341+0000 7f87ae59c700 1 -- 172.21.15.112:0/2305018067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879800b200 con 0x7f87b00fb060 2021-10-08T19:21:51.348 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.342+0000 7f87ae59c700 1 --2- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b010ce80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f879800c010 tx=0x7f8798006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:51.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.342+0000 7f87a6ffd700 1 -- 172.21.15.112:0/2305018067 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f879801b410 con 0x7f87b00fb060 2021-10-08T19:21:51.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.342+0000 7f87a6ffd700 1 -- 172.21.15.112:0/2305018067 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f879801b9c0 con 0x7f87b00fb060 2021-10-08T19:21:51.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.342+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b010d5c0 con 0x7f87b00fb060 2021-10-08T19:21:51.349 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.342+0000 7f87a6ffd700 1 -- 172.21.15.112:0/2305018067 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8798023750 con 0x7f87b00fb060 2021-10-08T19:21:51.350 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.342+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b010e260 con 0x7f87b00fb060 2021-10-08T19:21:51.351 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.343+0000 7f87a6ffd700 1 -- 172.21.15.112:0/2305018067 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 12) v1 ==== 40510+0+0 (secure 0 0 0) 0x7f879800f070 con 0x7f87b00fb060 2021-10-08T19:21:51.351 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.343+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b010da50 con 0x7f87b00fb060 2021-10-08T19:21:51.351 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.343+0000 7f87a6ffd700 1 --2- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f87900336e0 0x7f8790035b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:51.352 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.343+0000 7f87a6ffd700 1 -- 172.21.15.112:0/2305018067 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8798046b50 con 0x7f87b00fb060 2021-10-08T19:21:51.352 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.343+0000 7f87add9b700 1 --2- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f87900336e0 0x7f8790035b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:51.352 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.343+0000 7f87add9b700 1 --2- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f87900336e0 0x7f8790035b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87a00096a0 tx=0x7f87a0006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:51.352 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.347+0000 7f87a6ffd700 1 -- 172.21.15.112:0/2305018067 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f879802d490 con 0x7f87b00fb060 2021-10-08T19:21:51.514 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.513+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f87b005a9f0 con 0x7f87b00fb060 2021-10-08T19:21:51.514 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.514+0000 7f87a6ffd700 1 -- 172.21.15.112:0/2305018067 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f879802b390 con 0x7f87b00fb060 2021-10-08T19:21:51.515 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 8443 2021-10-08T19:21:51.516 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f87900336e0 msgr2=0x7f8790035b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:51.517 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 --2- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f87900336e0 0x7f8790035b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87a00096a0 tx=0x7f87a0006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:51.517 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 msgr2=0x7f87b010ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:51.517 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 --2- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b010ce80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f879800c010 tx=0x7f8798006ee0 comp rx=0 tx=0).stop 2021-10-08T19:21:51.517 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 shutdown_connections 2021-10-08T19:21:51.518 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 --2- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f87900336e0 0x7f8790035b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:51.518 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 --2- 172.21.15.112:0/2305018067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87b00fb060 0x7f87b010ce80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:51.518 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 >> 172.21.15.112:0/2305018067 conn(0x7f87b00f6850 msgr2=0x7f87b00ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:51.518 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 shutdown_connections 2021-10-08T19:21:51.519 INFO:teuthology.orchestra.run.smithi112.stderr:/usr/bin/ceph: 2021-10-08T19:21:51.515+0000 7f87b4e6e700 1 -- 172.21.15.112:0/2305018067 wait complete. 2021-10-08T19:21:51.538 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:51 smithi112 ceph-mon[31694]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:51.539 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:51 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:52.154 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-enabled firewalld.service 2021-10-08T19:21:52.164 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: disabled 2021-10-08T19:21:52.164 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: systemctl is-active firewalld.service 2021-10-08T19:21:52.170 INFO:teuthology.orchestra.run.smithi112.stderr:systemctl: inactive 2021-10-08T19:21:52.171 INFO:teuthology.orchestra.run.smithi112.stderr:firewalld.service is not enabled 2021-10-08T19:21:52.172 INFO:teuthology.orchestra.run.smithi112.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-10-08T19:21:52.173 INFO:teuthology.orchestra.run.smithi112.stderr:Ceph Dashboard is now available at: 2021-10-08T19:21:52.174 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:52.174 INFO:teuthology.orchestra.run.smithi112.stderr: URL: https://smithi112.front.sepia.ceph.com:8443/ 2021-10-08T19:21:52.175 INFO:teuthology.orchestra.run.smithi112.stderr: User: admin 2021-10-08T19:21:52.175 INFO:teuthology.orchestra.run.smithi112.stderr: Password: 8hlqic9xxo 2021-10-08T19:21:52.175 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:52.176 INFO:teuthology.orchestra.run.smithi112.stderr:You can access the Ceph CLI with: 2021-10-08T19:21:52.176 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:52.176 INFO:teuthology.orchestra.run.smithi112.stderr: sudo /sbin/cephadm shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:52.177 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:52.177 INFO:teuthology.orchestra.run.smithi112.stderr:Please consider enabling telemetry to help improve Ceph: 2021-10-08T19:21:52.178 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:52.178 INFO:teuthology.orchestra.run.smithi112.stderr: ceph telemetry on 2021-10-08T19:21:52.178 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:52.178 INFO:teuthology.orchestra.run.smithi112.stderr:For more information see: 2021-10-08T19:21:52.179 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:52.179 INFO:teuthology.orchestra.run.smithi112.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-10-08T19:21:52.179 INFO:teuthology.orchestra.run.smithi112.stderr: 2021-10-08T19:21:52.179 INFO:teuthology.orchestra.run.smithi112.stderr:Bootstrap complete. 2021-10-08T19:21:52.208 INFO:tasks.cephadm:Fetching config... 2021-10-08T19:21:52.209 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:21:52.210 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-10-08T19:21:52.263 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-10-08T19:21:52.263 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:21:52.264 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-10-08T19:21:52.317 INFO:tasks.cephadm:Fetching mon keyring... 2021-10-08T19:21:52.318 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:21:52.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-10-08T19:21:52.379 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2305018067' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-10-08T19:21:52.382 INFO:tasks.cephadm:Fetching pub ssh key... 2021-10-08T19:21:52.383 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:21:52.383 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-10-08T19:21:52.437 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-10-08T19:21:52.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3uXfp/weXgJn9hAEmJ+4Cz/gM0hGNMkzE3KGU8JfPXLga6x4AEp0ZdHMojZEAj26OTYDvQHgIDNYJ47WMaqmLgpwjBWd1NGJfd7tJubQ8cTBul3rgcdm2+DLdL5oMorz4rILhLC6n/r9C7qfpR+S/LBHrjDeWjotIP1WhaoPHQcz0oNHUMAFcmottTu3ACo31XmPKKU5bDjxGrD483Vu8Ho7EMTfsdezhyVnxAxqNVd/5WsQxbz0J2f+ELPSzrZcx2QUQureLXKhn4UuK0YJluTdZt2YEehAv15BD5m3a306t4bbxPhdj6JuX6WhXIfHUATgN08J90sNbe7LR7UJIv5V+xZTYOw4HCPgRBlrTVzAj2+L5uDu5e5Nl66Ivb+1E95ze5NOc7h36FiqDI2PY2xH++KLq0nPnNjFDYJoRbIBYCIN4BGiYbvFmZKDM2D2ZXmac+Ngh54xH0c8GnfERx/cBx5wjHGJwvZ+DumV/DSC0/Vk3t8tlmm+o22f3GDk= ceph-c1559bde-286c-11ec-8c25-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-10-08T19:21:52.510 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3uXfp/weXgJn9hAEmJ+4Cz/gM0hGNMkzE3KGU8JfPXLga6x4AEp0ZdHMojZEAj26OTYDvQHgIDNYJ47WMaqmLgpwjBWd1NGJfd7tJubQ8cTBul3rgcdm2+DLdL5oMorz4rILhLC6n/r9C7qfpR+S/LBHrjDeWjotIP1WhaoPHQcz0oNHUMAFcmottTu3ACo31XmPKKU5bDjxGrD483Vu8Ho7EMTfsdezhyVnxAxqNVd/5WsQxbz0J2f+ELPSzrZcx2QUQureLXKhn4UuK0YJluTdZt2YEehAv15BD5m3a306t4bbxPhdj6JuX6WhXIfHUATgN08J90sNbe7LR7UJIv5V+xZTYOw4HCPgRBlrTVzAj2+L5uDu5e5Nl66Ivb+1E95ze5NOc7h36FiqDI2PY2xH++KLq0nPnNjFDYJoRbIBYCIN4BGiYbvFmZKDM2D2ZXmac+Ngh54xH0c8GnfERx/cBx5wjHGJwvZ+DumV/DSC0/Vk3t8tlmm+o22f3GDk= ceph-c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:52.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3uXfp/weXgJn9hAEmJ+4Cz/gM0hGNMkzE3KGU8JfPXLga6x4AEp0ZdHMojZEAj26OTYDvQHgIDNYJ47WMaqmLgpwjBWd1NGJfd7tJubQ8cTBul3rgcdm2+DLdL5oMorz4rILhLC6n/r9C7qfpR+S/LBHrjDeWjotIP1WhaoPHQcz0oNHUMAFcmottTu3ACo31XmPKKU5bDjxGrD483Vu8Ho7EMTfsdezhyVnxAxqNVd/5WsQxbz0J2f+ELPSzrZcx2QUQureLXKhn4UuK0YJluTdZt2YEehAv15BD5m3a306t4bbxPhdj6JuX6WhXIfHUATgN08J90sNbe7LR7UJIv5V+xZTYOw4HCPgRBlrTVzAj2+L5uDu5e5Nl66Ivb+1E95ze5NOc7h36FiqDI2PY2xH++KLq0nPnNjFDYJoRbIBYCIN4BGiYbvFmZKDM2D2ZXmac+Ngh54xH0c8GnfERx/cBx5wjHGJwvZ+DumV/DSC0/Vk3t8tlmm+o22f3GDk= ceph-c1559bde-286c-11ec-8c25-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-10-08T19:21:52.562 INFO:teuthology.orchestra.run.smithi142.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3uXfp/weXgJn9hAEmJ+4Cz/gM0hGNMkzE3KGU8JfPXLga6x4AEp0ZdHMojZEAj26OTYDvQHgIDNYJ47WMaqmLgpwjBWd1NGJfd7tJubQ8cTBul3rgcdm2+DLdL5oMorz4rILhLC6n/r9C7qfpR+S/LBHrjDeWjotIP1WhaoPHQcz0oNHUMAFcmottTu3ACo31XmPKKU5bDjxGrD483Vu8Ho7EMTfsdezhyVnxAxqNVd/5WsQxbz0J2f+ELPSzrZcx2QUQureLXKhn4UuK0YJluTdZt2YEehAv15BD5m3a306t4bbxPhdj6JuX6WhXIfHUATgN08J90sNbe7LR7UJIv5V+xZTYOw4HCPgRBlrTVzAj2+L5uDu5e5Nl66Ivb+1E95ze5NOc7h36FiqDI2PY2xH++KLq0nPnNjFDYJoRbIBYCIN4BGiYbvFmZKDM2D2ZXmac+Ngh54xH0c8GnfERx/cBx5wjHGJwvZ+DumV/DSC0/Vk3t8tlmm+o22f3GDk= ceph-c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:21:52.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-10-08T19:21:53.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:53 smithi112 ceph-mon[31694]: mgrmap e13: y(active, since 6s) 2021-10-08T19:21:54.319 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.316+0000 7f9cec4ac700 1 -- 172.21.15.112:0/3207987635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 msgr2=0x7f9ce40f7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:54.320 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.316+0000 7f9cec4ac700 1 --2- 172.21.15.112:0/3207987635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 0x7f9ce40f7400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009fb0 tx=0x7f9ce0009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:54.320 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.316+0000 7f9cec4ac700 1 -- 172.21.15.112:0/3207987635 shutdown_connections 2021-10-08T19:21:54.320 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.316+0000 7f9cec4ac700 1 --2- 172.21.15.112:0/3207987635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 0x7f9ce40f7400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:54.320 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.316+0000 7f9cec4ac700 1 -- 172.21.15.112:0/3207987635 >> 172.21.15.112:0/3207987635 conn(0x7f9ce40f2740 msgr2=0x7f9ce40f4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:54.321 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cec4ac700 1 -- 172.21.15.112:0/3207987635 shutdown_connections 2021-10-08T19:21:54.321 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cec4ac700 1 -- 172.21.15.112:0/3207987635 wait complete. 2021-10-08T19:21:54.321 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cec4ac700 1 Processor -- start 2021-10-08T19:21:54.321 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cec4ac700 1 -- start start 2021-10-08T19:21:54.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cec4ac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 0x7f9ce41065e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:54.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cec4ac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4106b20 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cea248700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 0x7f9ce41065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:54.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cea248700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 0x7f9ce41065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33006/0 (socket says 172.21.15.112:33006) 2021-10-08T19:21:54.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cea248700 1 -- 172.21.15.112:0/1057865349 learned_addr learned my addr 172.21.15.112:0/1057865349 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:54.323 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.317+0000 7f9cea248700 1 -- 172.21.15.112:0/1057865349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0005040 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.323 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.318+0000 7f9cea248700 1 --2- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 0x7f9ce41065e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00043d0 tx=0x7f9ce0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:54.323 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.318+0000 7f9cdaffd700 1 -- 172.21.15.112:0/1057865349 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ce001c070 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.323 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.318+0000 7f9cdaffd700 1 -- 172.21.15.112:0/1057865349 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f9ce001f3b0 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.323 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.318+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce4106d20 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.324 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.318+0000 7f9cdaffd700 1 -- 172.21.15.112:0/1057865349 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0012330 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.324 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.318+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce4107150 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.324 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.319+0000 7f9cdaffd700 1 -- 172.21.15.112:0/1057865349 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7f9ce00125f0 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.324 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.319+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce40472f0 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.325 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.319+0000 7f9cdaffd700 1 --2- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f9cd0033730 0x7f9cd0035be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:54.325 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.319+0000 7f9cdaffd700 1 -- 172.21.15.112:0/1057865349 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9ce00475d0 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.325 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.319+0000 7f9ce9a47700 1 --2- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f9cd0033730 0x7f9cd0035be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:54.325 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.319+0000 7f9ce9a47700 1 --2- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f9cd0033730 0x7f9cd0035be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40096a0 tx=0x7f9cd4006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:54.326 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.323+0000 7f9cdaffd700 1 -- 172.21.15.112:0/1057865349 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f9ce0012c00 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.482 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.482+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f9ce40fc0c0 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.485 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.485+0000 7f9cdaffd700 1 -- 172.21.15.112:0/1057865349 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9ce0011340 con 0x7f9ce40f6ff0 2021-10-08T19:21:54.487 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f9cd0033730 msgr2=0x7f9cd0035be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:54.487 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 --2- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f9cd0033730 0x7f9cd0035be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40096a0 tx=0x7f9cd4006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:54.487 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 msgr2=0x7f9ce41065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:54.488 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 --2- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 0x7f9ce41065e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00043d0 tx=0x7f9ce0009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:54.488 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 shutdown_connections 2021-10-08T19:21:54.488 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 --2- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f9cd0033730 0x7f9cd0035be0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:54.488 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 --2- 172.21.15.112:0/1057865349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ce40f6ff0 0x7f9ce41065e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:54.489 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 >> 172.21.15.112:0/1057865349 conn(0x7f9ce40f2740 msgr2=0x7f9ce40f3550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:54.489 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 shutdown_connections 2021-10-08T19:21:54.489 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:54.487+0000 7f9cec4ac700 1 -- 172.21.15.112:0/1057865349 wait complete. 2021-10-08T19:21:55.172 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2021-10-08T19:21:55.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2021-10-08T19:21:55.774 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1057865349' entity='client.admin' 2021-10-08T19:21:55.774 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:55.774 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:55.775 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:55 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:55.775 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]: dispatch 2021-10-08T19:21:56.707 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:56 smithi112 ceph-mon[31694]: Deploying daemon agent.smithi112 on smithi112 2021-10-08T19:21:56.707 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:56 smithi112 ceph-mon[31694]: poll took 9295.575 ms: 1 events 2021-10-08T19:21:56.708 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:56 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:56.708 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:56 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:56.708 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:56 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:56.708 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:56 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:56.708 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:56 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.849+0000 7ff876167700 1 -- 172.21.15.112:0/2204153942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 msgr2=0x7ff8700f71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.849+0000 7ff876167700 1 --2- 172.21.15.112:0/2204153942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 0x7ff8700f71d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff860009fb0 tx=0x7ff860009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.849+0000 7ff876167700 1 -- 172.21.15.112:0/2204153942 shutdown_connections 2021-10-08T19:21:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.849+0000 7ff876167700 1 --2- 172.21.15.112:0/2204153942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 0x7ff8700f71d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.849+0000 7ff876167700 1 -- 172.21.15.112:0/2204153942 >> 172.21.15.112:0/2204153942 conn(0x7ff8700f2560 msgr2=0x7ff8700f4990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.849+0000 7ff876167700 1 -- 172.21.15.112:0/2204153942 shutdown_connections 2021-10-08T19:21:56.853 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.849+0000 7ff876167700 1 -- 172.21.15.112:0/2204153942 wait complete. 2021-10-08T19:21:56.853 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff876167700 1 Processor -- start 2021-10-08T19:21:56.853 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff876167700 1 -- start start 2021-10-08T19:21:56.853 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff876167700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 0x7ff8701063e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:56.853 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff876167700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff870106920 con 0x7ff8700f6dc0 2021-10-08T19:21:56.854 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff875165700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 0x7ff8701063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:56.854 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff875165700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 0x7ff8701063e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33014/0 (socket says 172.21.15.112:33014) 2021-10-08T19:21:56.854 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff875165700 1 -- 172.21.15.112:0/2473770 learned_addr learned my addr 172.21.15.112:0/2473770 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:21:56.854 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff875165700 1 -- 172.21.15.112:0/2473770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860005040 con 0x7ff8700f6dc0 2021-10-08T19:21:56.855 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff875165700 1 --2- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 0x7ff8701063e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff860009880 tx=0x7ff860009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:56.855 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff865ffb700 1 -- 172.21.15.112:0/2473770 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff86001a070 con 0x7ff8700f6dc0 2021-10-08T19:21:56.855 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff870106b20 con 0x7ff8700f6dc0 2021-10-08T19:21:56.855 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.850+0000 7ff865ffb700 1 -- 172.21.15.112:0/2473770 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff860015d30 con 0x7ff8700f6dc0 2021-10-08T19:21:56.855 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.851+0000 7ff865ffb700 1 -- 172.21.15.112:0/2473770 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff86001ec40 con 0x7ff8700f6dc0 2021-10-08T19:21:56.856 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.851+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8701077c0 con 0x7ff8700f6dc0 2021-10-08T19:21:56.857 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.851+0000 7ff865ffb700 1 -- 172.21.15.112:0/2473770 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7ff860025030 con 0x7ff8700f6dc0 2021-10-08T19:21:56.857 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.852+0000 7ff865ffb700 1 --2- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7ff85c035990 0x7ff85c037e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:21:56.857 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.852+0000 7ff865ffb700 1 -- 172.21.15.112:0/2473770 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff8600452e0 con 0x7ff8700f6dc0 2021-10-08T19:21:56.857 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.852+0000 7ff874964700 1 --2- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7ff85c035990 0x7ff85c037e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:21:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.852+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff870106fb0 con 0x7ff8700f6dc0 2021-10-08T19:21:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.852+0000 7ff874964700 1 --2- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7ff85c035990 0x7ff85c037e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0096a0 tx=0x7ff86c006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:21:56.858 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:56.856+0000 7ff865ffb700 1 -- 172.21.15.112:0/2473770 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7ff860023070 con 0x7ff8700f6dc0 2021-10-08T19:21:57.030 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.030+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8700fbf60 con 0x7ff85c035990 2021-10-08T19:21:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.033+0000 7ff865ffb700 1 -- 172.21.15.112:0/2473770 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff8700fbf60 con 0x7ff85c035990 2021-10-08T19:21:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.035+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7ff85c035990 msgr2=0x7ff85c037e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.035+0000 7ff876167700 1 --2- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7ff85c035990 0x7ff85c037e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0096a0 tx=0x7ff86c006b40 comp rx=0 tx=0).stop 2021-10-08T19:21:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.035+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 msgr2=0x7ff8701063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:21:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.035+0000 7ff876167700 1 --2- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 0x7ff8701063e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff860009880 tx=0x7ff860009b30 comp rx=0 tx=0).stop 2021-10-08T19:21:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.035+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 shutdown_connections 2021-10-08T19:21:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.035+0000 7ff876167700 1 --2- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7ff85c035990 0x7ff85c037e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.035+0000 7ff876167700 1 --2- 172.21.15.112:0/2473770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8700f6dc0 0x7ff8701063e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:21:57.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.035+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 >> 172.21.15.112:0/2473770 conn(0x7ff8700f2560 msgr2=0x7ff8700f3350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:21:57.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.036+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 shutdown_connections 2021-10-08T19:21:57.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:21:57.036+0000 7ff876167700 1 -- 172.21.15.112:0/2473770 wait complete. 2021-10-08T19:21:57.567 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.176 seconds 2021-10-08T19:21:57.568 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:57.568 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:21:57.568 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:57.568 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:21:57.569 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:21:57.569 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:21:57.569 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:57.569 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:57 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:21:57.886 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi142 2021-10-08T19:21:57.886 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:21:57.887 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/etc/ceph/ceph.conf 2021-10-08T19:21:57.905 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:21:57.906 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:57.964 INFO:tasks.cephadm:Adding host smithi142 to orchestrator... 2021-10-08T19:21:57.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch host add smithi142 2021-10-08T19:21:58.808 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:58 smithi112 ceph-mon[31694]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:21:58.808 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:58 smithi112 ceph-mon[31694]: Updating smithi112:/etc/ceph/ceph.conf 2021-10-08T19:21:58.808 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:58 smithi112 ceph-mon[31694]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:21:58.809 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:21:58 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:01.820 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:22:01 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:22:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:02.556 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:02.557 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:02 smithi112 ceph-mon[31694]: Sending message to agent on host smithi112 2021-10-08T19:22:02.557 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:02 smithi112 ceph-mon[31694]: Received old metadata from agent on host smithi112. Requested up-to-date metadata. 2021-10-08T19:22:02.557 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:02.558 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:02 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:22:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:03.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:03 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi112 2021-10-08T19:22:06.320 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:22:05 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:22:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:07.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:06 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:07.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:06 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:07.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:06 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:22:07.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:06 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:07.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:06 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:22:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:07.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:06 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:07.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:06 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:07.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:06 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:09.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:09 smithi112 ceph-mon[31694]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:11.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:11 smithi112 ceph-mon[31694]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:13.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:13 smithi112 ceph-mon[31694]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:15.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:15 smithi112 ceph-mon[31694]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:17.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:17 smithi112 ceph-mon[31694]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:19 smithi112 ceph-mon[31694]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:21.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:21 smithi112 ceph-mon[31694]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:23.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:23 smithi112 ceph-mon[31694]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:25.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:25 smithi112 ceph-mon[31694]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:27.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:27 smithi112 ceph-mon[31694]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:29.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:29 smithi112 ceph-mon[31694]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:30.070 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:22:29 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:22:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:31.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:30 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:31.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:30 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:22:31.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:30 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:22:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:32.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:31 smithi112 ceph-mon[31694]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:34.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:33 smithi112 ceph-mon[31694]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:36.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:35 smithi112 ceph-mon[31694]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:38.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:37 smithi112 ceph-mon[31694]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:40.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:39 smithi112 ceph-mon[31694]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:42.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:41 smithi112 ceph-mon[31694]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:44.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:43 smithi112 ceph-mon[31694]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:44.288 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 -- 172.21.15.142:0/173798943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 msgr2=0x7f37500f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:44.289 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 --2- 172.21.15.142:0/173798943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 0x7f37500f8870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3744009fb0 tx=0x7f3744009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:44.289 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 -- 172.21.15.142:0/173798943 shutdown_connections 2021-10-08T19:22:44.289 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 --2- 172.21.15.142:0/173798943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 0x7f37500f8870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:44.290 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 -- 172.21.15.142:0/173798943 >> 172.21.15.142:0/173798943 conn(0x7f37500f1d50 msgr2=0x7f37500f4180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:44.290 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 -- 172.21.15.142:0/173798943 shutdown_connections 2021-10-08T19:22:44.290 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 -- 172.21.15.142:0/173798943 wait complete. 2021-10-08T19:22:44.290 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 Processor -- start 2021-10-08T19:22:44.291 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.286+0000 7f3755e1d700 1 -- start start 2021-10-08T19:22:44.291 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.287+0000 7f3755e1d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 0x7f375010c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:44.291 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.287+0000 7f3755e1d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3750108010 con 0x7f37500f8460 2021-10-08T19:22:44.292 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.287+0000 7f3754e1b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 0x7f375010c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:44.292 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.287+0000 7f3754e1b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 0x7f375010c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.142:46234/0 (socket says 172.21.15.142:46234) 2021-10-08T19:22:44.292 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.287+0000 7f3754e1b700 1 -- 172.21.15.142:0/3890081955 learned_addr learned my addr 172.21.15.142:0/3890081955 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:22:44.292 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.287+0000 7f3754e1b700 1 -- 172.21.15.142:0/3890081955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744005040 con 0x7f37500f8460 2021-10-08T19:22:44.292 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.287+0000 7f3754e1b700 1 --2- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 0x7f375010c620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37440043d0 tx=0x7f3744009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:44.293 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.288+0000 7f374d7fa700 1 -- 172.21.15.142:0/3890081955 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f374401a070 con 0x7f37500f8460 2021-10-08T19:22:44.293 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.288+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37500f6d30 con 0x7f37500f8460 2021-10-08T19:22:44.293 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.288+0000 7f374d7fa700 1 -- 172.21.15.142:0/3890081955 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3744014cf0 con 0x7f37500f8460 2021-10-08T19:22:44.294 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.288+0000 7f374d7fa700 1 -- 172.21.15.142:0/3890081955 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f374401dbc0 con 0x7f37500f8460 2021-10-08T19:22:44.294 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.288+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375010cb60 con 0x7f37500f8460 2021-10-08T19:22:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.288+0000 7f374d7fa700 1 -- 172.21.15.142:0/3890081955 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7f374401d4b0 con 0x7f37500f8460 2021-10-08T19:22:44.295 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.288+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37500472f0 con 0x7f37500f8460 2021-10-08T19:22:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.289+0000 7f374d7fa700 1 --2- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3740033730 0x7f3740035be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.289+0000 7f374d7fa700 1 -- 172.21.15.142:0/3890081955 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f37440453b0 con 0x7f37500f8460 2021-10-08T19:22:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.289+0000 7f374ffff700 1 --2- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3740033730 0x7f3740035be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:44.296 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.289+0000 7f374ffff700 1 --2- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3740033730 0x7f3740035be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f373c0096a0 tx=0x7f373c006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:44.297 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.293+0000 7f374d7fa700 1 -- 172.21.15.142:0/3890081955 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3744013bd0 con 0x7f37500f8460 2021-10-08T19:22:44.454 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:44.452+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}) v1 -- 0x7f3750059800 con 0x7f3740033730 2021-10-08T19:22:45.439 INFO:teuthology.orchestra.run.smithi142.stdout:Added host 'smithi142' with addr '172.21.15.142' 2021-10-08T19:22:45.440 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.437+0000 7f374d7fa700 1 -- 172.21.15.142:0/3890081955 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3750059800 con 0x7f3740033730 2021-10-08T19:22:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3740033730 msgr2=0x7f3740035be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:45.441 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 --2- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3740033730 0x7f3740035be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f373c0096a0 tx=0x7f373c006b40 comp rx=0 tx=0).stop 2021-10-08T19:22:45.442 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 msgr2=0x7f375010c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:45.442 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 --2- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 0x7f375010c620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37440043d0 tx=0x7f3744009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:45.442 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 shutdown_connections 2021-10-08T19:22:45.442 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 --2- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3740033730 0x7f3740035be0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:45.443 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 --2- 172.21.15.142:0/3890081955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37500f8460 0x7f375010c620 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:45.443 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 >> 172.21.15.142:0/3890081955 conn(0x7f37500f1d50 msgr2=0x7f37500f2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:45.443 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 shutdown_connections 2021-10-08T19:22:45.443 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:45.439+0000 7f3755e1d700 1 -- 172.21.15.142:0/3890081955 wait complete. 2021-10-08T19:22:46.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:45 smithi112 ceph-mon[31694]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:46.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:45 smithi112 ceph-mon[31694]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:46.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:45 smithi112 ceph-mon[31694]: poll took 47034.597 ms: 1 events 2021-10-08T19:22:46.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:45 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:46.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:45 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:46.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:45 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:46.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:45 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:46.323 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch host ls --format=json 2021-10-08T19:22:47.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: Deploying cephadm binary to smithi142 2021-10-08T19:22:47.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.153 seconds 2021-10-08T19:22:47.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: Executing took 0.141 seconds 2021-10-08T19:22:47.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: Added host smithi142 2021-10-08T19:22:47.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:47.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:47.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:22:47.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:47.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:22:47.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]': finished 2021-10-08T19:22:47.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:47.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:48.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:48.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:48.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: Deploying daemon agent.smithi142 on smithi142 2021-10-08T19:22:48.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.165 seconds 2021-10-08T19:22:48.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:48.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:48.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:48.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:48.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:48.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:48.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:48.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:48.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:48.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:48.112 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.110+0000 7f852fe0a700 1 -- 172.21.15.142:0/3080182630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 msgr2=0x7f85280fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.110+0000 7f852fe0a700 1 --2- 172.21.15.142:0/3080182630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 0x7f85280fcb90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8524004770 tx=0x7f852400ac40 comp rx=0 tx=0).stop 2021-10-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.110+0000 7f852fe0a700 1 -- 172.21.15.142:0/3080182630 shutdown_connections 2021-10-08T19:22:48.113 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.110+0000 7f852fe0a700 1 --2- 172.21.15.142:0/3080182630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 0x7f85280fcb90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.110+0000 7f852fe0a700 1 -- 172.21.15.142:0/3080182630 >> 172.21.15.142:0/3080182630 conn(0x7f852806d580 msgr2=0x7f852806d980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.110+0000 7f852fe0a700 1 -- 172.21.15.142:0/3080182630 shutdown_connections 2021-10-08T19:22:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.110+0000 7f852fe0a700 1 -- 172.21.15.142:0/3080182630 wait complete. 2021-10-08T19:22:48.114 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.111+0000 7f852fe0a700 1 Processor -- start 2021-10-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.111+0000 7f852fe0a700 1 -- start start 2021-10-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.111+0000 7f852fe0a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 0x7f85281054b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.111+0000 7f852fe0a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281059f0 con 0x7f85280fc7c0 2021-10-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.111+0000 7f852dba6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 0x7f85281054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:48.115 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.111+0000 7f852dba6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 0x7f85281054b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.142:46240/0 (socket says 172.21.15.142:46240) 2021-10-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.111+0000 7f852dba6700 1 -- 172.21.15.142:0/1155933609 learned_addr learned my addr 172.21.15.142:0/1155933609 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.111+0000 7f852dba6700 1 -- 172.21.15.142:0/1155933609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524005040 con 0x7f85280fc7c0 2021-10-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.112+0000 7f852dba6700 1 --2- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 0x7f85281054b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f852400aeb0 tx=0x7f852400ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.112+0000 7f851e7fc700 1 -- 172.21.15.142:0/1155933609 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f852400f030 con 0x7f85280fc7c0 2021-10-08T19:22:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.112+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8528105bf0 con 0x7f85280fc7c0 2021-10-08T19:22:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.112+0000 7f851e7fc700 1 -- 172.21.15.142:0/1155933609 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8524007cf0 con 0x7f85280fc7c0 2021-10-08T19:22:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.112+0000 7f851e7fc700 1 -- 172.21.15.142:0/1155933609 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f852401d670 con 0x7f85280fc7c0 2021-10-08T19:22:48.117 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.112+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8528106000 con 0x7f85280fc7c0 2021-10-08T19:22:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.113+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852805a9f0 con 0x7f85280fc7c0 2021-10-08T19:22:48.118 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.113+0000 7f851e7fc700 1 -- 172.21.15.142:0/1155933609 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7f8524008040 con 0x7f85280fc7c0 2021-10-08T19:22:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.113+0000 7f851e7fc700 1 --2- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f8514033730 0x7f8514035be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.113+0000 7f851e7fc700 1 -- 172.21.15.142:0/1155933609 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8524045ba0 con 0x7f85280fc7c0 2021-10-08T19:22:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.113+0000 7f852d3a5700 1 --2- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f8514033730 0x7f8514035be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.114+0000 7f852d3a5700 1 --2- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f8514033730 0x7f8514035be0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f85180096a0 tx=0x7f8518006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.118+0000 7f851e7fc700 1 -- 172.21.15.142:0/1155933609 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f8524025b50 con 0x7f85280fc7c0 2021-10-08T19:22:48.298 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.298+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f852805a9f0 con 0x7f8514033730 2021-10-08T19:22:48.300 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.299+0000 7f851e7fc700 1 -- 172.21.15.142:0/1155933609 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f852805a9f0 con 0x7f8514033730 2021-10-08T19:22:48.300 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:22:48.300 INFO:teuthology.orchestra.run.smithi142.stdout:[{"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}, {"addr": "172.21.15.142", "hostname": "smithi142", "labels": [], "status": ""}] 2021-10-08T19:22:48.302 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f8514033730 msgr2=0x7f8514035be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:48.302 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 --2- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f8514033730 0x7f8514035be0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f85180096a0 tx=0x7f8518006b40 comp rx=0 tx=0).stop 2021-10-08T19:22:48.302 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 msgr2=0x7f85281054b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:48.302 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 --2- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 0x7f85281054b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f852400aeb0 tx=0x7f852400ac40 comp rx=0 tx=0).stop 2021-10-08T19:22:48.303 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 shutdown_connections 2021-10-08T19:22:48.303 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 --2- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f8514033730 0x7f8514035be0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:48.303 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 --2- 172.21.15.142:0/1155933609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85280fc7c0 0x7f85281054b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:48.303 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 >> 172.21.15.142:0/1155933609 conn(0x7f852806d580 msgr2=0x7f85280f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:48.304 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 shutdown_connections 2021-10-08T19:22:48.304 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:48.301+0000 7f852fe0a700 1 -- 172.21.15.142:0/1155933609 wait complete. 2021-10-08T19:22:48.959 INFO:tasks.cephadm:Setting crush tunables to default 2021-10-08T19:22:48.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd crush tunables default 2021-10-08T19:22:48.991 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:48 smithi112 ceph-mon[31694]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:22:48.992 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:48 smithi112 ceph-mon[31694]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:22:48.992 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:48 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:48.992 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:48 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:49.784 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:49 smithi112 ceph-mon[31694]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:49.784 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:49 smithi112 ceph-mon[31694]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:22:50.797 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 -- 172.21.15.112:0/3994446624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 msgr2=0x7f123c0fd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:50.797 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 --2- 172.21.15.112:0/3994446624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 0x7f123c0fd3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1238009fb0 tx=0x7f1238009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:50.797 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 -- 172.21.15.112:0/3994446624 shutdown_connections 2021-10-08T19:22:50.797 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 --2- 172.21.15.112:0/3994446624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 0x7f123c0fd3b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:50.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 -- 172.21.15.112:0/3994446624 >> 172.21.15.112:0/3994446624 conn(0x7f123c0f2c00 msgr2=0x7f123c0f5010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:50.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 -- 172.21.15.112:0/3994446624 shutdown_connections 2021-10-08T19:22:50.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 -- 172.21.15.112:0/3994446624 wait complete. 2021-10-08T19:22:50.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 Processor -- start 2021-10-08T19:22:50.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 -- start start 2021-10-08T19:22:50.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 0x7f123c1087d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:50.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.795+0000 7f12445dc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c108d10 con 0x7f123c0fcfe0 2021-10-08T19:22:50.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f1242378700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 0x7f123c1087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:50.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f1242378700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 0x7f123c1087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33030/0 (socket says 172.21.15.112:33030) 2021-10-08T19:22:50.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f1242378700 1 -- 172.21.15.112:0/559514263 learned_addr learned my addr 172.21.15.112:0/559514263 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:22:50.801 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f1242378700 1 -- 172.21.15.112:0/559514263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238005040 con 0x7f123c0fcfe0 2021-10-08T19:22:50.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f1242378700 1 --2- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 0x7f123c1087d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12380045a0 tx=0x7f1238009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:50.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f1232ffd700 1 -- 172.21.15.112:0/559514263 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f123801a070 con 0x7f123c0fcfe0 2021-10-08T19:22:50.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c108f10 con 0x7f123c0fcfe0 2021-10-08T19:22:50.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f1232ffd700 1 -- 172.21.15.112:0/559514263 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1238014ca0 con 0x7f123c0fcfe0 2021-10-08T19:22:50.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f1232ffd700 1 -- 172.21.15.112:0/559514263 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f123801da10 con 0x7f123c0fcfe0 2021-10-08T19:22:50.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.796+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c1092c0 con 0x7f123c0fcfe0 2021-10-08T19:22:50.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.797+0000 7f1232ffd700 1 -- 172.21.15.112:0/559514263 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7f123801dcd0 con 0x7f123c0fcfe0 2021-10-08T19:22:50.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.797+0000 7f1232ffd700 1 --2- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f1228033730 0x7f1228035be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:50.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.797+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c05a9f0 con 0x7f123c0fcfe0 2021-10-08T19:22:50.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.797+0000 7f1232ffd700 1 -- 172.21.15.112:0/559514263 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1238045500 con 0x7f123c0fcfe0 2021-10-08T19:22:50.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.797+0000 7f1241b77700 1 --2- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f1228033730 0x7f1228035be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:50.805 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.798+0000 7f1241b77700 1 --2- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f1228033730 0x7f1228035be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f122c0096a0 tx=0x7f122c006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:50.805 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.801+0000 7f1232ffd700 1 -- 172.21.15.112:0/559514263 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1238027440 con 0x7f123c0fcfe0 2021-10-08T19:22:50.972 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:50.970+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f123c0289c0 con 0x7f123c0fcfe0 2021-10-08T19:22:51.320 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:22:51 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:22:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:51.631 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.629+0000 7f1232ffd700 1 -- 172.21.15.112:0/559514263 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1238012330 con 0x7f123c0fcfe0 2021-10-08T19:22:51.633 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.631+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f1228033730 msgr2=0x7f1228035be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 --2- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f1228033730 0x7f1228035be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f122c0096a0 tx=0x7f122c006b40 comp rx=0 tx=0).stop 2021-10-08T19:22:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 msgr2=0x7f123c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 --2- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 0x7f123c1087d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12380045a0 tx=0x7f1238009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 shutdown_connections 2021-10-08T19:22:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 --2- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f1228033730 0x7f1228035be0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 --2- 172.21.15.112:0/559514263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f123c0fcfe0 0x7f123c1087d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 >> 172.21.15.112:0/559514263 conn(0x7f123c0f2c00 msgr2=0x7f123c0f3840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 shutdown_connections 2021-10-08T19:22:51.636 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:22:51.632+0000 7f12445dc700 1 -- 172.21.15.112:0/559514263 wait complete. 2021-10-08T19:22:51.636 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2021-10-08T19:22:52.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:51 smithi112 ceph-mon[31694]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:52.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/559514263' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:22:52.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:51 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:52.381 INFO:tasks.cephadm:Adding mon.a on smithi112 2021-10-08T19:22:52.382 INFO:tasks.cephadm:Adding mon.c on smithi112 2021-10-08T19:22:52.382 INFO:tasks.cephadm:Adding mon.b on smithi142 2021-10-08T19:22:52.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch apply mon '3;smithi112:172.21.15.112=a;smithi112:[v2:172.21.15.112:3301,v1:172.21.15.112:6790]=c;smithi142:172.21.15.142=b' 2021-10-08T19:22:52.977 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:52 smithi112 ceph-mon[31694]: Sending message to agent on host smithi142 2021-10-08T19:22:52.978 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:52 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:22:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:52.979 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:52 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi142 2021-10-08T19:22:52.979 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/559514263' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:22:52.979 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:52 smithi112 ceph-mon[31694]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:54.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:53 smithi112 ceph-mon[31694]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:54.485 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.482+0000 7fe210445700 1 -- 172.21.15.142:0/755827114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 msgr2=0x7fe2080fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.482+0000 7fe210445700 1 --2- 172.21.15.142:0/755827114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 0x7fe2080fd3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe204009fb0 tx=0x7fe204009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.482+0000 7fe210445700 1 -- 172.21.15.142:0/755827114 shutdown_connections 2021-10-08T19:22:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.482+0000 7fe210445700 1 --2- 172.21.15.142:0/755827114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 0x7fe2080fd3e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.482+0000 7fe210445700 1 -- 172.21.15.142:0/755827114 >> 172.21.15.142:0/755827114 conn(0x7fe2080f2bf0 msgr2=0x7fe2080f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.482+0000 7fe210445700 1 -- 172.21.15.142:0/755827114 shutdown_connections 2021-10-08T19:22:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.482+0000 7fe210445700 1 -- 172.21.15.142:0/755827114 wait complete. 2021-10-08T19:22:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.483+0000 7fe210445700 1 Processor -- start 2021-10-08T19:22:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.483+0000 7fe210445700 1 -- start start 2021-10-08T19:22:54.488 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.483+0000 7fe210445700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 0x7fe20810c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:54.488 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.483+0000 7fe210445700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20810cbd0 con 0x7fe2080fd010 2021-10-08T19:22:54.488 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.483+0000 7fe20e1e1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 0x7fe20810c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:54.488 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.483+0000 7fe20e1e1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 0x7fe20810c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.142:46248/0 (socket says 172.21.15.142:46248) 2021-10-08T19:22:54.488 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.483+0000 7fe20e1e1700 1 -- 172.21.15.142:0/948455251 learned_addr learned my addr 172.21.15.142:0/948455251 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:22:54.489 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.483+0000 7fe20e1e1700 1 -- 172.21.15.142:0/948455251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204005040 con 0x7fe2080fd010 2021-10-08T19:22:54.489 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.484+0000 7fe20e1e1700 1 --2- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 0x7fe20810c690 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe204005010 tx=0x7fe204009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:54.489 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.484+0000 7fe1feffd700 1 -- 172.21.15.142:0/948455251 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe20401a070 con 0x7fe2080fd010 2021-10-08T19:22:54.489 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.484+0000 7fe1feffd700 1 -- 172.21.15.142:0/948455251 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fe204014cf0 con 0x7fe2080fd010 2021-10-08T19:22:54.490 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.484+0000 7fe1feffd700 1 -- 172.21.15.142:0/948455251 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe20401e9f0 con 0x7fe2080fd010 2021-10-08T19:22:54.490 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.484+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20810cdd0 con 0x7fe2080fd010 2021-10-08T19:22:54.491 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.484+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20810d1e0 con 0x7fe2080fd010 2021-10-08T19:22:54.492 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.485+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20805a9f0 con 0x7fe2080fd010 2021-10-08T19:22:54.492 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.485+0000 7fe1feffd700 1 -- 172.21.15.142:0/948455251 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7fe204025030 con 0x7fe2080fd010 2021-10-08T19:22:54.492 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.485+0000 7fe1feffd700 1 --2- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe1f4033730 0x7fe1f4035be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:54.493 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.485+0000 7fe1feffd700 1 -- 172.21.15.142:0/948455251 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe204045500 con 0x7fe2080fd010 2021-10-08T19:22:54.493 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.486+0000 7fe20d9e0700 1 --2- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe1f4033730 0x7fe1f4035be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:54.493 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.486+0000 7fe20d9e0700 1 --2- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe1f4033730 0x7fe1f4035be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80096a0 tx=0x7fe1f8006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:54.493 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.490+0000 7fe1feffd700 1 -- 172.21.15.142:0/948455251 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fe204011520 con 0x7fe2080fd010 2021-10-08T19:22:54.682 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.681+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi112:172.21.15.112=a;smithi112:[v2:172.21.15.112:3301,v1:172.21.15.112:6790]=c;smithi142:172.21.15.142=b", "target": ["mon-mgr", ""]}) v1 -- 0x7fe208107d50 con 0x7fe1f4033730 2021-10-08T19:22:54.689 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.688+0000 7fe1feffd700 1 -- 172.21.15.142:0/948455251 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe208107d50 con 0x7fe1f4033730 2021-10-08T19:22:54.690 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled mon update... 2021-10-08T19:22:54.691 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe1f4033730 msgr2=0x7fe1f4035be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:54.691 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 --2- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe1f4033730 0x7fe1f4035be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80096a0 tx=0x7fe1f8006b40 comp rx=0 tx=0).stop 2021-10-08T19:22:54.692 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 msgr2=0x7fe20810c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:54.692 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 --2- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 0x7fe20810c690 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe204005010 tx=0x7fe204009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:54.692 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 shutdown_connections 2021-10-08T19:22:54.692 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 --2- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe1f4033730 0x7fe1f4035be0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 --2- 172.21.15.142:0/948455251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2080fd010 0x7fe20810c690 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 >> 172.21.15.142:0/948455251 conn(0x7fe2080f2bf0 msgr2=0x7fe2080f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:54.693 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.690+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 shutdown_connections 2021-10-08T19:22:54.694 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:54.691+0000 7fe210445700 1 -- 172.21.15.142:0/948455251 wait complete. 2021-10-08T19:22:55.070 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:22:54 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:22:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:55.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:22:54 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:22:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:55.329 DEBUG:teuthology.orchestra.run.smithi112:mon.c> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.c.service 2021-10-08T19:22:55.332 DEBUG:teuthology.orchestra.run.smithi142:mon.b> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mon.b.service 2021-10-08T19:22:55.335 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:22:55.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:22:55.357 INFO:journalctl@ceph.mon.c.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:22:55.363 INFO:journalctl@ceph.mon.b.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:22:56.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:56.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:56.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:56.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:22:56.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:56.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:22:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:56.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:56.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:56.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:56.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:56.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:56.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:56.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:56.993 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 -- 172.21.15.142:0/3927652894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 msgr2=0x7f291c0fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:56.994 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 --2- 172.21.15.142:0/3927652894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 0x7f291c0fe4a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2910009fb0 tx=0x7f2910009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:56.994 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 -- 172.21.15.142:0/3927652894 shutdown_connections 2021-10-08T19:22:56.994 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 --2- 172.21.15.142:0/3927652894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 0x7f291c0fe4a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:56.994 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 -- 172.21.15.142:0/3927652894 >> 172.21.15.142:0/3927652894 conn(0x7f291c0f3d10 msgr2=0x7f291c0f6120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:56.995 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 -- 172.21.15.142:0/3927652894 shutdown_connections 2021-10-08T19:22:56.995 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 -- 172.21.15.142:0/3927652894 wait complete. 2021-10-08T19:22:56.995 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 Processor -- start 2021-10-08T19:22:56.995 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 -- start start 2021-10-08T19:22:56.996 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.991+0000 7f2922bed700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 0x7f291c10d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:56.996 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f2922bed700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c10dca0 con 0x7f291c0fe0d0 2021-10-08T19:22:56.996 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f2920989700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 0x7f291c10d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:56.996 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f2920989700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 0x7f291c10d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.142:46256/0 (socket says 172.21.15.142:46256) 2021-10-08T19:22:56.996 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f2920989700 1 -- 172.21.15.142:0/2950343657 learned_addr learned my addr 172.21.15.142:0/2950343657 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:22:56.997 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f2920989700 1 -- 172.21.15.142:0/2950343657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2910005040 con 0x7f291c0fe0d0 2021-10-08T19:22:56.997 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f2920989700 1 --2- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 0x7f291c10d760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29100045a0 tx=0x7f2910009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:56.998 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f29197fa700 1 -- 172.21.15.142:0/2950343657 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291001a070 con 0x7f291c0fe0d0 2021-10-08T19:22:56.998 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f29197fa700 1 -- 172.21.15.142:0/2950343657 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f2910014ca0 con 0x7f291c0fe0d0 2021-10-08T19:22:56.998 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f29197fa700 1 -- 172.21.15.142:0/2950343657 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291001da10 con 0x7f291c0fe0d0 2021-10-08T19:22:56.998 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.992+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c10dea0 con 0x7f291c0fe0d0 2021-10-08T19:22:56.999 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.993+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c10e2d0 con 0x7f291c0fe0d0 2021-10-08T19:22:57.000 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.993+0000 7f29197fa700 1 -- 172.21.15.142:0/2950343657 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7f291001dc80 con 0x7f291c0fe0d0 2021-10-08T19:22:57.000 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.993+0000 7f29197fa700 1 --2- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f290c033780 0x7f290c035c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:22:57.001 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.993+0000 7f29197fa700 1 -- 172.21.15.142:0/2950343657 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f29100455f0 con 0x7f291c0fe0d0 2021-10-08T19:22:57.001 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.993+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c05a9f0 con 0x7f291c0fe0d0 2021-10-08T19:22:57.001 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.994+0000 7f291bfff700 1 --2- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f290c033780 0x7f290c035c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:22:57.001 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.994+0000 7f291bfff700 1 --2- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f290c033780 0x7f290c035c30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29080096a0 tx=0x7f2908006b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:22:57.002 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:56.998+0000 7f29197fa700 1 -- 172.21.15.142:0/2950343657 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f2910027440 con 0x7f291c0fe0d0 2021-10-08T19:22:57.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:56 smithi112 ceph-mon[31694]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi112:172.21.15.112=a;smithi112:[v2:172.21.15.112:3301,v1:172.21.15.112:6790]=c;smithi142:172.21.15.142=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:57.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:56 smithi112 ceph-mon[31694]: Saving service mon spec with placement smithi112:172.21.15.112=a;smithi112:[v2:172.21.15.112:3301,v1:172.21.15.112:6790]=c;smithi142:172.21.15.142=b;count:3 2021-10-08T19:22:57.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:56 smithi112 ceph-mon[31694]: Deploying daemon mon.c on smithi112 2021-10-08T19:22:57.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:56 smithi112 ceph-mon[31694]: poll took 7536.941 ms: 1 events 2021-10-08T19:22:57.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:56 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:22:57.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:56 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:22:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:57.218 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.217+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f291c108d40 con 0x7f291c0fe0d0 2021-10-08T19:22:57.218 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.217+0000 7f29197fa700 1 -- 172.21.15.142:0/2950343657 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+694 (secure 0 0 0) 0x7f2910013390 con 0x7f291c0fe0d0 2021-10-08T19:22:57.219 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:22:57.219 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c1559bde-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:21:00.903107Z","created":"2021-10-08T19:21:00.903107Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-10-08T19:22:57.220 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f290c033780 msgr2=0x7f290c035c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:57.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 --2- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f290c033780 0x7f290c035c30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29080096a0 tx=0x7f2908006b40 comp rx=0 tx=0).stop 2021-10-08T19:22:57.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 msgr2=0x7f291c10d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:22:57.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 --2- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 0x7f291c10d760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29100045a0 tx=0x7f2910009b30 comp rx=0 tx=0).stop 2021-10-08T19:22:57.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 shutdown_connections 2021-10-08T19:22:57.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 --2- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f290c033780 0x7f290c035c30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:57.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 --2- 172.21.15.142:0/2950343657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c0fe0d0 0x7f291c10d760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:22:57.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 >> 172.21.15.142:0/2950343657 conn(0x7f291c0f3d10 msgr2=0x7f291c0f5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:22:57.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 shutdown_connections 2021-10-08T19:22:57.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:22:57.219+0000 7f2922bed700 1 -- 172.21.15.142:0/2950343657 wait complete. 2021-10-08T19:22:57.223 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2021-10-08T19:22:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 systemd[1]: Starting Ceph mon.c for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:22:57.935 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[31694]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:57.935 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/2950343657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:22:57.937 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: set uid:gid to 167:167 (ceph:ceph) 2021-10-08T19:22:57.937 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev), process ceph-mon, pid 7 2021-10-08T19:22:57.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pidfile_write: ignore empty --pid-file 2021-10-08T19:22:57.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: load: jerasure load: lrc 2021-10-08T19:22:57.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: RocksDB version: 6.15.5 2021-10-08T19:22:57.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-10-08T19:22:57.938 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Compile date Oct 7 2021 2021-10-08T19:22:57.939 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: DB SUMMARY 2021-10-08T19:22:57.939 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: DB Session ID: EI1P9JSEG976U4IR36TY 2021-10-08T19:22:57.939 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: CURRENT file: CURRENT 2021-10-08T19:22:57.939 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: IDENTITY file: IDENTITY 2021-10-08T19:22:57.940 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2021-10-08T19:22:57.940 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-10-08T19:22:57.940 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2021-10-08T19:22:57.940 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.error_if_exists: 0 2021-10-08T19:22:57.940 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.create_if_missing: 0 2021-10-08T19:22:57.941 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.paranoid_checks: 1 2021-10-08T19:22:57.941 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-10-08T19:22:57.941 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.env: 0x55a4be6f6b60 2021-10-08T19:22:57.941 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.fs: Posix File System 2021-10-08T19:22:57.942 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.info_log: 0x55a4bfec8120 2021-10-08T19:22:57.942 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_file_opening_threads: 16 2021-10-08T19:22:57.942 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.statistics: (nil) 2021-10-08T19:22:57.942 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.use_fsync: 0 2021-10-08T19:22:57.942 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_log_file_size: 0 2021-10-08T19:22:57.943 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-10-08T19:22:57.943 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.log_file_time_to_roll: 0 2021-10-08T19:22:57.943 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.keep_log_file_num: 1000 2021-10-08T19:22:57.943 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.recycle_log_file_num: 0 2021-10-08T19:22:57.943 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.allow_fallocate: 1 2021-10-08T19:22:57.944 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.allow_mmap_reads: 0 2021-10-08T19:22:57.944 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.allow_mmap_writes: 0 2021-10-08T19:22:57.944 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.use_direct_reads: 0 2021-10-08T19:22:57.944 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-10-08T19:22:57.945 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.create_missing_column_families: 0 2021-10-08T19:22:57.945 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.db_log_dir: 2021-10-08T19:22:57.945 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-10-08T19:22:57.945 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.table_cache_numshardbits: 6 2021-10-08T19:22:57.945 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.WAL_ttl_seconds: 0 2021-10-08T19:22:57.946 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.WAL_size_limit_MB: 0 2021-10-08T19:22:57.946 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-10-08T19:22:57.946 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-10-08T19:22:57.946 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.is_fd_close_on_exec: 1 2021-10-08T19:22:57.946 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.advise_random_on_open: 1 2021-10-08T19:22:57.947 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.db_write_buffer_size: 0 2021-10-08T19:22:57.947 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.write_buffer_manager: 0x55a4bff3de00 2021-10-08T19:22:57.947 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-10-08T19:22:57.947 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-10-08T19:22:57.947 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-10-08T19:22:57.948 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.use_adaptive_mutex: 0 2021-10-08T19:22:57.948 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.rate_limiter: (nil) 2021-10-08T19:22:57.948 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-10-08T19:22:57.948 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.wal_recovery_mode: 2 2021-10-08T19:22:57.948 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.enable_thread_tracking: 0 2021-10-08T19:22:57.949 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.enable_pipelined_write: 0 2021-10-08T19:22:57.949 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.unordered_write: 0 2021-10-08T19:22:57.949 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-10-08T19:22:57.949 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-10-08T19:22:57.950 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-10-08T19:22:57.950 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-10-08T19:22:57.950 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.row_cache: None 2021-10-08T19:22:57.950 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.wal_filter: None 2021-10-08T19:22:57.950 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-10-08T19:22:57.951 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.allow_ingest_behind: 0 2021-10-08T19:22:57.951 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.preserve_deletes: 0 2021-10-08T19:22:57.951 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.two_write_queues: 0 2021-10-08T19:22:57.951 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.manual_wal_flush: 0 2021-10-08T19:22:57.951 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.atomic_flush: 0 2021-10-08T19:22:57.952 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-10-08T19:22:57.952 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.persist_stats_to_disk: 0 2021-10-08T19:22:57.952 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.write_dbid_to_manifest: 0 2021-10-08T19:22:57.952 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.log_readahead_size: 0 2021-10-08T19:22:57.952 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-10-08T19:22:57.953 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.best_efforts_recovery: 0 2021-10-08T19:22:57.953 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-10-08T19:22:57.953 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-10-08T19:22:57.954 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.allow_data_in_errors: 0 2021-10-08T19:22:57.954 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.db_host_id: __hostname__ 2021-10-08T19:22:57.954 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_background_jobs: 2 2021-10-08T19:22:57.954 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_background_compactions: -1 2021-10-08T19:22:57.955 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_subcompactions: 1 2021-10-08T19:22:57.955 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-10-08T19:22:57.955 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-10-08T19:22:57.955 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.delayed_write_rate : 16777216 2021-10-08T19:22:57.955 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_total_wal_size: 0 2021-10-08T19:22:57.956 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-10-08T19:22:57.956 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.stats_dump_period_sec: 600 2021-10-08T19:22:57.956 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.stats_persist_period_sec: 600 2021-10-08T19:22:57.956 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-10-08T19:22:57.957 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_open_files: -1 2021-10-08T19:22:57.957 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bytes_per_sync: 0 2021-10-08T19:22:57.957 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.wal_bytes_per_sync: 0 2021-10-08T19:22:57.957 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.strict_bytes_per_sync: 0 2021-10-08T19:22:57.957 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_readahead_size: 0 2021-10-08T19:22:57.958 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_background_flushes: -1 2021-10-08T19:22:57.958 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Compression algorithms supported: 2021-10-08T19:22:57.958 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-10-08T19:22:57.958 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: kZSTD supported: 0 2021-10-08T19:22:57.958 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: kXpressCompression supported: 0 2021-10-08T19:22:57.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: kLZ4HCCompression supported: 1 2021-10-08T19:22:57.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: kLZ4Compression supported: 1 2021-10-08T19:22:57.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: kBZip2Compression supported: 0 2021-10-08T19:22:57.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: kZlibCompression supported: 1 2021-10-08T19:22:57.959 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: kSnappyCompression supported: 1 2021-10-08T19:22:57.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Fast CRC32 supported: Supported on x86 2021-10-08T19:22:57.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2021-10-08T19:22:57.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-10-08T19:22:57.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-10-08T19:22:57.960 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.merge_operator: 2021-10-08T19:22:57.961 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_filter: None 2021-10-08T19:22:57.961 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_filter_factory: None 2021-10-08T19:22:57.961 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.sst_partitioner_factory: None 2021-10-08T19:22:57.961 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.memtable_factory: SkipListFactory 2021-10-08T19:22:57.962 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.table_factory: BlockBasedTable 2021-10-08T19:22:57.962 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a4bfe91b80) 2021-10-08T19:22:57.962 INFO:journalctl@ceph.mon.c.smithi112.stdout: cache_index_and_filter_blocks: 1 2021-10-08T19:22:57.962 INFO:journalctl@ceph.mon.c.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-10-08T19:22:57.962 INFO:journalctl@ceph.mon.c.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-10-08T19:22:57.963 INFO:journalctl@ceph.mon.c.smithi112.stdout: pin_top_level_index_and_filter: 1 2021-10-08T19:22:57.963 INFO:journalctl@ceph.mon.c.smithi112.stdout: index_type: 0 2021-10-08T19:22:57.963 INFO:journalctl@ceph.mon.c.smithi112.stdout: data_block_index_type: 0 2021-10-08T19:22:57.963 INFO:journalctl@ceph.mon.c.smithi112.stdout: index_shortening: 1 2021-10-08T19:22:57.963 INFO:journalctl@ceph.mon.c.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2021-10-08T19:22:57.964 INFO:journalctl@ceph.mon.c.smithi112.stdout: hash_index_allow_collision: 1 2021-10-08T19:22:57.964 INFO:journalctl@ceph.mon.c.smithi112.stdout: checksum: 1 2021-10-08T19:22:57.964 INFO:journalctl@ceph.mon.c.smithi112.stdout: no_block_cache: 0 2021-10-08T19:22:57.964 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_cache: 0x55a4bfec6d10 2021-10-08T19:22:57.964 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_cache_name: BinnedLRUCache 2021-10-08T19:22:57.965 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_cache_options: 2021-10-08T19:22:57.965 INFO:journalctl@ceph.mon.c.smithi112.stdout: capacity : 536870912 2021-10-08T19:22:57.965 INFO:journalctl@ceph.mon.c.smithi112.stdout: num_shard_bits : 4 2021-10-08T19:22:57.965 INFO:journalctl@ceph.mon.c.smithi112.stdout: strict_capacity_limit : 0 2021-10-08T19:22:57.966 INFO:journalctl@ceph.mon.c.smithi112.stdout: high_pri_pool_ratio: 0.000 2021-10-08T19:22:57.966 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_cache_compressed: (nil) 2021-10-08T19:22:57.966 INFO:journalctl@ceph.mon.c.smithi112.stdout: persistent_cache: (nil) 2021-10-08T19:22:57.966 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_size: 4096 2021-10-08T19:22:57.966 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_size_deviation: 10 2021-10-08T19:22:57.967 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_restart_interval: 16 2021-10-08T19:22:57.967 INFO:journalctl@ceph.mon.c.smithi112.stdout: index_block_restart_interval: 1 2021-10-08T19:22:57.967 INFO:journalctl@ceph.mon.c.smithi112.stdout: metadata_block_size: 4096 2021-10-08T19:22:57.967 INFO:journalctl@ceph.mon.c.smithi112.stdout: partition_filters: 0 2021-10-08T19:22:57.967 INFO:journalctl@ceph.mon.c.smithi112.stdout: use_delta_encoding: 1 2021-10-08T19:22:57.968 INFO:journalctl@ceph.mon.c.smithi112.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-10-08T19:22:57.968 INFO:journalctl@ceph.mon.c.smithi112.stdout: whole_key_filtering: 1 2021-10-08T19:22:57.968 INFO:journalctl@ceph.mon.c.smithi112.stdout: verify_compression: 0 2021-10-08T19:22:57.968 INFO:journalctl@ceph.mon.c.smithi112.stdout: read_amp_bytes_per_bit: 0 2021-10-08T19:22:57.968 INFO:journalctl@ceph.mon.c.smithi112.stdout: format_version: 4 2021-10-08T19:22:57.969 INFO:journalctl@ceph.mon.c.smithi112.stdout: enable_index_compression: 1 2021-10-08T19:22:57.969 INFO:journalctl@ceph.mon.c.smithi112.stdout: block_align: 0 2021-10-08T19:22:57.969 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.write_buffer_size: 33554432 2021-10-08T19:22:57.969 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_write_buffer_number: 2 2021-10-08T19:22:57.969 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compression: NoCompression 2021-10-08T19:22:57.970 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bottommost_compression: Disabled 2021-10-08T19:22:57.970 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.prefix_extractor: nullptr 2021-10-08T19:22:57.970 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-10-08T19:22:57.970 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.num_levels: 7 2021-10-08T19:22:57.971 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-10-08T19:22:57.971 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-10-08T19:22:57.971 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-10-08T19:22:57.971 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-10-08T19:22:57.971 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-10-08T19:22:57.972 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-10-08T19:22:57.972 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-10-08T19:22:57.972 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:22:57.972 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-10-08T19:22:57.972 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-10-08T19:22:57.973 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compression_opts.window_bits: -14 2021-10-08T19:22:57.973 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compression_opts.level: 32767 2021-10-08T19:22:57.973 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compression_opts.strategy: 0 2021-10-08T19:22:57.973 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-10-08T19:22:57.974 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:22:57.974 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-10-08T19:22:57.974 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compression_opts.enabled: false 2021-10-08T19:22:57.974 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-10-08T19:22:57.974 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-10-08T19:22:57.975 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-10-08T19:22:57.975 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.target_file_size_base: 67108864 2021-10-08T19:22:57.975 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.target_file_size_multiplier: 1 2021-10-08T19:22:57.976 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-10-08T19:22:57.976 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-10-08T19:22:57.976 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-10-08T19:22:57.976 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-10-08T19:22:57.976 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-10-08T19:22:57.977 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-10-08T19:22:57.977 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-10-08T19:22:57.977 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-10-08T19:22:57.977 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-10-08T19:22:57.977 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-10-08T19:22:57.978 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-10-08T19:22:57.978 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-10-08T19:22:57.978 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.arena_block_size: 4194304 2021-10-08T19:22:57.978 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-10-08T19:22:57.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-10-08T19:22:57.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-10-08T19:22:57.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.disable_auto_compactions: 0 2021-10-08T19:22:57.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-10-08T19:22:57.979 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-10-08T19:22:57.980 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-10-08T19:22:57.980 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-10-08T19:22:57.980 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-10-08T19:22:57.980 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-10-08T19:22:57.980 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-10-08T19:22:57.981 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-10-08T19:22:57.981 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-10-08T19:22:57.981 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-10-08T19:22:57.981 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.table_properties_collectors: 2021-10-08T19:22:57.982 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.inplace_update_support: 0 2021-10-08T19:22:57.982 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.inplace_update_num_locks: 10000 2021-10-08T19:22:57.982 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-10-08T19:22:57.982 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-10-08T19:22:57.982 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.memtable_huge_page_size: 0 2021-10-08T19:22:57.983 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.bloom_locality: 0 2021-10-08T19:22:57.983 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.max_successive_merges: 0 2021-10-08T19:22:57.983 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.optimize_filters_for_hits: 0 2021-10-08T19:22:57.983 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.paranoid_file_checks: 0 2021-10-08T19:22:57.983 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.force_consistency_checks: 1 2021-10-08T19:22:57.984 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.report_bg_io_stats: 0 2021-10-08T19:22:57.984 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.ttl: 2592000 2021-10-08T19:22:57.984 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.periodic_compaction_seconds: 0 2021-10-08T19:22:57.984 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.enable_blob_files: false 2021-10-08T19:22:57.985 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.min_blob_size: 0 2021-10-08T19:22:57.985 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.blob_file_size: 268435456 2021-10-08T19:22:57.985 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.blob_compression_type: NoCompression 2021-10-08T19:22:57.985 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.enable_blob_garbage_collection: false 2021-10-08T19:22:57.985 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-10-08T19:22:57.986 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-10-08T19:22:57.986 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2021-10-08T19:22:57.986 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2021-10-08T19:22:57.986 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720977864028, "job": 1, "event": "recovery_started", "wal_files": [4]} 2021-10-08T19:22:57.986 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2021-10-08T19:22:57.987 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-10-08T19:22:57.987 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720977864284, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720977, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "bd231552-8cff-4772-bf62-ebf59d03376e", "db_session_id": "EI1P9JSEG976U4IR36TY"}} 2021-10-08T19:22:57.987 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2021-10-08T19:22:57.987 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720977864598, "job": 1, "event": "recovery_finished"} 2021-10-08T19:22:57.988 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-10-08T19:22:57.988 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55a4bfee2a80 2021-10-08T19:22:57.988 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: DB pointer 0x55a4bfef2000 2021-10-08T19:22:57.988 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-10-08T19:22:57.988 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-10-08T19:22:57.989 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** DB Stats ** 2021-10-08T19:22:57.989 INFO:journalctl@ceph.mon.c.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:22:57.989 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-10-08T19:22:57.989 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-10-08T19:22:57.990 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:22:57.990 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-10-08T19:22:57.990 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-10-08T19:22:57.990 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:22:57.990 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2021-10-08T19:22:57.991 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** Compaction Stats [default] ** 2021-10-08T19:22:57.991 INFO:journalctl@ceph.mon.c.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:22:57.991 INFO:journalctl@ceph.mon.c.smithi112.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:22:57.991 INFO:journalctl@ceph.mon.c.smithi112.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.1 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:57.991 INFO:journalctl@ceph.mon.c.smithi112.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.1 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:57.992 INFO:journalctl@ceph.mon.c.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.1 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:57.992 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2021-10-08T19:22:57.992 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** Compaction Stats [default] ** 2021-10-08T19:22:57.993 INFO:journalctl@ceph.mon.c.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:22:57.993 INFO:journalctl@ceph.mon.c.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:22:57.993 INFO:journalctl@ceph.mon.c.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.1 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:57.993 INFO:journalctl@ceph.mon.c.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:22:57.993 INFO:journalctl@ceph.mon.c.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:22:57.994 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:22:57.994 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:22:57.994 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:22:57.994 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:22:57.995 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:22:57.995 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:22:57.995 INFO:journalctl@ceph.mon.c.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:22:57.995 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2021-10-08T19:22:57.995 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:22:57.996 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2021-10-08T19:22:57.996 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** Compaction Stats [default] ** 2021-10-08T19:22:57.996 INFO:journalctl@ceph.mon.c.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:22:57.996 INFO:journalctl@ceph.mon.c.smithi112.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:22:57.996 INFO:journalctl@ceph.mon.c.smithi112.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.1 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.1 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-10-08T19:22:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2021-10-08T19:22:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** Compaction Stats [default] ** 2021-10-08T19:22:57.997 INFO:journalctl@ceph.mon.c.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:22:57.998 INFO:journalctl@ceph.mon.c.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:22:57.998 INFO:journalctl@ceph.mon.c.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.1 0.00 0.00 1 0.000 0 0 2021-10-08T19:22:57.998 INFO:journalctl@ceph.mon.c.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:22:57.998 INFO:journalctl@ceph.mon.c.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:22:57.999 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:22:57.999 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:22:57.999 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:22:58.000 INFO:journalctl@ceph.mon.c.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:22:58.000 INFO:journalctl@ceph.mon.c.smithi112.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:22:58.000 INFO:journalctl@ceph.mon.c.smithi112.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:22:58.000 INFO:journalctl@ceph.mon.c.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:22:58.001 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2021-10-08T19:22:58.001 INFO:journalctl@ceph.mon.c.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:22:58.001 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c does not exist in monmap, will attempt to join an existing cluster 2021-10-08T19:22:58.001 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: using public_addrv [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:22:58.002 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: starting mon.c rank -1 at public addrs [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] at bind addrs [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:22:58.002 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(???) e0 preinit fsid c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:22:58.002 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 bash[40445]: 5053aaef018d69b4172f8802cbc39879cf162cad9994981b8432d8ff6b1b4099 2021-10-08T19:22:58.002 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).mds e1 new map 2021-10-08T19:22:58.002 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).mds e1 print_map 2021-10-08T19:22:58.003 INFO:journalctl@ceph.mon.c.smithi112.stdout: e1 2021-10-08T19:22:58.003 INFO:journalctl@ceph.mon.c.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:22:58.003 INFO:journalctl@ceph.mon.c.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:22:58.003 INFO:journalctl@ceph.mon.c.smithi112.stdout: legacy client fscid: -1 2021-10-08T19:22:58.004 INFO:journalctl@ceph.mon.c.smithi112.stdout: 2021-10-08T19:22:58.004 INFO:journalctl@ceph.mon.c.smithi112.stdout: No filesystems configured 2021-10-08T19:22:58.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-10-08T19:22:58.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-10-08T19:22:58.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-10-08T19:22:58.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-10-08T19:22:58.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-10-08T19:22:58.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-10-08T19:22:58.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:22:58.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:58.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:58.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:22:58.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.007 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.007 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.007 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:22:58.007 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:22:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:58.008 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.008 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.008 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.008 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.008 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:58.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: poll took 47034.597 ms: 1 events 2021-10-08T19:22:58.010 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.010 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:58.010 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:58.010 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:58.010 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Deploying cephadm binary to smithi142 2021-10-08T19:22:58.011 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.153 seconds 2021-10-08T19:22:58.011 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Executing took 0.141 seconds 2021-10-08T19:22:58.011 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Added host smithi142 2021-10-08T19:22:58.011 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.012 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.012 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:22:58.012 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:22:58.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]': finished 2021-10-08T19:22:58.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:22:58.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:22:58.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:58.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Deploying daemon agent.smithi142 on smithi142 2021-10-08T19:22:58.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.165 seconds 2021-10-08T19:22:58.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:58.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:58.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:58.016 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.016 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.016 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:58.017 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:58.017 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:58.017 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.017 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:22:58.017 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:22:58.018 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:58.018 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:22:58.018 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.018 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:22:58.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/559514263' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:22:58.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Sending message to agent on host smithi142 2021-10-08T19:22:58.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:22:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:58.020 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi142 2021-10-08T19:22:58.020 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/559514263' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:22:58.020 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:22:58.020 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.020 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.021 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.021 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:22:58.021 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:22:58.021 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:22:58.022 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:22:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:58.022 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:58.022 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:22:58.022 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.022 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.023 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:22:58.023 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:22:58.023 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:22:58.023 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi112:172.21.15.112=a;smithi112:[v2:172.21.15.112:3301,v1:172.21.15.112:6790]=c;smithi142:172.21.15.142=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:22:58.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Saving service mon spec with placement smithi112:172.21.15.112=a;smithi112:[v2:172.21.15.112:3301,v1:172.21.15.112:6790]=c;smithi142:172.21.15.142=b;count:3 2021-10-08T19:22:58.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Deploying daemon mon.c on smithi112 2021-10-08T19:22:58.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: poll took 7536.941 ms: 1 events 2021-10-08T19:22:58.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:22:58.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:22:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:22:58.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:22:58.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/2950343657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:22:58.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-10-08T19:22:58.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 ceph-mon[40655]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2021-10-08T19:22:58.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:22:57 smithi112 systemd[1]: Started Ceph mon.c for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:22:58.790 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:22:58.791 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:23:03.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:03.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: mon.a calling monitor election 2021-10-08T19:23:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: poll took 2842.726 ms: 1 events 2021-10-08T19:23:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: mon.c calling monitor election 2021-10-08T19:23:03.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:03.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:23:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: monmap e2: 2 mons at {a=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0],c=[v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0]} 2021-10-08T19:23:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: fsmap 2021-10-08T19:23:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:23:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: mgrmap e13: y(active, since 76s) 2021-10-08T19:23:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: overall HEALTH_OK 2021-10-08T19:23:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:03.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:03.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:03.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:03.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: mon.a calling monitor election 2021-10-08T19:23:03.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:03.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: poll took 2842.726 ms: 1 events 2021-10-08T19:23:03.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: mon.c calling monitor election 2021-10-08T19:23:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:03.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:03.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:23:03.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: monmap e2: 2 mons at {a=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0],c=[v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0]} 2021-10-08T19:23:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: fsmap 2021-10-08T19:23:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:23:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: mgrmap e13: y(active, since 76s) 2021-10-08T19:23:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: overall HEALTH_OK 2021-10-08T19:23:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:03.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:03.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:03.438 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.437+0000 7fb268942700 1 -- 172.21.15.142:0/3619243730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 msgr2=0x7fb24c005700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:03.439 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.437+0000 7fb268942700 1 --2- 172.21.15.142:0/3619243730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 0x7fb24c005700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb2640f92b0 tx=0x7fb25400b040 comp rx=0 tx=0).stop 2021-10-08T19:23:03.439 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.438+0000 7fb268942700 1 -- 172.21.15.142:0/3619243730 shutdown_connections 2021-10-08T19:23:03.439 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.438+0000 7fb268942700 1 --2- 172.21.15.142:0/3619243730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 0x7fb24c005700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:03.440 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.438+0000 7fb268942700 1 -- 172.21.15.142:0/3619243730 >> 172.21.15.142:0/3619243730 conn(0x7fb2640f3d10 msgr2=0x7fb2640f6120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:03.440 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.438+0000 7fb268942700 1 -- 172.21.15.142:0/3619243730 shutdown_connections 2021-10-08T19:23:03.440 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.438+0000 7fb268942700 1 -- 172.21.15.142:0/3619243730 wait complete. 2021-10-08T19:23:03.443 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.438+0000 7fb268942700 1 Processor -- start 2021-10-08T19:23:03.443 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb268942700 1 -- start start 2021-10-08T19:23:03.444 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb268942700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 0x7fb26410d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:03.444 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb268942700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 0x7fb264107850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:03.444 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb268942700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26410e490 con 0x7fb24c003280 2021-10-08T19:23:03.444 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb268942700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26410e5d0 con 0x7fb26410ded0 2021-10-08T19:23:03.445 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb26259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 0x7fb26410d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:03.445 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb261d9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 0x7fb264107850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:03.445 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb26259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 0x7fb26410d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.142:46270/0 (socket says 172.21.15.142:46270) 2021-10-08T19:23:03.446 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb26259c700 1 -- 172.21.15.142:0/1769621487 learned_addr learned my addr 172.21.15.142:0/1769621487 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:23:03.446 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb261d9b700 1 -- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 msgr2=0x7fb264107850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2021-10-08T19:23:03.446 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb261d9b700 1 -- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 msgr2=0x7fb264107850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-10-08T19:23:03.446 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb261d9b700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 0x7fb264107850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-10-08T19:23:03.447 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb261d9b700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 0x7fb264107850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:23:03.447 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb26259c700 1 -- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 msgr2=0x7fb264107850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:23:03.447 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb26259c700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 0x7fb264107850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:03.447 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb26259c700 1 -- 172.21.15.142:0/1769621487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254005040 con 0x7fb24c003280 2021-10-08T19:23:03.448 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.439+0000 7fb26259c700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 0x7fb26410d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb2540041d0 tx=0x7fb25400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:03.448 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.440+0000 7fb252ffd700 1 -- 172.21.15.142:0/1769621487 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb2540048c0 con 0x7fb24c003280 2021-10-08T19:23:03.448 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.440+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb264107e50 con 0x7fb24c003280 2021-10-08T19:23:03.448 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.440+0000 7fb252ffd700 1 -- 172.21.15.142:0/1769621487 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb254020400 con 0x7fb24c003280 2021-10-08T19:23:03.448 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.440+0000 7fb252ffd700 1 -- 172.21.15.142:0/1769621487 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb25401e3b0 con 0x7fb24c003280 2021-10-08T19:23:03.449 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.440+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb264108390 con 0x7fb24c003280 2021-10-08T19:23:03.449 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.440+0000 7fb252ffd700 1 -- 172.21.15.142:0/1769621487 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7fb254030070 con 0x7fb24c003280 2021-10-08T19:23:03.449 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.440+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26405a9f0 con 0x7fb24c003280 2021-10-08T19:23:03.449 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.441+0000 7fb252ffd700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fb2440338c0 0x7fb244035d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:03.450 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.441+0000 7fb252ffd700 1 -- 172.21.15.142:0/1769621487 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb254046890 con 0x7fb24c003280 2021-10-08T19:23:03.450 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.441+0000 7fb261d9b700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fb2440338c0 0x7fb244035d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:03.450 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.441+0000 7fb261d9b700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fb2440338c0 0x7fb244035d70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb258006c30 tx=0x7fb258008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:03.451 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.446+0000 7fb252ffd700 1 -- 172.21.15.142:0/1769621487 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb254004a20 con 0x7fb24c003280 2021-10-08T19:23:03.707 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.705+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb2640472f0 con 0x7fb24c003280 2021-10-08T19:23:03.707 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.706+0000 7fb252ffd700 1 -- 172.21.15.142:0/1769621487 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+964 (secure 0 0 0) 0x7fb254008050 con 0x7fb24c003280 2021-10-08T19:23:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:23:03.708 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":2,"fsid":"c1559bde-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:22:57.882843Z","created":"2021-10-08T19:21:00.903107Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3301","nonce":0},{"type":"v1","addr":"172.21.15.112:6790","nonce":0}]},"addr":"172.21.15.112:6790/0","public_addr":"172.21.15.112:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-10-08T19:23:03.709 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.707+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fb2440338c0 msgr2=0x7fb244035d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:03.710 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.707+0000 7fb268942700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fb2440338c0 0x7fb244035d70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb258006c30 tx=0x7fb258008040 comp rx=0 tx=0).stop 2021-10-08T19:23:03.710 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.707+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 msgr2=0x7fb26410d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:03.710 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.708+0000 7fb268942700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 0x7fb26410d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb2540041d0 tx=0x7fb25400b040 comp rx=0 tx=0).stop 2021-10-08T19:23:03.710 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.708+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 shutdown_connections 2021-10-08T19:23:03.711 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.708+0000 7fb268942700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fb2440338c0 0x7fb244035d70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:03.711 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.708+0000 7fb268942700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb24c003280 0x7fb26410d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:03.711 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.708+0000 7fb268942700 1 --2- 172.21.15.142:0/1769621487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb26410ded0 0x7fb264107850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:03.711 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.708+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 >> 172.21.15.142:0/1769621487 conn(0x7fb2640f3d10 msgr2=0x7fb2640f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:03.712 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.708+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 shutdown_connections 2021-10-08T19:23:03.712 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:03.708+0000 7fb268942700 1 -- 172.21.15.142:0/1769621487 wait complete. 2021-10-08T19:23:03.712 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 2 2021-10-08T19:23:04.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:04 smithi112 ceph-mon[31694]: Deploying daemon mon.b on smithi142 2021-10-08T19:23:04.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:04 smithi112 ceph-mon[31694]: poll took 4922.746 ms: 1 events 2021-10-08T19:23:04.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/1769621487' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:04.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:04 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:04 smithi112 ceph-mon[40655]: Deploying daemon mon.b on smithi142 2021-10-08T19:23:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:04 smithi112 ceph-mon[40655]: poll took 4922.746 ms: 1 events 2021-10-08T19:23:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/1769621487' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:04 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:05.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:05 smithi112 ceph-mon[31694]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:05.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:05 smithi112 ceph-mon[40655]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:05.636 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-10-08T19:23:05.637 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph mon dump -f json 2021-10-08T19:23:06.259 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:06 smithi142 systemd[1]: Starting Ceph mon.b for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:23:07.400 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: set uid:gid to 167:167 (ceph:ceph) 2021-10-08T19:23:07.401 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: ceph version 17.0.0-8087-g103b6cc3 (103b6cc3554193fcd0852d9c647cef19e99920cf) quincy (dev), process ceph-mon, pid 8 2021-10-08T19:23:07.401 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pidfile_write: ignore empty --pid-file 2021-10-08T19:23:07.402 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: load: jerasure load: lrc 2021-10-08T19:23:07.402 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: RocksDB version: 6.15.5 2021-10-08T19:23:07.403 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-10-08T19:23:07.403 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Compile date Oct 7 2021 2021-10-08T19:23:07.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: DB SUMMARY 2021-10-08T19:23:07.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: DB Session ID: MXG0ULY14ZB0QY9DWJ6F 2021-10-08T19:23:07.405 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: CURRENT file: CURRENT 2021-10-08T19:23:07.405 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: IDENTITY file: IDENTITY 2021-10-08T19:23:07.406 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2021-10-08T19:23:07.406 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-10-08T19:23:07.406 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2021-10-08T19:23:07.407 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.error_if_exists: 0 2021-10-08T19:23:07.407 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.create_if_missing: 0 2021-10-08T19:23:07.408 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.paranoid_checks: 1 2021-10-08T19:23:07.408 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-10-08T19:23:07.409 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.env: 0x55bb0dce5b60 2021-10-08T19:23:07.409 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.fs: Posix File System 2021-10-08T19:23:07.409 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.info_log: 0x55bb0ec74120 2021-10-08T19:23:07.410 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_file_opening_threads: 16 2021-10-08T19:23:07.410 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.statistics: (nil) 2021-10-08T19:23:07.411 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.use_fsync: 0 2021-10-08T19:23:07.411 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_log_file_size: 0 2021-10-08T19:23:07.412 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_manifest_file_size: 1073741824 2021-10-08T19:23:07.412 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.log_file_time_to_roll: 0 2021-10-08T19:23:07.413 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.keep_log_file_num: 1000 2021-10-08T19:23:07.413 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.recycle_log_file_num: 0 2021-10-08T19:23:07.414 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.allow_fallocate: 1 2021-10-08T19:23:07.414 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.allow_mmap_reads: 0 2021-10-08T19:23:07.415 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.allow_mmap_writes: 0 2021-10-08T19:23:07.415 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.use_direct_reads: 0 2021-10-08T19:23:07.416 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-10-08T19:23:07.416 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.create_missing_column_families: 0 2021-10-08T19:23:07.417 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.db_log_dir: 2021-10-08T19:23:07.417 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-10-08T19:23:07.417 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.table_cache_numshardbits: 6 2021-10-08T19:23:07.418 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.WAL_ttl_seconds: 0 2021-10-08T19:23:07.418 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.WAL_size_limit_MB: 0 2021-10-08T19:23:07.419 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-10-08T19:23:07.419 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.manifest_preallocation_size: 4194304 2021-10-08T19:23:07.419 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.is_fd_close_on_exec: 1 2021-10-08T19:23:07.420 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.advise_random_on_open: 1 2021-10-08T19:23:07.420 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.db_write_buffer_size: 0 2021-10-08T19:23:07.420 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.write_buffer_manager: 0x55bb0ece9dd0 2021-10-08T19:23:07.421 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.access_hint_on_compaction_start: 1 2021-10-08T19:23:07.421 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-10-08T19:23:07.421 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.random_access_max_buffer_size: 1048576 2021-10-08T19:23:07.422 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.use_adaptive_mutex: 0 2021-10-08T19:23:07.422 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.rate_limiter: (nil) 2021-10-08T19:23:07.422 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-10-08T19:23:07.423 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.wal_recovery_mode: 2 2021-10-08T19:23:07.423 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.enable_thread_tracking: 0 2021-10-08T19:23:07.423 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 bash[33112]: 1aa3bd103eefc8a5d95e0f96e4a81efe98f19ca3dd7acf04948a565239cefd1e 2021-10-08T19:23:07.424 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.enable_pipelined_write: 0 2021-10-08T19:23:07.424 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.unordered_write: 0 2021-10-08T19:23:07.424 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.allow_concurrent_memtable_write: 1 2021-10-08T19:23:07.424 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-10-08T19:23:07.424 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.write_thread_max_yield_usec: 100 2021-10-08T19:23:07.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.write_thread_slow_yield_usec: 3 2021-10-08T19:23:07.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.row_cache: None 2021-10-08T19:23:07.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.wal_filter: None 2021-10-08T19:23:07.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.avoid_flush_during_recovery: 0 2021-10-08T19:23:07.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.allow_ingest_behind: 0 2021-10-08T19:23:07.426 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.preserve_deletes: 0 2021-10-08T19:23:07.426 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.two_write_queues: 0 2021-10-08T19:23:07.426 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.manual_wal_flush: 0 2021-10-08T19:23:07.426 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.atomic_flush: 0 2021-10-08T19:23:07.427 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-10-08T19:23:07.427 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.persist_stats_to_disk: 0 2021-10-08T19:23:07.427 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.write_dbid_to_manifest: 0 2021-10-08T19:23:07.427 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.log_readahead_size: 0 2021-10-08T19:23:07.427 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.file_checksum_gen_factory: Unknown 2021-10-08T19:23:07.428 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.best_efforts_recovery: 0 2021-10-08T19:23:07.428 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-10-08T19:23:07.428 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-10-08T19:23:07.428 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.allow_data_in_errors: 0 2021-10-08T19:23:07.429 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.db_host_id: __hostname__ 2021-10-08T19:23:07.429 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_background_jobs: 2 2021-10-08T19:23:07.429 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_background_compactions: -1 2021-10-08T19:23:07.429 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_subcompactions: 1 2021-10-08T19:23:07.429 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.avoid_flush_during_shutdown: 0 2021-10-08T19:23:07.430 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-10-08T19:23:07.430 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.delayed_write_rate : 16777216 2021-10-08T19:23:07.430 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_total_wal_size: 0 2021-10-08T19:23:07.430 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-10-08T19:23:07.431 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.stats_dump_period_sec: 600 2021-10-08T19:23:07.431 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.stats_persist_period_sec: 600 2021-10-08T19:23:07.431 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.stats_history_buffer_size: 1048576 2021-10-08T19:23:07.431 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_open_files: -1 2021-10-08T19:23:07.432 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bytes_per_sync: 0 2021-10-08T19:23:07.432 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.wal_bytes_per_sync: 0 2021-10-08T19:23:07.432 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.strict_bytes_per_sync: 0 2021-10-08T19:23:07.432 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_readahead_size: 0 2021-10-08T19:23:07.432 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_background_flushes: -1 2021-10-08T19:23:07.433 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Compression algorithms supported: 2021-10-08T19:23:07.433 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: kZSTDNotFinalCompression supported: 0 2021-10-08T19:23:07.433 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: kZSTD supported: 0 2021-10-08T19:23:07.433 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: kXpressCompression supported: 0 2021-10-08T19:23:07.433 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: kLZ4HCCompression supported: 1 2021-10-08T19:23:07.434 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: kLZ4Compression supported: 1 2021-10-08T19:23:07.434 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: kBZip2Compression supported: 0 2021-10-08T19:23:07.434 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: kZlibCompression supported: 1 2021-10-08T19:23:07.434 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: kSnappyCompression supported: 1 2021-10-08T19:23:07.435 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Fast CRC32 supported: Supported on x86 2021-10-08T19:23:07.435 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 2021-10-08T19:23:07.435 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-10-08T19:23:07.435 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-10-08T19:23:07.435 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.merge_operator: 2021-10-08T19:23:07.436 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_filter: None 2021-10-08T19:23:07.436 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_filter_factory: None 2021-10-08T19:23:07.436 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.sst_partitioner_factory: None 2021-10-08T19:23:07.436 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.memtable_factory: SkipListFactory 2021-10-08T19:23:07.436 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.table_factory: BlockBasedTable 2021-10-08T19:23:07.437 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bb0ec3db80) 2021-10-08T19:23:07.437 INFO:journalctl@ceph.mon.b.smithi142.stdout: cache_index_and_filter_blocks: 1 2021-10-08T19:23:07.437 INFO:journalctl@ceph.mon.b.smithi142.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2021-10-08T19:23:07.438 INFO:journalctl@ceph.mon.b.smithi142.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2021-10-08T19:23:07.438 INFO:journalctl@ceph.mon.b.smithi142.stdout: pin_top_level_index_and_filter: 1 2021-10-08T19:23:07.438 INFO:journalctl@ceph.mon.b.smithi142.stdout: index_type: 0 2021-10-08T19:23:07.438 INFO:journalctl@ceph.mon.b.smithi142.stdout: data_block_index_type: 0 2021-10-08T19:23:07.438 INFO:journalctl@ceph.mon.b.smithi142.stdout: index_shortening: 1 2021-10-08T19:23:07.439 INFO:journalctl@ceph.mon.b.smithi142.stdout: data_block_hash_table_util_ratio: 0.750000 2021-10-08T19:23:07.439 INFO:journalctl@ceph.mon.b.smithi142.stdout: hash_index_allow_collision: 1 2021-10-08T19:23:07.439 INFO:journalctl@ceph.mon.b.smithi142.stdout: checksum: 1 2021-10-08T19:23:07.439 INFO:journalctl@ceph.mon.b.smithi142.stdout: no_block_cache: 0 2021-10-08T19:23:07.440 INFO:journalctl@ceph.mon.b.smithi142.stdout: block_cache: 0x55bb0ec72d10 2021-10-08T19:23:07.440 INFO:journalctl@ceph.mon.b.smithi142.stdout: block_cache_name: BinnedLRUCache 2021-10-08T19:23:07.440 INFO:journalctl@ceph.mon.b.smithi142.stdout: block_cache_options: 2021-10-08T19:23:07.440 INFO:journalctl@ceph.mon.b.smithi142.stdout: capacity : 536870912 2021-10-08T19:23:07.440 INFO:journalctl@ceph.mon.b.smithi142.stdout: num_shard_bits : 4 2021-10-08T19:23:07.441 INFO:journalctl@ceph.mon.b.smithi142.stdout: strict_capacity_limit : 0 2021-10-08T19:23:07.441 INFO:journalctl@ceph.mon.b.smithi142.stdout: high_pri_pool_ratio: 0.000 2021-10-08T19:23:07.441 INFO:journalctl@ceph.mon.b.smithi142.stdout: block_cache_compressed: (nil) 2021-10-08T19:23:07.441 INFO:journalctl@ceph.mon.b.smithi142.stdout: persistent_cache: (nil) 2021-10-08T19:23:07.441 INFO:journalctl@ceph.mon.b.smithi142.stdout: block_size: 4096 2021-10-08T19:23:07.442 INFO:journalctl@ceph.mon.b.smithi142.stdout: block_size_deviation: 10 2021-10-08T19:23:07.442 INFO:journalctl@ceph.mon.b.smithi142.stdout: block_restart_interval: 16 2021-10-08T19:23:07.442 INFO:journalctl@ceph.mon.b.smithi142.stdout: index_block_restart_interval: 1 2021-10-08T19:23:07.442 INFO:journalctl@ceph.mon.b.smithi142.stdout: metadata_block_size: 4096 2021-10-08T19:23:07.443 INFO:journalctl@ceph.mon.b.smithi142.stdout: partition_filters: 0 2021-10-08T19:23:07.443 INFO:journalctl@ceph.mon.b.smithi142.stdout: use_delta_encoding: 1 2021-10-08T19:23:07.443 INFO:journalctl@ceph.mon.b.smithi142.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2021-10-08T19:23:07.443 INFO:journalctl@ceph.mon.b.smithi142.stdout: whole_key_filtering: 1 2021-10-08T19:23:07.443 INFO:journalctl@ceph.mon.b.smithi142.stdout: verify_compression: 0 2021-10-08T19:23:07.444 INFO:journalctl@ceph.mon.b.smithi142.stdout: read_amp_bytes_per_bit: 0 2021-10-08T19:23:07.444 INFO:journalctl@ceph.mon.b.smithi142.stdout: format_version: 4 2021-10-08T19:23:07.444 INFO:journalctl@ceph.mon.b.smithi142.stdout: enable_index_compression: 1 2021-10-08T19:23:07.444 INFO:journalctl@ceph.mon.b.smithi142.stdout: block_align: 0 2021-10-08T19:23:07.444 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.write_buffer_size: 33554432 2021-10-08T19:23:07.445 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_write_buffer_number: 2 2021-10-08T19:23:07.445 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compression: NoCompression 2021-10-08T19:23:07.445 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bottommost_compression: Disabled 2021-10-08T19:23:07.445 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.prefix_extractor: nullptr 2021-10-08T19:23:07.445 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-10-08T19:23:07.446 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.num_levels: 7 2021-10-08T19:23:07.446 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-10-08T19:23:07.446 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-10-08T19:23:07.446 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-10-08T19:23:07.447 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-10-08T19:23:07.447 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bottommost_compression_opts.level: 32767 2021-10-08T19:23:07.447 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-10-08T19:23:07.447 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-10-08T19:23:07.447 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:23:07.448 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-10-08T19:23:07.448 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bottommost_compression_opts.enabled: false 2021-10-08T19:23:07.448 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compression_opts.window_bits: -14 2021-10-08T19:23:07.448 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compression_opts.level: 32767 2021-10-08T19:23:07.448 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compression_opts.strategy: 0 2021-10-08T19:23:07.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-10-08T19:23:07.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-10-08T19:23:07.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compression_opts.parallel_threads: 1 2021-10-08T19:23:07.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compression_opts.enabled: false 2021-10-08T19:23:07.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-10-08T19:23:07.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-10-08T19:23:07.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.level0_stop_writes_trigger: 36 2021-10-08T19:23:07.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.target_file_size_base: 67108864 2021-10-08T19:23:07.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.target_file_size_multiplier: 1 2021-10-08T19:23:07.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_base: 268435456 2021-10-08T19:23:07.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-10-08T19:23:07.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-10-08T19:23:07.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-10-08T19:23:07.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-10-08T19:23:07.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-10-08T19:23:07.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-10-08T19:23:07.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-10-08T19:23:07.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-10-08T19:23:07.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-10-08T19:23:07.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-10-08T19:23:07.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_compaction_bytes: 1677721600 2021-10-08T19:23:07.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.arena_block_size: 4194304 2021-10-08T19:23:07.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-10-08T19:23:07.454 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-10-08T19:23:07.454 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-10-08T19:23:07.454 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.disable_auto_compactions: 0 2021-10-08T19:23:07.454 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-10-08T19:23:07.455 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-10-08T19:23:07.455 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-10-08T19:23:07.455 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-10-08T19:23:07.455 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-10-08T19:23:07.455 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-10-08T19:23:07.456 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-10-08T19:23:07.456 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-10-08T19:23:07.456 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-10-08T19:23:07.456 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-10-08T19:23:07.457 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.table_properties_collectors: 2021-10-08T19:23:07.457 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.inplace_update_support: 0 2021-10-08T19:23:07.457 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.inplace_update_num_locks: 10000 2021-10-08T19:23:07.457 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-10-08T19:23:07.457 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.memtable_whole_key_filtering: 0 2021-10-08T19:23:07.458 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.memtable_huge_page_size: 0 2021-10-08T19:23:07.458 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.bloom_locality: 0 2021-10-08T19:23:07.458 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.max_successive_merges: 0 2021-10-08T19:23:07.458 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.optimize_filters_for_hits: 0 2021-10-08T19:23:07.458 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.paranoid_file_checks: 0 2021-10-08T19:23:07.459 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.force_consistency_checks: 1 2021-10-08T19:23:07.459 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.report_bg_io_stats: 0 2021-10-08T19:23:07.459 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.ttl: 2592000 2021-10-08T19:23:07.459 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.periodic_compaction_seconds: 0 2021-10-08T19:23:07.460 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.enable_blob_files: false 2021-10-08T19:23:07.460 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.min_blob_size: 0 2021-10-08T19:23:07.460 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.blob_file_size: 268435456 2021-10-08T19:23:07.460 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.blob_compression_type: NoCompression 2021-10-08T19:23:07.460 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.enable_blob_garbage_collection: false 2021-10-08T19:23:07.461 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-10-08T19:23:07.461 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-10-08T19:23:07.462 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2021-10-08T19:23:07.462 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2021-10-08T19:23:07.462 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720987188055, "job": 1, "event": "recovery_started", "wal_files": [4]} 2021-10-08T19:23:07.462 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2021-10-08T19:23:07.462 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-10-08T19:23:07.463 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720987188324, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1670, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1633720987, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "586b746f-0f91-43fe-986f-f72b7f67fcd9", "db_session_id": "MXG0ULY14ZB0QY9DWJ6F"}} 2021-10-08T19:23:07.463 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2021-10-08T19:23:07.463 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: EVENT_LOG_v1 {"time_micros": 1633720987188662, "job": 1, "event": "recovery_finished"} 2021-10-08T19:23:07.463 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-10-08T19:23:07.464 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55bb0ec8ea80 2021-10-08T19:23:07.464 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: DB pointer 0x55bb0ec9e000 2021-10-08T19:23:07.464 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-10-08T19:23:07.464 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: rocksdb: [db/db_impl/db_impl.cc:903] 2021-10-08T19:23:07.464 INFO:journalctl@ceph.mon.b.smithi142.stdout: ** DB Stats ** 2021-10-08T19:23:07.465 INFO:journalctl@ceph.mon.b.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:23:07.465 INFO:journalctl@ceph.mon.b.smithi142.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-10-08T19:23:07.465 INFO:journalctl@ceph.mon.b.smithi142.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-10-08T19:23:07.466 INFO:journalctl@ceph.mon.b.smithi142.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:23:07.467 INFO:journalctl@ceph.mon.b.smithi142.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-10-08T19:23:07.467 INFO:journalctl@ceph.mon.b.smithi142.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-10-08T19:23:07.467 INFO:journalctl@ceph.mon.b.smithi142.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-10-08T19:23:07.468 INFO:journalctl@ceph.mon.b.smithi142.stdout: 2021-10-08T19:23:07.468 INFO:journalctl@ceph.mon.b.smithi142.stdout: ** Compaction Stats [default] ** 2021-10-08T19:23:07.468 INFO:journalctl@ceph.mon.b.smithi142.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:23:07.469 INFO:journalctl@ceph.mon.b.smithi142.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:23:07.469 INFO:journalctl@ceph.mon.b.smithi142.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:23:07.469 INFO:journalctl@ceph.mon.b.smithi142.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:23:07.470 INFO:journalctl@ceph.mon.b.smithi142.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:23:07.470 INFO:journalctl@ceph.mon.b.smithi142.stdout: 2021-10-08T19:23:07.470 INFO:journalctl@ceph.mon.b.smithi142.stdout: ** Compaction Stats [default] ** 2021-10-08T19:23:07.471 INFO:journalctl@ceph.mon.b.smithi142.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:23:07.471 INFO:journalctl@ceph.mon.b.smithi142.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:23:07.472 INFO:journalctl@ceph.mon.b.smithi142.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:23:07.472 INFO:journalctl@ceph.mon.b.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:23:07.472 INFO:journalctl@ceph.mon.b.smithi142.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:23:07.473 INFO:journalctl@ceph.mon.b.smithi142.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:23:07.473 INFO:journalctl@ceph.mon.b.smithi142.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:23:07.473 INFO:journalctl@ceph.mon.b.smithi142.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:23:07.474 INFO:journalctl@ceph.mon.b.smithi142.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:23:07.474 INFO:journalctl@ceph.mon.b.smithi142.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:23:07.475 INFO:journalctl@ceph.mon.b.smithi142.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:23:07.475 INFO:journalctl@ceph.mon.b.smithi142.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:23:07.476 INFO:journalctl@ceph.mon.b.smithi142.stdout: 2021-10-08T19:23:07.476 INFO:journalctl@ceph.mon.b.smithi142.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:23:07.476 INFO:journalctl@ceph.mon.b.smithi142.stdout: 2021-10-08T19:23:07.476 INFO:journalctl@ceph.mon.b.smithi142.stdout: ** Compaction Stats [default] ** 2021-10-08T19:23:07.476 INFO:journalctl@ceph.mon.b.smithi142.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:23:07.477 INFO:journalctl@ceph.mon.b.smithi142.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:23:07.477 INFO:journalctl@ceph.mon.b.smithi142.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:23:07.477 INFO:journalctl@ceph.mon.b.smithi142.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 6.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:23:07.477 INFO:journalctl@ceph.mon.b.smithi142.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-10-08T19:23:07.478 INFO:journalctl@ceph.mon.b.smithi142.stdout: 2021-10-08T19:23:07.478 INFO:journalctl@ceph.mon.b.smithi142.stdout: ** Compaction Stats [default] ** 2021-10-08T19:23:07.478 INFO:journalctl@ceph.mon.b.smithi142.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-10-08T19:23:07.478 INFO:journalctl@ceph.mon.b.smithi142.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-10-08T19:23:07.479 INFO:journalctl@ceph.mon.b.smithi142.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.3 0.00 0.00 1 0.000 0 0 2021-10-08T19:23:07.479 INFO:journalctl@ceph.mon.b.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2021-10-08T19:23:07.479 INFO:journalctl@ceph.mon.b.smithi142.stdout: Flush(GB): cumulative 0.000, interval 0.000 2021-10-08T19:23:07.479 INFO:journalctl@ceph.mon.b.smithi142.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2021-10-08T19:23:07.480 INFO:journalctl@ceph.mon.b.smithi142.stdout: AddFile(Total Files): cumulative 0, interval 0 2021-10-08T19:23:07.480 INFO:journalctl@ceph.mon.b.smithi142.stdout: AddFile(L0 Files): cumulative 0, interval 0 2021-10-08T19:23:07.480 INFO:journalctl@ceph.mon.b.smithi142.stdout: AddFile(Keys): cumulative 0, interval 0 2021-10-08T19:23:07.481 INFO:journalctl@ceph.mon.b.smithi142.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:23:07.481 INFO:journalctl@ceph.mon.b.smithi142.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-10-08T19:23:07.481 INFO:journalctl@ceph.mon.b.smithi142.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-10-08T19:23:07.481 INFO:journalctl@ceph.mon.b.smithi142.stdout: 2021-10-08T19:23:07.481 INFO:journalctl@ceph.mon.b.smithi142.stdout: ** File Read Latency Histogram By Level [default] ** 2021-10-08T19:23:07.482 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b does not exist in monmap, will attempt to join an existing cluster 2021-10-08T19:23:07.482 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: using public_addr v2:172.21.15.142:0/0 -> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:23:07.482 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: starting mon.b rank -1 at public addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] at bind addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:23:07.482 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(???) e0 preinit fsid c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:23:07.483 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).mds e1 new map 2021-10-08T19:23:07.483 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).mds e1 print_map 2021-10-08T19:23:07.483 INFO:journalctl@ceph.mon.b.smithi142.stdout: e1 2021-10-08T19:23:07.483 INFO:journalctl@ceph.mon.b.smithi142.stdout: enable_multiple, ever_enabled_multiple: 1,1 2021-10-08T19:23:07.484 INFO:journalctl@ceph.mon.b.smithi142.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-10-08T19:23:07.484 INFO:journalctl@ceph.mon.b.smithi142.stdout: legacy client fscid: -1 2021-10-08T19:23:07.484 INFO:journalctl@ceph.mon.b.smithi142.stdout: 2021-10-08T19:23:07.484 INFO:journalctl@ceph.mon.b.smithi142.stdout: No filesystems configured 2021-10-08T19:23:07.484 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-10-08T19:23:07.485 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-10-08T19:23:07.485 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-10-08T19:23:07.486 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-10-08T19:23:07.486 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-10-08T19:23:07.486 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-10-08T19:23:07.486 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2021-10-08T19:23:07.487 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:23:07.487 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:23:07.487 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-10-08T19:23:07.487 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.488 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.488 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.488 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.488 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.489 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:23:07.489 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:22:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:07.489 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.489 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.490 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.490 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.490 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.490 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.491 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.491 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.491 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:07.491 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: poll took 47034.597 ms: 1 events 2021-10-08T19:23:07.492 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.492 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:07.492 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:07.492 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:07.492 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Deploying cephadm binary to smithi142 2021-10-08T19:23:07.493 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.153 seconds 2021-10-08T19:23:07.493 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Executing took 0.141 seconds 2021-10-08T19:23:07.493 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Added host smithi142 2021-10-08T19:23:07.493 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.494 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.494 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:07.494 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.494 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:23:07.495 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]': finished 2021-10-08T19:23:07.495 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:07.496 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:07.496 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.496 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:07.497 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Deploying daemon agent.smithi142 on smithi142 2021-10-08T19:23:07.497 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.165 seconds 2021-10-08T19:23:07.497 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.498 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:07.498 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:07.499 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:07.499 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.500 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.500 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:07.501 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:07.501 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:07.501 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.502 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:23:07.502 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:23:07.503 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:07.503 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:07.504 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.504 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:23:07.504 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.505 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/559514263' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-10-08T19:23:07.505 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.506 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Sending message to agent on host smithi142 2021-10-08T19:23:07.506 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:22:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:07.507 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi142 2021-10-08T19:23:07.507 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/559514263' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-10-08T19:23:07.507 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:23:07.508 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.508 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.509 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.509 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:07.510 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:07.510 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:07.510 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:22:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:07.511 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:07.511 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:07.512 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.512 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.513 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:07.513 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:07.513 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.514 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi112:172.21.15.112=a;smithi112:[v2:172.21.15.112:3301,v1:172.21.15.112:6790]=c;smithi142:172.21.15.142=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:07.514 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Saving service mon spec with placement smithi112:172.21.15.112=a;smithi112:[v2:172.21.15.112:3301,v1:172.21.15.112:6790]=c;smithi142:172.21.15.142=b;count:3 2021-10-08T19:23:07.515 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Deploying daemon mon.c on smithi112 2021-10-08T19:23:07.515 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: poll took 7536.941 ms: 1 events 2021-10-08T19:23:07.515 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:23:07.516 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:22:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:07.516 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.517 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/2950343657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:07.517 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:07.518 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.a calling monitor election 2021-10-08T19:23:07.518 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:07.519 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.519 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: poll took 2842.726 ms: 1 events 2021-10-08T19:23:07.519 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:07.519 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:07.519 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.c calling monitor election 2021-10-08T19:23:07.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:07.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:07.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.521 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:07.521 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-10-08T19:23:07.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: monmap e2: 2 mons at {a=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0],c=[v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0]} 2021-10-08T19:23:07.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: fsmap 2021-10-08T19:23:07.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:23:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mgrmap e13: y(active, since 76s) 2021-10-08T19:23:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: overall HEALTH_OK 2021-10-08T19:23:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:07.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:07.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:07.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: Deploying daemon mon.b on smithi142 2021-10-08T19:23:07.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: poll took 4922.746 ms: 1 events 2021-10-08T19:23:07.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/1769621487' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:07.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:07.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-10-08T19:23:07.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 ceph-mon[33432]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-10-08T19:23:07.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:07 smithi142 systemd[1]: Started Ceph mon.b for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:23:07.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:07 smithi112 ceph-mon[31694]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:07.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:07 smithi112 ceph-mon[40655]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:12.570 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:12.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: mon.a calling monitor election 2021-10-08T19:23:12.600 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:12.600 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: mon.c calling monitor election 2021-10-08T19:23:12.600 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: poll took 3927.173 ms: 1 events 2021-10-08T19:23:12.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:12.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: mon.b calling monitor election 2021-10-08T19:23:12.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:12.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.602 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:23:12.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: monmap e3: 3 mons at {a=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0],b=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],c=[v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0]} 2021-10-08T19:23:12.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: fsmap 2021-10-08T19:23:12.603 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:23:12.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: mgrmap e13: y(active, since 86s) 2021-10-08T19:23:12.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: overall HEALTH_OK 2021-10-08T19:23:12.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:12.604 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:12.605 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:12.605 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:12.605 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:12.605 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.606 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: mon.a calling monitor election 2021-10-08T19:23:12.606 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:12.606 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: mon.c calling monitor election 2021-10-08T19:23:12.606 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: poll took 3927.173 ms: 1 events 2021-10-08T19:23:12.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:12.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: mon.b calling monitor election 2021-10-08T19:23:12.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:12.608 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.608 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.608 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.608 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:23:12.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: monmap e3: 3 mons at {a=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0],b=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],c=[v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0]} 2021-10-08T19:23:12.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: fsmap 2021-10-08T19:23:12.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:23:12.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: mgrmap e13: y(active, since 86s) 2021-10-08T19:23:12.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: overall HEALTH_OK 2021-10-08T19:23:12.610 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:12.610 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:12.610 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:12.610 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:12.611 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:23:12.612 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.612 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: mon.a calling monitor election 2021-10-08T19:23:12.612 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:23:12.612 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: mon.c calling monitor election 2021-10-08T19:23:12.613 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: poll took 3927.173 ms: 1 events 2021-10-08T19:23:12.613 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:12.613 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.613 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.613 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: mon.b calling monitor election 2021-10-08T19:23:12.614 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:12.614 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.614 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.614 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:12.615 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-10-08T19:23:12.615 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: monmap e3: 3 mons at {a=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0],b=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],c=[v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0]} 2021-10-08T19:23:12.615 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: fsmap 2021-10-08T19:23:12.615 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: osdmap e4: 0 total, 0 up, 0 in 2021-10-08T19:23:12.615 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: mgrmap e13: y(active, since 86s) 2021-10-08T19:23:12.616 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: overall HEALTH_OK 2021-10-08T19:23:12.616 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:12.616 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:12.616 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:12.617 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:13.610 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.605+0000 7fbd9253c700 1 -- 172.21.15.142:0/1785949119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd74005ef0 msgr2=0x7fbd740082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:13.610 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.605+0000 7fbd9253c700 1 --2- 172.21.15.142:0/1785949119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd74005ef0 0x7fbd740082d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0f8170 tx=0x7fbd7c002040 comp rx=0 tx=0).stop 2021-10-08T19:23:13.610 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.605+0000 7fbd9253c700 1 -- 172.21.15.142:0/1785949119 shutdown_connections 2021-10-08T19:23:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.605+0000 7fbd9253c700 1 --2- 172.21.15.142:0/1785949119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd74005ef0 0x7fbd740082d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.605+0000 7fbd9253c700 1 -- 172.21.15.142:0/1785949119 >> 172.21.15.142:0/1785949119 conn(0x7fbd8c0f2c00 msgr2=0x7fbd8c0f5010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.605+0000 7fbd9253c700 1 -- 172.21.15.142:0/1785949119 shutdown_connections 2021-10-08T19:23:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.605+0000 7fbd9253c700 1 -- 172.21.15.142:0/1785949119 wait complete. 2021-10-08T19:23:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.606+0000 7fbd9253c700 1 Processor -- start 2021-10-08T19:23:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.606+0000 7fbd9253c700 1 -- start start 2021-10-08T19:23:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.606+0000 7fbd9253c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd74005ef0 0x7fbd8c0fe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.606+0000 7fbd9253c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0fee20 0x7fbd8c0ff290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:13.613 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.606+0000 7fbd9253c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c113ba0 0x7fbd8c115f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:13.613 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.606+0000 7fbd9253c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c116750 con 0x7fbd8c0fee20 2021-10-08T19:23:13.613 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.606+0000 7fbd9253c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c1168c0 con 0x7fbd8c113ba0 2021-10-08T19:23:13.613 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.606+0000 7fbd9253c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c116a80 con 0x7fbd74005ef0 2021-10-08T19:23:13.613 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c113ba0 0x7fbd8c115f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:13.614 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c113ba0 0x7fbd8c115f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59054/0 (socket says 172.21.15.142:59054) 2021-10-08T19:23:13.614 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 -- 172.21.15.142:0/4240679121 learned_addr learned my addr 172.21.15.142:0/4240679121 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:23:13.614 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd8b7fe700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0fee20 0x7fbd8c0ff290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:13.614 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd8bfff700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd74005ef0 0x7fbd8c0fe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:13.615 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 -- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd74005ef0 msgr2=0x7fbd8c0fe8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:13.615 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd74005ef0 0x7fbd8c0fe8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:13.615 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 -- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0fee20 msgr2=0x7fbd8c0ff290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:13.615 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0fee20 0x7fbd8c0ff290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:13.615 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 -- 172.21.15.142:0/4240679121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c005040 con 0x7fbd8c113ba0 2021-10-08T19:23:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd90ad9700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c113ba0 0x7fbd8c115f80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400b810 tx=0x7fbd84009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd88ff9700 1 -- 172.21.15.142:0/4240679121 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd840105b0 con 0x7fbd8c113ba0 2021-10-08T19:23:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd88ff9700 1 -- 172.21.15.142:0/4240679121 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbd84010b60 con 0x7fbd8c113ba0 2021-10-08T19:23:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c116d60 con 0x7fbd8c113ba0 2021-10-08T19:23:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd88ff9700 1 -- 172.21.15.142:0/4240679121 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84011b10 con 0x7fbd8c113ba0 2021-10-08T19:23:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.607+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c117220 con 0x7fbd8c113ba0 2021-10-08T19:23:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.608+0000 7fbd88ff9700 1 -- 172.21.15.142:0/4240679121 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7fbd8400f070 con 0x7fbd8c113ba0 2021-10-08T19:23:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.608+0000 7fbd88ff9700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbd78033c00 0x7fbd780360b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.608+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c05a9f0 con 0x7fbd8c113ba0 2021-10-08T19:23:13.618 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.608+0000 7fbd88ff9700 1 -- 172.21.15.142:0/4240679121 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbd84044ac0 con 0x7fbd8c113ba0 2021-10-08T19:23:13.618 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.609+0000 7fbd8bfff700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbd78033c00 0x7fbd780360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:13.618 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.609+0000 7fbd8bfff700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbd78033c00 0x7fbd780360b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009c00 tx=0x7fbd7c002040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:13.619 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.613+0000 7fbd88ff9700 1 -- 172.21.15.142:0/4240679121 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fbd84018900 con 0x7fbd8c113ba0 2021-10-08T19:23:13.683 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:13.684 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: Sending message to agent on host smithi142 2021-10-08T19:23:13.684 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: Sending message to agent on host smithi112 2021-10-08T19:23:13.685 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: Updating smithi112:/etc/ceph/ceph.conf 2021-10-08T19:23:13.685 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:23:13.685 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: poll took 4988.013 ms: 1 events 2021-10-08T19:23:13.685 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi142 2021-10-08T19:23:13.686 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.686 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.686 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.686 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:13.687 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:23:13.687 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:13.687 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:13.687 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:13.688 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: Reconfiguring daemon mon.a on smithi112 2021-10-08T19:23:13.688 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:13.688 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:13.688 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: Sending message to agent on host smithi142 2021-10-08T19:23:13.689 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: Sending message to agent on host smithi112 2021-10-08T19:23:13.689 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: Updating smithi112:/etc/ceph/ceph.conf 2021-10-08T19:23:13.689 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:23:13.689 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: poll took 4988.013 ms: 1 events 2021-10-08T19:23:13.689 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi142 2021-10-08T19:23:13.690 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.690 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.690 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.690 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:13.691 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:23:13.691 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:13.691 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:13.691 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:13.692 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: Reconfiguring daemon mon.a on smithi112 2021-10-08T19:23:13.692 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:13.710 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:13.711 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: Sending message to agent on host smithi142 2021-10-08T19:23:13.711 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: Sending message to agent on host smithi112 2021-10-08T19:23:13.711 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: Updating smithi112:/etc/ceph/ceph.conf 2021-10-08T19:23:13.711 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:23:13.711 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: poll took 4988.013 ms: 1 events 2021-10-08T19:23:13.712 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi142 2021-10-08T19:23:13.712 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.712 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.712 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:13.713 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:13.713 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: Reconfiguring mon.a (unknown last config time)... 2021-10-08T19:23:13.713 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:13.713 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:13.713 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:13.714 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: Reconfiguring daemon mon.a on smithi112 2021-10-08T19:23:13.714 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:23:13.859 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.858+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbd8c100020 con 0x7fbd8c113ba0 2021-10-08T19:23:13.859 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.858+0000 7fbd88ff9700 1 -- 172.21.15.142:0/4240679121 <== mon.2 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1234 (secure 0 0 0) 0x7fbd84001310 con 0x7fbd8c113ba0 2021-10-08T19:23:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: 2021-10-08T19:23:13.860 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":3,"fsid":"c1559bde-286c-11ec-8c25-001a4aab830c","modified":"2021-10-08T19:23:07.214579Z","created":"2021-10-08T19:21:00.903107Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3301","nonce":0},{"type":"v1","addr":"172.21.15.112:6790","nonce":0}]},"addr":"172.21.15.112:6790/0","public_addr":"172.21.15.112:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2021-10-08T19:23:13.861 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbd78033c00 msgr2=0x7fbd780360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:13.862 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbd78033c00 0x7fbd780360b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009c00 tx=0x7fbd7c002040 comp rx=0 tx=0).stop 2021-10-08T19:23:13.862 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c113ba0 msgr2=0x7fbd8c115f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:13.862 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c113ba0 0x7fbd8c115f80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400b810 tx=0x7fbd84009220 comp rx=0 tx=0).stop 2021-10-08T19:23:13.862 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 shutdown_connections 2021-10-08T19:23:13.863 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbd78033c00 0x7fbd780360b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:13.863 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c113ba0 0x7fbd8c115f80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:13.863 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd74005ef0 0x7fbd8c0fe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:13.864 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 --2- 172.21.15.142:0/4240679121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd8c0fee20 0x7fbd8c0ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:13.864 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.860+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 >> 172.21.15.142:0/4240679121 conn(0x7fbd8c0f2c00 msgr2=0x7fbd8c100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:13.864 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.861+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 shutdown_connections 2021-10-08T19:23:13.865 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:13.861+0000 7fbd9253c700 1 -- 172.21.15.142:0/4240679121 wait complete. 2021-10-08T19:23:13.865 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 3 2021-10-08T19:23:14.480 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-10-08T19:23:14.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph config generate-minimal-conf 2021-10-08T19:23:14.730 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi112 2021-10-08T19:23:14.730 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/4240679121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:14.731 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:14.731 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:14.731 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:14.731 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:14.732 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi112 2021-10-08T19:23:14.732 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/4240679121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:14.732 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:14.732 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:14.733 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:14.733 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:14 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:14.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:14 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi112 2021-10-08T19:23:14.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/4240679121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-10-08T19:23:14.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:14 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:14.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:14 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:14 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:14 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:15.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:15 smithi142 ceph-mon[33432]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:15 smithi142 ceph-mon[33432]: poll took 1577.602 ms: 1 events 2021-10-08T19:23:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:15 smithi142 ceph-mon[33432]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:23:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:15 smithi142 ceph-mon[33432]: Reconfiguring daemon mon.c on smithi112 2021-10-08T19:23:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:15 smithi112 ceph-mon[31694]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:15 smithi112 ceph-mon[31694]: poll took 1577.602 ms: 1 events 2021-10-08T19:23:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:15 smithi112 ceph-mon[31694]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:23:15.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:15 smithi112 ceph-mon[31694]: Reconfiguring daemon mon.c on smithi112 2021-10-08T19:23:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:15 smithi112 ceph-mon[40655]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:15 smithi112 ceph-mon[40655]: poll took 1577.602 ms: 1 events 2021-10-08T19:23:15.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:15 smithi112 ceph-mon[40655]: Reconfiguring mon.c (monmap changed)... 2021-10-08T19:23:15.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:15 smithi112 ceph-mon[40655]: Reconfiguring daemon mon.c on smithi112 2021-10-08T19:23:16.528 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:23:16 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:23:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:16.761 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 -- 172.21.15.112:0/324800366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4040fd5e0 msgr2=0x7fa4040f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:16.762 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/324800366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4040fd5e0 0x7fa4040f6ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4004820 tx=0x7fa3f400ac40 comp rx=0 tx=0).stop 2021-10-08T19:23:16.762 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 -- 172.21.15.112:0/324800366 shutdown_connections 2021-10-08T19:23:16.762 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/324800366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4040f7410 0x7fa404103ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.763 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/324800366 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4040fcc40 0x7fa4040fd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.763 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/324800366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4040fd5e0 0x7fa4040f6ce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.763 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 -- 172.21.15.112:0/324800366 >> 172.21.15.112:0/324800366 conn(0x7fa40406d8c0 msgr2=0x7fa4040f4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:16.763 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 -- 172.21.15.112:0/324800366 shutdown_connections 2021-10-08T19:23:16.764 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.759+0000 7fa40bdd5700 1 -- 172.21.15.112:0/324800366 wait complete. 2021-10-08T19:23:16.764 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40bdd5700 1 Processor -- start 2021-10-08T19:23:16.764 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40bdd5700 1 -- start start 2021-10-08T19:23:16.764 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40bdd5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4040f7410 0x7fa40410e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:16.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40bdd5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4040fcc40 0x7fa40410ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:16.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40bdd5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4040fd5e0 0x7fa4041087c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:16.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40bdd5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa404108d50 con 0x7fa4040fd5e0 2021-10-08T19:23:16.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40bdd5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa404108e90 con 0x7fa4040fcc40 2021-10-08T19:23:16.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40bdd5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa404109050 con 0x7fa4040f7410 2021-10-08T19:23:16.766 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409b71700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4040f7410 0x7fa40410e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:16.766 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409b71700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4040f7410 0x7fa40410e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:55028/0 (socket says 172.21.15.112:55028) 2021-10-08T19:23:16.766 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409b71700 1 -- 172.21.15.112:0/3579560574 learned_addr learned my addr 172.21.15.112:0/3579560574 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:23:16.766 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409370700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4040fcc40 0x7fa40410ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:16.767 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa40a372700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4040fd5e0 0x7fa4041087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:16.767 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409b71700 1 -- 172.21.15.112:0/3579560574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4040fcc40 msgr2=0x7fa40410ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:16.767 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409b71700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4040fcc40 0x7fa40410ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.767 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409b71700 1 -- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4040fd5e0 msgr2=0x7fa4041087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:16.767 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409b71700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4040fd5e0 0x7fa4041087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.768 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.760+0000 7fa409b71700 1 -- 172.21.15.112:0/3579560574 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400005040 con 0x7fa4040f7410 2021-10-08T19:23:16.768 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.761+0000 7fa409b71700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4040f7410 0x7fa40410e720 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa4000048f0 tx=0x7fa400009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:16.768 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.761+0000 7fa3fa7fc700 1 -- 172.21.15.112:0/3579560574 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40000e050 con 0x7fa4040f7410 2021-10-08T19:23:16.768 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.761+0000 7fa3fa7fc700 1 -- 172.21.15.112:0/3579560574 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fa40000f040 con 0x7fa4040f7410 2021-10-08T19:23:16.769 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.761+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f4005040 con 0x7fa4040f7410 2021-10-08T19:23:16.769 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.761+0000 7fa3fa7fc700 1 -- 172.21.15.112:0/3579560574 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000146d0 con 0x7fa4040f7410 2021-10-08T19:23:16.769 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.761+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa404115540 con 0x7fa4040f7410 2021-10-08T19:23:16.769 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.761+0000 7fa3fa7fc700 1 -- 172.21.15.112:0/3579560574 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7fa40001b030 con 0x7fa4040f7410 2021-10-08T19:23:16.770 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.762+0000 7fa3fa7fc700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fa3f0033a20 0x7fa3f0035ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:16.770 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.762+0000 7fa3fa7fc700 1 -- 172.21.15.112:0/3579560574 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa400043f80 con 0x7fa4040f7410 2021-10-08T19:23:16.771 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.762+0000 7fa409370700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fa3f0033a20 0x7fa3f0035ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:16.771 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.762+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa404047b50 con 0x7fa4040f7410 2021-10-08T19:23:16.771 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.763+0000 7fa409370700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fa3f0033a20 0x7fa3f0035ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4004f00 tx=0x7fa3f400ac40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:16.771 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.768+0000 7fa3fa7fc700 1 -- 172.21.15.112:0/3579560574 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fa400019020 con 0x7fa4040f7410 2021-10-08T19:23:16.953 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.951+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa404105690 con 0x7fa4040f7410 2021-10-08T19:23:16.953 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.952+0000 7fa3fa7fc700 1 -- 172.21.15.112:0/3579560574 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7fa40001b870 con 0x7fa4040f7410 2021-10-08T19:23:16.954 INFO:teuthology.orchestra.run.smithi112.stdout:# minimal ceph.conf for c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:23:16.954 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2021-10-08T19:23:16.954 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:23:16.954 INFO:teuthology.orchestra.run.smithi112.stdout: mon_host = [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:23:16.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fa3f0033a20 msgr2=0x7fa3f0035ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:16.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fa3f0033a20 0x7fa3f0035ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4004f00 tx=0x7fa3f400ac40 comp rx=0 tx=0).stop 2021-10-08T19:23:16.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4040f7410 msgr2=0x7fa40410e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:16.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4040f7410 0x7fa40410e720 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa4000048f0 tx=0x7fa400009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:16.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 shutdown_connections 2021-10-08T19:23:16.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fa3f0033a20 0x7fa3f0035ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.957 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4040fd5e0 0x7fa4041087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.957 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa4040f7410 0x7fa40410e720 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.957 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 --2- 172.21.15.112:0/3579560574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4040fcc40 0x7fa40410ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:16.957 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 >> 172.21.15.112:0/3579560574 conn(0x7fa40406d8c0 msgr2=0x7fa40406e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:16.958 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 shutdown_connections 2021-10-08T19:23:16.958 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:16.954+0000 7fa40bdd5700 1 -- 172.21.15.112:0/3579560574 wait complete. 2021-10-08T19:23:17.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:17 smithi142 ceph-mon[33432]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:17 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:17 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:17 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:23:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:17 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:17 smithi142 ceph-mon[33432]: poll took 2033.012 ms: 1 events 2021-10-08T19:23:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3579560574' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:17.530 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[40655]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:17.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:17.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:17.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:23:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:17.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:17.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[40655]: poll took 2033.012 ms: 1 events 2021-10-08T19:23:17.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3579560574' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:17.532 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[31694]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:17.532 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:17.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:17.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:23:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:17.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:17.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[31694]: poll took 2033.012 ms: 1 events 2021-10-08T19:23:17.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3579560574' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:18.115 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-10-08T19:23:18.116 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:23:18.116 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2021-10-08T19:23:18.148 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:23:18.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:23:18.215 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:23:18.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.conf 2021-10-08T19:23:18.243 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:23:18.244 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:23:18.309 INFO:tasks.cephadm:Adding mgr.y on smithi112 2021-10-08T19:23:18.309 INFO:tasks.cephadm:Adding mgr.x on smithi142 2021-10-08T19:23:18.310 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch apply mgr '2;smithi112=y;smithi142=x' 2021-10-08T19:23:19.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:23:18 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:23:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: poll took 1683.418 ms: 1 events 2021-10-08T19:23:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:23:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: Reconfiguring daemon mon.b on smithi142 2021-10-08T19:23:19.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:19 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:19.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: poll took 1683.418 ms: 1 events 2021-10-08T19:23:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:23:19.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:19.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:19.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:19.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: Reconfiguring daemon mon.b on smithi142 2021-10-08T19:23:19.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: poll took 1683.418 ms: 1 events 2021-10-08T19:23:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: Reconfiguring mon.b (monmap changed)... 2021-10-08T19:23:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-10-08T19:23:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-10-08T19:23:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: Reconfiguring daemon mon.b on smithi142 2021-10-08T19:23:19.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:19 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:20.216 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/1239714166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f90b0 msgr2=0x7fcd680ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:20.216 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/1239714166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f90b0 0x7fcd680ff970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009a60 tx=0x7fcd60004d10 comp rx=0 tx=0).stop 2021-10-08T19:23:20.216 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/1239714166 shutdown_connections 2021-10-08T19:23:20.217 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/1239714166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f90b0 0x7fcd680ff970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.217 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/1239714166 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd680f7480 0x7fcd680f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.217 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/1239714166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd680f8720 0x7fcd680f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.217 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/1239714166 >> 172.21.15.142:0/1239714166 conn(0x7fcd680f2c70 msgr2=0x7fcd680f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:20.218 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/1239714166 shutdown_connections 2021-10-08T19:23:20.218 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/1239714166 wait complete. 2021-10-08T19:23:20.218 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 Processor -- start 2021-10-08T19:23:20.218 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.212+0000 7fcd6ca3f700 1 -- start start 2021-10-08T19:23:20.218 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6ca3f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd680f7480 0x7fcd68062600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:20.219 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6ca3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f8720 0x7fcd6810d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:20.219 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6ca3f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd680f90b0 0x7fcd6810fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:20.219 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6ca3f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68110220 con 0x7fcd680f90b0 2021-10-08T19:23:20.219 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6ca3f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68110390 con 0x7fcd680f8720 2021-10-08T19:23:20.220 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6ca3f700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68110550 con 0x7fcd680f7480 2021-10-08T19:23:20.220 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f8720 0x7fcd6810d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:20.220 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f8720 0x7fcd6810d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59066/0 (socket says 172.21.15.142:59066) 2021-10-08T19:23:20.220 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 -- 172.21.15.142:0/156506439 learned_addr learned my addr 172.21.15.142:0/156506439 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:23:20.220 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6659c700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd680f7480 0x7fcd68062600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:20.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd66d9d700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd680f90b0 0x7fcd6810fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:20.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 -- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd680f7480 msgr2=0x7fcd68062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:20.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd680f7480 0x7fcd68062600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 -- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd680f90b0 msgr2=0x7fcd6810fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:20.221 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd680f90b0 0x7fcd6810fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 -- 172.21.15.142:0/156506439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60009640 con 0x7fcd680f8720 2021-10-08T19:23:20.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd65d9b700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f8720 0x7fcd6810d3b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00b490 tx=0x7fcd5c006ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:20.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd56ffd700 1 -- 172.21.15.142:0/156506439 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00be00 con 0x7fcd680f8720 2021-10-08T19:23:20.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd68110830 con 0x7fcd680f8720 2021-10-08T19:23:20.222 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd56ffd700 1 -- 172.21.15.142:0/156506439 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fcd5c00f960 con 0x7fcd680f8720 2021-10-08T19:23:20.223 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd56ffd700 1 -- 172.21.15.142:0/156506439 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c011960 con 0x7fcd680f8720 2021-10-08T19:23:20.223 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.213+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd68110d20 con 0x7fcd680f8720 2021-10-08T19:23:20.223 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.214+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd680289c0 con 0x7fcd680f8720 2021-10-08T19:23:20.223 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.214+0000 7fcd56ffd700 1 -- 172.21.15.142:0/156506439 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7fcd5c017020 con 0x7fcd680f8720 2021-10-08T19:23:20.224 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.215+0000 7fcd56ffd700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fcd50033a20 0x7fcd50035ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:20.224 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.215+0000 7fcd56ffd700 1 -- 172.21.15.142:0/156506439 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcd5c043b00 con 0x7fcd680f8720 2021-10-08T19:23:20.224 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.215+0000 7fcd6659c700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fcd50033a20 0x7fcd50035ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:20.224 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.215+0000 7fcd6659c700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fcd50033a20 0x7fcd50035ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcd58006fd0 tx=0x7fcd58008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:20.225 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.219+0000 7fcd56ffd700 1 -- 172.21.15.142:0/156506439 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fcd5c00fad0 con 0x7fcd680f8720 2021-10-08T19:23:20.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:20 smithi142 ceph-mon[33432]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:20.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:20 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:23:20.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:20 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:23:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:20.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:20 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:20.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:20 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:20 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:20 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:20 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:20.385 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.385+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi112=y;smithi142=x", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd68059800 con 0x7fcd50033a20 2021-10-08T19:23:20.393 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.393+0000 7fcd56ffd700 1 -- 172.21.15.142:0/156506439 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcd68059800 con 0x7fcd50033a20 2021-10-08T19:23:20.394 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled mgr update... 2021-10-08T19:23:20.396 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fcd50033a20 msgr2=0x7fcd50035ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:20.396 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fcd50033a20 0x7fcd50035ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcd58006fd0 tx=0x7fcd58008040 comp rx=0 tx=0).stop 2021-10-08T19:23:20.396 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f8720 msgr2=0x7fcd6810d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:20.396 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f8720 0x7fcd6810d3b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00b490 tx=0x7fcd5c006ef0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.397 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 shutdown_connections 2021-10-08T19:23:20.397 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fcd50033a20 0x7fcd50035ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.397 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd680f90b0 0x7fcd6810fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.398 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcd680f7480 0x7fcd68062600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.398 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 --2- 172.21.15.142:0/156506439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680f8720 0x7fcd6810d3b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:20.398 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 >> 172.21.15.142:0/156506439 conn(0x7fcd680f2c70 msgr2=0x7fcd680f4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:20.399 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 shutdown_connections 2021-10-08T19:23:20.399 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:23:20.395+0000 7fcd6ca3f700 1 -- 172.21.15.142:0/156506439 wait complete. 2021-10-08T19:23:20.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:20.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:23:20.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:23:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:20.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[40655]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:20.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:23:20.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:23:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:20.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:20.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:20.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:20.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:20.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:20 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:21.079 DEBUG:teuthology.orchestra.run.smithi142:mgr.x> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@mgr.x.service 2021-10-08T19:23:21.082 INFO:tasks.cephadm:Deploying OSDs... 2021-10-08T19:23:21.082 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:23:21.083 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2021-10-08T19:23:21.103 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-08T19:23:21.104 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-08T19:23:21.107 INFO:journalctl@ceph.mgr.x.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:23:21.162 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-08T19:23:21.162 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:23:21.162 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 115958 Links: 1 2021-10-08T19:23:21.163 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:23:21.163 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:23:21.163 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2021-10-08 19:23:15.515378815 +0000 2021-10-08T19:23:21.163 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2021-10-08 19:08:29.731317657 +0000 2021-10-08T19:23:21.164 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2021-10-08 19:08:29.731317657 +0000 2021-10-08T19:23:21.164 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2021-10-08T19:23:21.174 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2021-10-08T19:23:21.174 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2021-10-08T19:23:21.174 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000261073 s, 2.0 MB/s 2021-10-08T19:23:21.177 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-08T19:23:21.235 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-08T19:23:21.235 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:23:21.235 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 116053 Links: 1 2021-10-08T19:23:21.236 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:23:21.236 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:23:21.236 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2021-10-08 19:23:15.515378815 +0000 2021-10-08T19:23:21.236 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2021-10-08 19:08:30.073314624 +0000 2021-10-08T19:23:21.237 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2021-10-08 19:08:30.073314624 +0000 2021-10-08T19:23:21.237 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2021-10-08T19:23:21.250 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2021-10-08T19:23:21.251 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2021-10-08T19:23:21.251 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000282943 s, 1.8 MB/s 2021-10-08T19:23:21.252 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-08T19:23:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-08T19:23:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:23:21.308 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 117949 Links: 1 2021-10-08T19:23:21.308 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:23:21.309 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:23:21.309 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2021-10-08 19:23:15.515378815 +0000 2021-10-08T19:23:21.309 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2021-10-08 19:08:30.460311192 +0000 2021-10-08T19:23:21.309 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2021-10-08 19:08:30.460311192 +0000 2021-10-08T19:23:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2021-10-08T19:23:21.319 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2021-10-08T19:23:21.319 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2021-10-08T19:23:21.319 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000224984 s, 2.3 MB/s 2021-10-08T19:23:21.322 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-08T19:23:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-08T19:23:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:23:21.380 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 115005 Links: 1 2021-10-08T19:23:21.381 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:23:21.381 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2021-10-08 19:23:15.515378815 +0000 2021-10-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2021-10-08 19:08:30.793308240 +0000 2021-10-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2021-10-08 19:08:30.793308240 +0000 2021-10-08T19:23:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2021-10-08T19:23:21.390 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2021-10-08T19:23:21.390 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2021-10-08T19:23:21.391 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000216065 s, 2.4 MB/s 2021-10-08T19:23:21.394 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:23:21.395 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2021-10-08T19:23:21.410 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-08T19:23:21.411 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-08T19:23:21.465 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-08T19:23:21.466 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:23:21.466 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 110094 Links: 1 2021-10-08T19:23:21.466 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:23:21.466 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:23:21.467 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2021-10-08 19:23:14.564479201 +0000 2021-10-08T19:23:21.467 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2021-10-08 19:08:29.933512946 +0000 2021-10-08T19:23:21.467 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2021-10-08 19:08:29.933512946 +0000 2021-10-08T19:23:21.467 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2021-10-08T19:23:21.477 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2021-10-08T19:23:21.478 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2021-10-08T19:23:21.478 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000223533 s, 2.3 MB/s 2021-10-08T19:23:21.480 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-08T19:23:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: poll took 1481.864 ms: 1 events 2021-10-08T19:23:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi112=y;smithi142=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: Saving service mgr spec with placement smithi112=y;smithi142=x;count:2 2021-10-08T19:23:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:21.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:21.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:23:21.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:23:21.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:23:21.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:21.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:21 smithi142 ceph-mon[33432]: Deploying daemon mgr.x on smithi142 2021-10-08T19:23:21.542 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-08T19:23:21.543 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:23:21.543 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 109442 Links: 1 2021-10-08T19:23:21.544 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:23:21.544 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:23:21.544 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2021-10-08 19:23:14.564479201 +0000 2021-10-08T19:23:21.545 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2021-10-08 19:08:30.266507179 +0000 2021-10-08T19:23:21.545 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2021-10-08 19:08:30.266507179 +0000 2021-10-08T19:23:21.546 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2021-10-08T19:23:21.552 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2021-10-08T19:23:21.552 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2021-10-08T19:23:21.553 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000189719 s, 2.7 MB/s 2021-10-08T19:23:21.555 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-08T19:23:21.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: poll took 1481.864 ms: 1 events 2021-10-08T19:23:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi112=y;smithi142=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: Saving service mgr spec with placement smithi112=y;smithi142=x;count:2 2021-10-08T19:23:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:21.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:23:21.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:23:21.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:23:21.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:21.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[31694]: Deploying daemon mgr.x on smithi142 2021-10-08T19:23:21.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:21.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: poll took 1481.864 ms: 1 events 2021-10-08T19:23:21.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi112=y;smithi142=x", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:21.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: Saving service mgr spec with placement smithi112=y;smithi142=x;count:2 2021-10-08T19:23:21.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:21.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:21.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:21.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:21.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:21.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:23:21.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-10-08T19:23:21.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:23:21.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:21.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:21 smithi112 ceph-mon[40655]: Deploying daemon mgr.x on smithi142 2021-10-08T19:23:21.610 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-08T19:23:21.610 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:23:21.610 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 115104 Links: 1 2021-10-08T19:23:21.611 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:23:21.611 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:23:21.611 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2021-10-08 19:23:14.564479201 +0000 2021-10-08T19:23:21.611 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2021-10-08 19:08:30.624500980 +0000 2021-10-08T19:23:21.612 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2021-10-08 19:08:30.624500980 +0000 2021-10-08T19:23:21.612 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2021-10-08T19:23:21.620 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2021-10-08T19:23:21.620 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2021-10-08T19:23:21.621 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000212779 s, 2.4 MB/s 2021-10-08T19:23:21.623 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-08T19:23:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-08T19:23:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-08T19:23:21.678 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 116823 Links: 1 2021-10-08T19:23:21.679 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-08T19:23:21.679 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2021-10-08T19:23:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2021-10-08 19:23:14.564479201 +0000 2021-10-08T19:23:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2021-10-08 19:08:30.970494988 +0000 2021-10-08T19:23:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2021-10-08 19:08:30.970494988 +0000 2021-10-08T19:23:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2021-10-08T19:23:21.687 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2021-10-08T19:23:21.687 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2021-10-08T19:23:21.688 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000185654 s, 2.8 MB/s 2021-10-08T19:23:21.690 INFO:tasks.cephadm:Deploying osd.0 on smithi112 with /dev/vg_nvme/lv_4... 2021-10-08T19:23:21.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-10-08T19:23:22.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:23:22 smithi142 systemd[1]: Starting Ceph mgr.x for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:23:22.822 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:23:22 smithi142 ceph-mgr[35397]: -- 172.21.15.142:0/2682436123 <== mon.2 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561fead02340 con 0x561feacd8c00 2021-10-08T19:23:22.822 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:23:22 smithi142 bash[35187]: e2fb6aa8dd4096857f0d0d49c2a35b1b77b22fe6938e308257b477f2bcfa39f9 2021-10-08T19:23:23.272 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:23:22 smithi142 systemd[1]: Started Ceph mgr.x for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:23:23.538 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:23.539 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:23.539 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:23.539 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:23.539 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:23.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:23.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:23:23.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:23:23.541 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:23.541 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:23.542 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:23.542 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:23.542 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:23.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:23.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:23.543 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:23:23.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:23:23.544 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-10-08T19:23:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-10-08T19:23:23.745 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2021-10-08T19:23:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2021-10-08T19:23:23.746 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112694 s, 930 MB/s 2021-10-08T19:23:23.746 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2021-10-08T19:23:23.757 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:23.757 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:23.758 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:23.758 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:23.759 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:23.759 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:23.759 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-10-08T19:23:23.760 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-10-08T19:23:23.760 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:24.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[31694]: Sending message to agent on host smithi142 2021-10-08T19:23:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[31694]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:23:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[31694]: Reconfiguring daemon mgr.y on smithi112 2021-10-08T19:23:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi142 2021-10-08T19:23:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[40655]: Sending message to agent on host smithi142 2021-10-08T19:23:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[40655]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:23:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[40655]: Reconfiguring daemon mgr.y on smithi112 2021-10-08T19:23:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:24 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi142 2021-10-08T19:23:24.666 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:24 smithi142 ceph-mon[33432]: Sending message to agent on host smithi142 2021-10-08T19:23:24.667 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:24 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:24.667 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:24 smithi142 ceph-mon[33432]: Reconfiguring mgr.y (unknown last config time)... 2021-10-08T19:23:24.667 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:24 smithi142 ceph-mon[33432]: Reconfiguring daemon mgr.y on smithi112 2021-10-08T19:23:24.667 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:24 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi142 2021-10-08T19:23:24.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2021-10-08T19:23:26.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:25 smithi142 ceph-mon[33432]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:25 smithi142 ceph-mon[33432]: poll took 1376.660 ms: 1 events 2021-10-08T19:23:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:26.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:26.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:25 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:26.070 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[40655]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:26.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[40655]: poll took 1376.660 ms: 1 events 2021-10-08T19:23:26.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:26.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[31694]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[31694]: poll took 1376.660 ms: 1 events 2021-10-08T19:23:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:26.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:26.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:26.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:26.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:25 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:23:26.528 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 -- 172.21.15.112:0/4031403199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f74b0 msgr2=0x7fbb780f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:26.528 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/4031403199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f74b0 0x7fbb780f78c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0046e0 tx=0x7fbb6c009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:26.529 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 -- 172.21.15.112:0/4031403199 shutdown_connections 2021-10-08T19:23:26.529 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/4031403199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780f90e0 0x7fbb780ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:26.530 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/4031403199 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f74b0 0x7fbb780f78c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:26.530 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/4031403199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb780f8750 0x7fbb780f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:26.530 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 -- 172.21.15.112:0/4031403199 >> 172.21.15.112:0/4031403199 conn(0x7fbb780f2ca0 msgr2=0x7fbb780f50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 -- 172.21.15.112:0/4031403199 shutdown_connections 2021-10-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.527+0000 7fbb7eecf700 1 -- 172.21.15.112:0/4031403199 wait complete. 2021-10-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7eecf700 1 Processor -- start 2021-10-08T19:23:26.531 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7eecf700 1 -- start start 2021-10-08T19:23:26.534 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7eecf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780f74b0 0x7fbb78061fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:26.534 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7eecf700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f8750 0x7fbb7810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:26.534 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7eecf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb780f90e0 0x7fbb7810fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:26.534 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7eecf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb781102e0 con 0x7fbb780f90e0 2021-10-08T19:23:26.535 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7eecf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78110450 con 0x7fbb780f74b0 2021-10-08T19:23:26.535 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7eecf700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78110610 con 0x7fbb780f8750 2021-10-08T19:23:26.535 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb77fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f8750 0x7fbb7810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:26.535 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb77fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f8750 0x7fbb7810d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:55044/0 (socket says 172.21.15.112:55044) 2021-10-08T19:23:26.535 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb77fff700 1 -- 172.21.15.112:0/72241520 learned_addr learned my addr 172.21.15.112:0/72241520 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:23:26.536 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7d46c700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb780f90e0 0x7fbb7810fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:26.536 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7cc6b700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780f74b0 0x7fbb78061fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:26.536 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb77fff700 1 -- 172.21.15.112:0/72241520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780f74b0 msgr2=0x7fbb78061fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:26.536 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb77fff700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780f74b0 0x7fbb78061fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:26.537 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb77fff700 1 -- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb780f90e0 msgr2=0x7fbb7810fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:26.537 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb77fff700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb780f90e0 0x7fbb7810fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:26.537 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb77fff700 1 -- 172.21.15.112:0/72241520 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64005040 con 0x7fbb780f8750 2021-10-08T19:23:26.537 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.528+0000 7fbb7d46c700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb780f90e0 0x7fbb7810fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:23:26.538 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.529+0000 7fbb77fff700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f8750 0x7fbb7810d590 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb640048f0 tx=0x7fbb64009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:26.538 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.529+0000 7fbb757fa700 1 -- 172.21.15.112:0/72241520 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6400e050 con 0x7fbb780f8750 2021-10-08T19:23:26.538 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.529+0000 7fbb757fa700 1 -- 172.21.15.112:0/72241520 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbb6400f040 con 0x7fbb780f8750 2021-10-08T19:23:26.538 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.529+0000 7fbb757fa700 1 -- 172.21.15.112:0/72241520 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb640146d0 con 0x7fbb780f8750 2021-10-08T19:23:26.538 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.529+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c005040 con 0x7fbb780f8750 2021-10-08T19:23:26.539 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.529+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb78110cd0 con 0x7fbb780f8750 2021-10-08T19:23:26.539 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.529+0000 7fbb757fa700 1 -- 172.21.15.112:0/72241520 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 13) v1 ==== 40554+0+0 (secure 0 0 0) 0x7fbb6401b030 con 0x7fbb780f8750 2021-10-08T19:23:26.539 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.530+0000 7fbb757fa700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbb68033a20 0x7fbb68035ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:26.539 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.530+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb781021d0 con 0x7fbb780f8750 2021-10-08T19:23:26.540 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.530+0000 7fbb757fa700 1 -- 172.21.15.112:0/72241520 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbb640441d0 con 0x7fbb780f8750 2021-10-08T19:23:26.540 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.530+0000 7fbb7cc6b700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbb68033a20 0x7fbb68035ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:26.541 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.530+0000 7fbb7cc6b700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbb68033a20 0x7fbb68035ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0046b0 tx=0x7fbb6c009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:26.541 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.534+0000 7fbb757fa700 1 -- 172.21.15.112:0/72241520 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fbb64019070 con 0x7fbb780f8750 2021-10-08T19:23:26.701 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:26.701+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb78059800 con 0x7fbb68033a20 2021-10-08T19:23:27.744 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:23:27 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:23:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:27.746 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[40655]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:27.746 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:27.746 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:27.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:27.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:27.747 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[31694]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:27.747 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:27.748 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:27.748 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:27.748 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:27 smithi142 ceph-mon[33432]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:28.547 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:28.548 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: poll took 2029.869 ms: 1 events 2021-10-08T19:23:28.548 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:28.548 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:28.549 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:28.549 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:28.549 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:23:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:28.549 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:28.549 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:28.550 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:28.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:28.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: poll took 2029.869 ms: 1 events 2021-10-08T19:23:28.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:28.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:28.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:28.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:28.553 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:23:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:28.553 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:28.553 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:28.553 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:28 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:28.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:28.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: poll took 2029.869 ms: 1 events 2021-10-08T19:23:28.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:28.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:23:28.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:23:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:28.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:28 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:29.355+0000 7fbb757fa700 1 -- 172.21.15.112:0/72241520 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mgrmap(e 14) v1 ==== 80765+0+0 (secure 0 0 0) 0x7fbb64014b70 con 0x7fbb780f8750 2021-10-08T19:23:29.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: Standby manager daemon x started 2021-10-08T19:23:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:23:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:23:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:23:29.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:23:29.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3938232724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db"}]: dispatch 2021-10-08T19:23:29.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3938232724' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db"}]': finished 2021-10-08T19:23:29.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:23:29.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:29.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:29.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: Standby manager daemon x started 2021-10-08T19:23:29.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:23:29.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:23:29.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:23:29.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:23:29.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3938232724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db"}]: dispatch 2021-10-08T19:23:29.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3938232724' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db"}]': finished 2021-10-08T19:23:29.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:23:29.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:29.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:29.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: Standby manager daemon x started 2021-10-08T19:23:29.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:23:29.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:23:29.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:23:29.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: from='mgr.? 172.21.15.142:0/1402158533' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:23:29.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3938232724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db"}]: dispatch 2021-10-08T19:23:29.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3938232724' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db"}]': finished 2021-10-08T19:23:29.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: osdmap e5: 1 total, 0 up, 1 in 2021-10-08T19:23:29.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:30.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:30 smithi142 ceph-mon[33432]: mgrmap e14: y(active, since 103s), standbys: x 2021-10-08T19:23:30.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:30 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:23:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3842431057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:30.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:30 smithi112 ceph-mon[31694]: mgrmap e14: y(active, since 103s), standbys: x 2021-10-08T19:23:30.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:30 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:23:30.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3842431057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:30.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:30 smithi112 ceph-mon[40655]: mgrmap e14: y(active, since 103s), standbys: x 2021-10-08T19:23:30.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:30 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:23:30.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3842431057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:31.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:31 smithi142 ceph-mon[33432]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:31.820 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:31 smithi112 ceph-mon[40655]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:31.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:31 smithi112 ceph-mon[31694]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:33.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:33 smithi112 ceph-mon[31694]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:33.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:33 smithi112 ceph-mon[31694]: poll took 5490.068 ms: 1 events 2021-10-08T19:23:33.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:33 smithi112 ceph-mon[40655]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:33.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:33 smithi112 ceph-mon[40655]: poll took 5490.068 ms: 1 events 2021-10-08T19:23:33.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:33 smithi142 ceph-mon[33432]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:33.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:33 smithi142 ceph-mon[33432]: poll took 5490.068 ms: 1 events 2021-10-08T19:23:35.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:35 smithi142 ceph-mon[33432]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:35.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:23:35.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:35.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:35 smithi112 ceph-mon[31694]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:35.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:23:35.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:35.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:35 smithi112 ceph-mon[40655]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:35.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-10-08T19:23:35.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:36.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:36 smithi142 ceph-mon[33432]: poll took 2183.725 ms: 1 events 2021-10-08T19:23:36.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:36 smithi142 ceph-mon[33432]: Deploying daemon osd.0 on smithi112 2021-10-08T19:23:36.809 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:36 smithi112 ceph-mon[40655]: poll took 2183.725 ms: 1 events 2021-10-08T19:23:36.810 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:36 smithi112 ceph-mon[40655]: Deploying daemon osd.0 on smithi112 2021-10-08T19:23:36.810 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:36 smithi112 ceph-mon[31694]: poll took 2183.725 ms: 1 events 2021-10-08T19:23:36.811 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:36 smithi112 ceph-mon[31694]: Deploying daemon osd.0 on smithi112 2021-10-08T19:23:37.765 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:37 smithi112 ceph-mon[31694]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:37.765 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:37 smithi112 ceph-mon[40655]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:37.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:37 smithi142 ceph-mon[33432]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:39.124 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 0 on host 'smithi112' 2021-10-08T19:23:39.125 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.122+0000 7fbb757fa700 1 -- 172.21.15.112:0/72241520 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbb78059800 con 0x7fbb68033a20 2021-10-08T19:23:39.126 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.125+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbb68033a20 msgr2=0x7fbb68035ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:39.126 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.126+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbb68033a20 0x7fbb68035ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0046b0 tx=0x7fbb6c009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:39.126 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.126+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f8750 msgr2=0x7fbb7810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:39.127 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.126+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f8750 0x7fbb7810d590 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb640048f0 tx=0x7fbb64009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:39.129 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.127+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 shutdown_connections 2021-10-08T19:23:39.129 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.127+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fbb68033a20 0x7fbb68035ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:39.129 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.127+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb780f90e0 0x7fbb7810fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:39.129 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.127+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb780f74b0 0x7fbb78061fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.127+0000 7fbb7eecf700 1 --2- 172.21.15.112:0/72241520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbb780f8750 0x7fbb7810d590 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.127+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 >> 172.21.15.112:0/72241520 conn(0x7fbb780f2ca0 msgr2=0x7fbb780f50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.127+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 shutdown_connections 2021-10-08T19:23:39.130 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:39.127+0000 7fbb7eecf700 1 -- 172.21.15.112:0/72241520 wait complete. 2021-10-08T19:23:39.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:39.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:39.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:39.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:39.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:39.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.779 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.780 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:39.780 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:39.780 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:39.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.811 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:39.812 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:39.812 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:39.813 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:39.813 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.814 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:39.814 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.815 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.815 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.815 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:39.816 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:39.816 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:39.817 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.817 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:39.818 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:39.818 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:39.819 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:39.819 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.820 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:39.820 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:39.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:39.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:39.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:39.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:40.033 DEBUG:teuthology.orchestra.run.smithi112:osd.0> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@osd.0.service 2021-10-08T19:23:40.035 INFO:tasks.cephadm:Deploying osd.1 on smithi112 with /dev/vg_nvme/lv_3... 2021-10-08T19:23:40.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-10-08T19:23:40.066 INFO:journalctl@ceph.osd.0.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:23:40.728 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:40 smithi112 ceph-mon[31694]: poll took 3338.927 ms: 1 events 2021-10-08T19:23:40.729 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:40 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi112 to 15124M 2021-10-08T19:23:40.729 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:40 smithi112 ceph-mon[40655]: poll took 3338.927 ms: 1 events 2021-10-08T19:23:40.729 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:40 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi112 to 15124M 2021-10-08T19:23:40.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:40 smithi142 ceph-mon[33432]: poll took 3338.927 ms: 1 events 2021-10-08T19:23:40.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:40 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi112 to 15124M 2021-10-08T19:23:41.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:41 smithi112 ceph-mon[31694]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:41 smithi112 ceph-mon[40655]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:41.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:41 smithi142 ceph-mon[33432]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:42.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:42 smithi112 ceph-mon[31694]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:23:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:42 smithi112 ceph-mon[40655]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:23:42.572 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:23:42 smithi112 conmon[45343]: 2021-10-08T19:23:42.227+0000 7f0df0ed60c0 -1 osd.0 0 log_to_monitors {default=true} 2021-10-08T19:23:42.621 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-10-08T19:23:42.621 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-10-08T19:23:42.621 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2021-10-08T19:23:42.621 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2021-10-08T19:23:42.622 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123831 s, 847 MB/s 2021-10-08T19:23:42.622 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2021-10-08T19:23:42.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:42 smithi142 ceph-mon[33432]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-10-08T19:23:43.452 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2021-10-08T19:23:43.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:43 smithi142 ceph-mon[33432]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:43 smithi142 ceph-mon[33432]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:23:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:43 smithi142 ceph-mon[33432]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:23:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:43 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:43 smithi142 ceph-mon[33432]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:23:43.821 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:23:43 smithi112 conmon[45343]: 2021-10-08T19:23:43.405+0000 7f0de767e700 -1 osd.0 0 waiting for initial osdmap 2021-10-08T19:23:43.821 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:23:43 smithi112 conmon[45343]: 2021-10-08T19:23:43.410+0000 7f0de2015700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:23:43.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[31694]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:43.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[31694]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:23:43.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[31694]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:23:43.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:43.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[31694]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:23:43.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[40655]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:43.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[40655]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-10-08T19:23:43.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[40655]: osdmap e6: 1 total, 0 up, 1 in 2021-10-08T19:23:43.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:43.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:43 smithi112 ceph-mon[40655]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:23:44.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:44 smithi142 ceph-mon[33432]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:23:44.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:44 smithi142 ceph-mon[33432]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:23:44.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:44 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:44.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:44 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:44.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:44 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:44.776 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[31694]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:23:44.776 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[31694]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:23:44.777 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:44.777 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:44.777 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:44.778 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[40655]: from='osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:23:44.778 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[40655]: osdmap e7: 1 total, 0 up, 1 in 2021-10-08T19:23:44.778 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:44.778 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:44.779 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:44 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:45.415 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:23:45 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:23:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:45.416 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[31694]: purged_snaps scrub starts 2021-10-08T19:23:45.416 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[31694]: purged_snaps scrub ok 2021-10-08T19:23:45.416 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[31694]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:45.417 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[31694]: osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] boot 2021-10-08T19:23:45.417 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[31694]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:23:45.417 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:45.417 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:45.424 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 -- 172.21.15.112:0/3059274237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f90b0 msgr2=0x7f5fbc0ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:45.425 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 --2- 172.21.15.112:0/3059274237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f90b0 0x7f5fbc0ff970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009ab0 tx=0x7f5fb4004c50 comp rx=0 tx=0).stop 2021-10-08T19:23:45.425 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 -- 172.21.15.112:0/3059274237 shutdown_connections 2021-10-08T19:23:45.425 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 --2- 172.21.15.112:0/3059274237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f90b0 0x7f5fbc0ff970 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:45.425 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 --2- 172.21.15.112:0/3059274237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc0f7480 0x7f5fbc0f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:45.426 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 --2- 172.21.15.112:0/3059274237 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fbc0f8720 0x7f5fbc0f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:45.426 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 -- 172.21.15.112:0/3059274237 >> 172.21.15.112:0/3059274237 conn(0x7f5fbc0f2c70 msgr2=0x7f5fbc0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:45.426 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 -- 172.21.15.112:0/3059274237 shutdown_connections 2021-10-08T19:23:45.426 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.422+0000 7f5fc4414700 1 -- 172.21.15.112:0/3059274237 wait complete. 2021-10-08T19:23:45.427 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc4414700 1 Processor -- start 2021-10-08T19:23:45.427 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc4414700 1 -- start start 2021-10-08T19:23:45.427 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc4414700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f7480 0x7f5fbc0625a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:45.427 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc4414700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fbc0f8720 0x7f5fbc10d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:45.427 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc4414700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc0f90b0 0x7f5fbc10f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:45.428 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc4414700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc1100e0 con 0x7f5fbc0f7480 2021-10-08T19:23:45.428 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc4414700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc110250 con 0x7f5fbc0f90b0 2021-10-08T19:23:45.428 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc4414700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc110410 con 0x7f5fbc0f8720 2021-10-08T19:23:45.428 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc19af700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fbc0f8720 0x7f5fbc10d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:45.429 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc21b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f7480 0x7f5fbc0625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:45.429 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc19af700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fbc0f8720 0x7f5fbc10d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:55106/0 (socket says 172.21.15.112:55106) 2021-10-08T19:23:45.429 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc21b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f7480 0x7f5fbc0625a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33144/0 (socket says 172.21.15.112:33144) 2021-10-08T19:23:45.429 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc19af700 1 -- 172.21.15.112:0/288643567 learned_addr learned my addr 172.21.15.112:0/288643567 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:23:45.429 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc29b1700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc0f90b0 0x7f5fbc10f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:45.430 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc19af700 1 -- 172.21.15.112:0/288643567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc0f90b0 msgr2=0x7f5fbc10f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:45.430 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc19af700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc0f90b0 0x7f5fbc10f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:45.430 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc19af700 1 -- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f7480 msgr2=0x7f5fbc0625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:45.430 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc19af700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f7480 0x7f5fbc0625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:45.431 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc19af700 1 -- 172.21.15.112:0/288643567 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac005040 con 0x7f5fbc0f8720 2021-10-08T19:23:45.431 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.423+0000 7f5fc21b0700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f7480 0x7f5fbc0625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:23:45.431 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.424+0000 7f5fc19af700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fbc0f8720 0x7f5fbc10d390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0049e0 tx=0x7f5fac009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:45.431 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.424+0000 7f5fb2ffd700 1 -- 172.21.15.112:0/288643567 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00e050 con 0x7f5fbc0f8720 2021-10-08T19:23:45.431 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.424+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb4009640 con 0x7f5fbc0f8720 2021-10-08T19:23:45.431 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.424+0000 7f5fb2ffd700 1 -- 172.21.15.112:0/288643567 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5fac00f040 con 0x7f5fbc0f8720 2021-10-08T19:23:45.432 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.424+0000 7f5fb2ffd700 1 -- 172.21.15.112:0/288643567 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac014670 con 0x7f5fbc0f8720 2021-10-08T19:23:45.432 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.424+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc110a70 con 0x7f5fbc0f8720 2021-10-08T19:23:45.433 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.425+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fbc0289c0 con 0x7f5fbc0f8720 2021-10-08T19:23:45.433 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.425+0000 7f5fb2ffd700 1 -- 172.21.15.112:0/288643567 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 14) v1 ==== 80765+0+0 (secure 0 0 0) 0x7f5fac01b030 con 0x7f5fbc0f8720 2021-10-08T19:23:45.433 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.425+0000 7f5fb2ffd700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f5fa80634b0 0x7f5fa8065960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:23:45.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.425+0000 7f5fb2ffd700 1 -- 172.21.15.112:0/288643567 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1763+0+0 (secure 0 0 0) 0x7f5fac07e170 con 0x7f5fbc0f8720 2021-10-08T19:23:45.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.425+0000 7f5fc21b0700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f5fa80634b0 0x7f5fa8065960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:23:45.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.426+0000 7f5fc21b0700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f5fa80634b0 0x7f5fa8065960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0f8580 tx=0x7f5fb800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:23:45.435 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.430+0000 7f5fb2ffd700 1 -- 172.21.15.112:0/288643567 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f5fac048b00 con 0x7f5fbc0f8720 2021-10-08T19:23:45.596 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:45.596+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fbc059800 con 0x7f5fa80634b0 2021-10-08T19:23:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:45 smithi142 ceph-mon[33432]: purged_snaps scrub starts 2021-10-08T19:23:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:45 smithi142 ceph-mon[33432]: purged_snaps scrub ok 2021-10-08T19:23:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:45 smithi142 ceph-mon[33432]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:45 smithi142 ceph-mon[33432]: osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] boot 2021-10-08T19:23:45.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:45 smithi142 ceph-mon[33432]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:23:45.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:45 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:45.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:45 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:45.820 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[40655]: purged_snaps scrub starts 2021-10-08T19:23:45.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[40655]: purged_snaps scrub ok 2021-10-08T19:23:45.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[40655]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-10-08T19:23:45.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[40655]: osd.0 [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] boot 2021-10-08T19:23:45.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[40655]: osdmap e8: 1 total, 1 up, 1 in 2021-10-08T19:23:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:23:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:45 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:46.519 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: Detected new or changed devices on smithi112 2021-10-08T19:23:46.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:23:46.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:23:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:46.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:46.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:46.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:46.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:46.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: poll took 6489.594 ms: 1 events 2021-10-08T19:23:46.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:23:46.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:46.522 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:46.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: Detected new or changed devices on smithi112 2021-10-08T19:23:46.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:23:46.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:23:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:46.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:46.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:46.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:46.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:46.524 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: poll took 6489.594 ms: 1 events 2021-10-08T19:23:46.524 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:23:46.524 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:46.524 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:46 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:46.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: Detected new or changed devices on smithi112 2021-10-08T19:23:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:23:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:23:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:23:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:23:46.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:23:46.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:46.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: poll took 6489.594 ms: 1 events 2021-10-08T19:23:46.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: osdmap e9: 1 total, 1 up, 1 in 2021-10-08T19:23:46.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:23:46.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:46 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:23:47.563 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:47 smithi112 ceph-mon[31694]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:47.564 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:47 smithi112 ceph-mon[40655]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:47.727 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:47 smithi142 ceph-mon[33432]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:49.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:49 smithi142 ceph-mon[33432]: pgmap v59: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2958036624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]: dispatch 2021-10-08T19:23:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]: dispatch 2021-10-08T19:23:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]': finished 2021-10-08T19:23:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:49 smithi142 ceph-mon[33432]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:23:49.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:49 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:49.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1268227432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:49.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[31694]: pgmap v59: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:49.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2958036624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]: dispatch 2021-10-08T19:23:49.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]: dispatch 2021-10-08T19:23:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]': finished 2021-10-08T19:23:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[31694]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:23:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1268227432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[40655]: pgmap v59: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2958036624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]: dispatch 2021-10-08T19:23:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]: dispatch 2021-10-08T19:23:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb484e98-9c69-4c55-84d6-096b231a6135"}]': finished 2021-10-08T19:23:49.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[40655]: osdmap e10: 2 total, 1 up, 2 in 2021-10-08T19:23:49.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:23:49.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1268227432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:23:51.320 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:23:51 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:23:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:51.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:51 smithi112 ceph-mon[31694]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:51.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:51 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:51.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:51 smithi112 ceph-mon[40655]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:51.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:51 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:51.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:51 smithi142 ceph-mon[33432]: pgmap v61: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:51 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:52.410 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:52 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:52.410 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:52 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:23:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:52.412 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:52 smithi112 ceph-mon[40655]: poll took 5490.557 ms: 1 events 2021-10-08T19:23:52.412 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:52 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:52.413 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:52 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:23:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:52.413 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:52 smithi112 ceph-mon[31694]: poll took 5490.557 ms: 1 events 2021-10-08T19:23:52.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:52 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:23:52.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:52 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:23:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:23:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:52 smithi142 ceph-mon[33432]: poll took 5490.557 ms: 1 events 2021-10-08T19:23:53.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:53 smithi142 ceph-mon[33432]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:53.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:53 smithi112 ceph-mon[31694]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:53.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:53 smithi112 ceph-mon[40655]: pgmap v62: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:55.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[31694]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:55.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[31694]: poll took 2384.631 ms: 1 events 2021-10-08T19:23:55.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:23:55.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:55.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[31694]: Deploying daemon osd.1 on smithi112 2021-10-08T19:23:55.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[40655]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:55.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[40655]: poll took 2384.631 ms: 1 events 2021-10-08T19:23:55.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:23:55.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:55.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:55 smithi112 ceph-mon[40655]: Deploying daemon osd.1 on smithi112 2021-10-08T19:23:55.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:55 smithi142 ceph-mon[33432]: pgmap v63: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:55 smithi142 ceph-mon[33432]: poll took 2384.631 ms: 1 events 2021-10-08T19:23:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:55 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-10-08T19:23:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:55 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:55 smithi142 ceph-mon[33432]: Deploying daemon osd.1 on smithi112 2021-10-08T19:23:57.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:57 smithi142 ceph-mon[33432]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:57 smithi112 ceph-mon[31694]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:57 smithi112 ceph-mon[40655]: pgmap v64: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:58.013 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 1 on host 'smithi112' 2021-10-08T19:23:58.014 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.009+0000 7f5fb2ffd700 1 -- 172.21.15.112:0/288643567 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5fbc059800 con 0x7f5fa80634b0 2021-10-08T19:23:58.015 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.011+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f5fa80634b0 msgr2=0x7f5fa8065960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:58.016 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.011+0000 7f5fc4414700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f5fa80634b0 0x7f5fa8065960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0f8580 tx=0x7f5fb800b040 comp rx=0 tx=0).stop 2021-10-08T19:23:58.016 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.011+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fbc0f8720 msgr2=0x7f5fbc10d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:23:58.016 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.011+0000 7f5fc4414700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fbc0f8720 0x7f5fbc10d390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0049e0 tx=0x7f5fac009b30 comp rx=0 tx=0).stop 2021-10-08T19:23:58.017 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.011+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 shutdown_connections 2021-10-08T19:23:58.017 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.011+0000 7f5fc4414700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f5fa80634b0 0x7f5fa8065960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:58.017 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.011+0000 7f5fc4414700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc0f90b0 0x7f5fbc10f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:58.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.011+0000 7f5fc4414700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fbc0f7480 0x7f5fbc0625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:58.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.012+0000 7f5fc4414700 1 --2- 172.21.15.112:0/288643567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5fbc0f8720 0x7f5fbc10d390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:23:58.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.012+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 >> 172.21.15.112:0/288643567 conn(0x7f5fbc0f2c70 msgr2=0x7f5fbc0f4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:23:58.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.012+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 shutdown_connections 2021-10-08T19:23:58.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:23:58.012+0000 7f5fc4414700 1 -- 172.21.15.112:0/288643567 wait complete. 2021-10-08T19:23:58.446 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:58.447 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:58.447 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.447 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:58.448 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:58.448 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.448 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:58.449 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.449 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.450 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:58.450 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:58.450 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:58.451 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:58.452 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:58.452 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.453 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:58.453 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:58.453 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.454 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:58.454 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.455 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.456 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:58.456 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:58.456 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:58.457 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:58.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:23:58.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:23:58.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:23:58.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:23:58.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:23:58.698 DEBUG:teuthology.orchestra.run.smithi112:osd.1> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@osd.1.service 2021-10-08T19:23:58.700 INFO:tasks.cephadm:Deploying osd.2 on smithi112 with /dev/vg_nvme/lv_2... 2021-10-08T19:23:58.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-10-08T19:23:58.728 INFO:journalctl@ceph.osd.1.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:23:59.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:59 smithi142 ceph-mon[33432]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:59 smithi142 ceph-mon[33432]: poll took 3138.191 ms: 1 events 2021-10-08T19:23:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:23:59 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi112 to 7562M 2021-10-08T19:23:59.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:59 smithi112 ceph-mon[31694]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:59 smithi112 ceph-mon[31694]: poll took 3138.191 ms: 1 events 2021-10-08T19:23:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:23:59 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi112 to 7562M 2021-10-08T19:23:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:59 smithi112 ceph-mon[40655]: pgmap v65: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:23:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:59 smithi112 ceph-mon[40655]: poll took 3138.191 ms: 1 events 2021-10-08T19:23:59.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:23:59 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi112 to 7562M 2021-10-08T19:24:00.746 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-10-08T19:24:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-10-08T19:24:00.747 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2021-10-08T19:24:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2021-10-08T19:24:00.747 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124289 s, 844 MB/s 2021-10-08T19:24:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2021-10-08T19:24:01.427 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:01 smithi112 ceph-mon[31694]: pgmap v66: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:01.427 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:01 smithi112 ceph-mon[40655]: pgmap v66: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:01.428 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:01 smithi112 conmon[49444]: 2021-10-08T19:24:01.226+0000 7f8c554230c0 -1 osd.1 0 log_to_monitors {default=true} 2021-10-08T19:24:01.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2021-10-08T19:24:01.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:01 smithi142 ceph-mon[33432]: pgmap v66: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:02.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:02 smithi142 ceph-mon[33432]: from='osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:24:02.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:02 smithi142 ceph-mon[33432]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:24:02.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:02 smithi112 ceph-mon[31694]: from='osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:24:02.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:02 smithi112 ceph-mon[31694]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:24:02.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:02 smithi112 ceph-mon[40655]: from='osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:24:02.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:02 smithi112 ceph-mon[40655]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-10-08T19:24:03.067 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 -- 172.21.15.112:0/2155877386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80f87d0 msgr2=0x7f22c80f8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:03.068 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 --2- 172.21.15.112:0/2155877386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80f87d0 0x7f22c80f8be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22b80046e0 tx=0x7f22b8009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:03.068 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 -- 172.21.15.112:0/2155877386 shutdown_connections 2021-10-08T19:24:03.069 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 --2- 172.21.15.112:0/2155877386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c80fa400 0x7f22c8100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:03.069 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 --2- 172.21.15.112:0/2155877386 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80f87d0 0x7f22c80f8be0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:03.069 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 --2- 172.21.15.112:0/2155877386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c80f9a70 0x7f22c80f9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:03.069 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 -- 172.21.15.112:0/2155877386 >> 172.21.15.112:0/2155877386 conn(0x7f22c80f4000 msgr2=0x7f22c80f6410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:03.070 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 -- 172.21.15.112:0/2155877386 shutdown_connections 2021-10-08T19:24:03.070 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 -- 172.21.15.112:0/2155877386 wait complete. 2021-10-08T19:24:03.070 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.064+0000 7f22cce6c700 1 Processor -- start 2021-10-08T19:24:03.070 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22cce6c700 1 -- start start 2021-10-08T19:24:03.071 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22cce6c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c80f87d0 0x7f22c8108990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:03.071 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22cce6c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c80f9a70 0x7f22c8108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:03.071 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22cce6c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80fa400 0x7f22c810ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:03.071 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22cce6c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c81104a0 con 0x7f22c80f87d0 2021-10-08T19:24:03.071 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22cce6c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c8110610 con 0x7f22c80f9a70 2021-10-08T19:24:03.072 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22cce6c700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c81107d0 con 0x7f22c80fa400 2021-10-08T19:24:03.072 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c80f87d0 0x7f22c8108990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:03.072 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c80f87d0 0x7f22c8108990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33202/0 (socket says 172.21.15.112:33202) 2021-10-08T19:24:03.072 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c6d9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80fa400 0x7f22c810ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:03.073 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 -- 172.21.15.112:0/1277108641 learned_addr learned my addr 172.21.15.112:0/1277108641 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:24:03.073 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c5d9b700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c80f9a70 0x7f22c8108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:03.073 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 -- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80fa400 msgr2=0x7f22c810ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:03.073 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80fa400 0x7f22c810ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:03.073 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 -- 172.21.15.112:0/1277108641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c80f9a70 msgr2=0x7f22c8108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:03.074 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c80f9a70 0x7f22c8108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:03.074 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 -- 172.21.15.112:0/1277108641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8005040 con 0x7f22c80f87d0 2021-10-08T19:24:03.074 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c5d9b700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c80f9a70 0x7f22c8108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:24:03.075 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c6d9d700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80fa400 0x7f22c810ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:24:03.075 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22c659c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c80f87d0 0x7f22c8108990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009880 tx=0x7f22b8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:03.075 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22b6ffd700 1 -- 172.21.15.112:0/1277108641 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8007920 con 0x7f22c80f87d0 2021-10-08T19:24:03.075 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.065+0000 7f22b6ffd700 1 -- 172.21.15.112:0/1277108641 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f22b801c3f0 con 0x7f22c80f87d0 2021-10-08T19:24:03.076 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.066+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c8110a50 con 0x7f22c80f87d0 2021-10-08T19:24:03.076 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.066+0000 7f22b6ffd700 1 -- 172.21.15.112:0/1277108641 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8012630 con 0x7f22c80f87d0 2021-10-08T19:24:03.076 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.066+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c8110f30 con 0x7f22c80f87d0 2021-10-08T19:24:03.078 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.066+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c8062bc0 con 0x7f22c80f87d0 2021-10-08T19:24:03.078 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.067+0000 7f22b6ffd700 1 -- 172.21.15.112:0/1277108641 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 14) v1 ==== 80765+0+0 (secure 0 0 0) 0x7f22b8007a80 con 0x7f22c80f87d0 2021-10-08T19:24:03.078 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.067+0000 7f22b6ffd700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f22b00634b0 0x7f22b0065960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:03.078 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.067+0000 7f22b6ffd700 1 -- 172.21.15.112:0/1277108641 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1899+0+0 (secure 0 0 0) 0x7f22b807fb10 con 0x7f22c80f87d0 2021-10-08T19:24:03.079 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.067+0000 7f22c5d9b700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f22b00634b0 0x7f22b0065960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:03.079 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.067+0000 7f22c5d9b700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f22b00634b0 0x7f22b0065960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22bc007fc0 tx=0x7f22bc00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:03.079 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.071+0000 7f22b6ffd700 1 -- 172.21.15.112:0/1277108641 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f22b804fe80 con 0x7f22c80f87d0 2021-10-08T19:24:03.244 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:03.243+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f22c8103480 con 0x7f22b00634b0 2021-10-08T19:24:03.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:03 smithi142 ceph-mon[33432]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:03.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:03 smithi142 ceph-mon[33432]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:24:03.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:03 smithi142 ceph-mon[33432]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:24:03.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:03 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:03 smithi142 ceph-mon[33432]: from='osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:03 smithi142 ceph-mon[33432]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:03.570 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:03 smithi112 conmon[49444]: 2021-10-08T19:24:03.184+0000 7f8c4bbcb700 -1 osd.1 0 waiting for initial osdmap 2021-10-08T19:24:03.571 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:03 smithi112 conmon[49444]: 2021-10-08T19:24:03.187+0000 7f8c4455e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:24:03.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[31694]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:03.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[31694]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:24:03.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[31694]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:24:03.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:03.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[31694]: from='osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:03.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[31694]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:03.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[40655]: pgmap v67: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:03.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[40655]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-10-08T19:24:03.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[40655]: osdmap e11: 2 total, 1 up, 2 in 2021-10-08T19:24:03.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:03.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[40655]: from='osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:03.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:03 smithi112 ceph-mon[40655]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:04.191 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:04.192 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:24:04.192 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:04.192 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:04.192 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:24:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:04.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:04.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:04.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:04 smithi142 ceph-mon[33432]: poll took 5249.966 ms: 1 events 2021-10-08T19:24:04.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[31694]: poll took 5249.966 ms: 1 events 2021-10-08T19:24:04.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:04.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: osdmap e12: 2 total, 1 up, 2 in 2021-10-08T19:24:04.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:04.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:04.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:04.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:04.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:04.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:04.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:04 smithi112 ceph-mon[40655]: poll took 5249.966 ms: 1 events 2021-10-08T19:24:05.496 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[40655]: purged_snaps scrub starts 2021-10-08T19:24:05.496 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[40655]: purged_snaps scrub ok 2021-10-08T19:24:05.496 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[40655]: pgmap v70: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:05.496 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:05.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[40655]: osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] boot 2021-10-08T19:24:05.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[40655]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:24:05.497 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:05.497 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[31694]: purged_snaps scrub starts 2021-10-08T19:24:05.498 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[31694]: purged_snaps scrub ok 2021-10-08T19:24:05.498 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[31694]: pgmap v70: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:05.498 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:05.498 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[31694]: osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] boot 2021-10-08T19:24:05.499 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[31694]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:24:05.499 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:05 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:05.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:05 smithi142 ceph-mon[33432]: purged_snaps scrub starts 2021-10-08T19:24:05.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:05 smithi142 ceph-mon[33432]: purged_snaps scrub ok 2021-10-08T19:24:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:05 smithi142 ceph-mon[33432]: pgmap v70: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2021-10-08T19:24:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:05 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:05 smithi142 ceph-mon[33432]: osd.1 [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] boot 2021-10-08T19:24:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:05 smithi142 ceph-mon[33432]: osdmap e13: 2 total, 2 up, 2 in 2021-10-08T19:24:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:05 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:24:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:06 smithi142 ceph-mon[33432]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:24:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3689158196' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]: dispatch 2021-10-08T19:24:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]: dispatch 2021-10-08T19:24:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]': finished 2021-10-08T19:24:06.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:06 smithi142 ceph-mon[33432]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:24:06.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:06 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[40655]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:24:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3689158196' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]: dispatch 2021-10-08T19:24:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]: dispatch 2021-10-08T19:24:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]': finished 2021-10-08T19:24:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[40655]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:24:06.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[31694]: osdmap e14: 2 total, 2 up, 2 in 2021-10-08T19:24:06.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3689158196' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]: dispatch 2021-10-08T19:24:06.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]: dispatch 2021-10-08T19:24:06.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a751de5f-e823-4e5e-9843-a18b220be8f7"}]': finished 2021-10-08T19:24:06.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[31694]: osdmap e15: 3 total, 2 up, 3 in 2021-10-08T19:24:06.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:06 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:07.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:07 smithi142 ceph-mon[33432]: pgmap v74: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/502657288' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:07.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:07 smithi112 ceph-mon[31694]: pgmap v74: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:07.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/502657288' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:07.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:07 smithi112 ceph-mon[40655]: pgmap v74: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:07.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/502657288' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:09.482 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:09 smithi112 ceph-mon[31694]: pgmap v75: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:09.482 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:09 smithi112 ceph-mon[40655]: pgmap v75: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:09.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:09 smithi142 ceph-mon[33432]: pgmap v75: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:10.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:10 smithi142 ceph-mon[33432]: poll took 5488.099 ms: 1 events 2021-10-08T19:24:10.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:10 smithi112 ceph-mon[31694]: poll took 5488.099 ms: 1 events 2021-10-08T19:24:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:10 smithi112 ceph-mon[40655]: poll took 5488.099 ms: 1 events 2021-10-08T19:24:11.498 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:11 smithi112 ceph-mon[31694]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:11.499 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:11 smithi112 ceph-mon[40655]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:11.514 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:11 smithi142 ceph-mon[33432]: pgmap v76: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:13.391 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:13 smithi142 ceph-mon[33432]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:13.392 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:24:13.392 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:13.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:13 smithi112 ceph-mon[31694]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:13.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:24:13.478 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:13.478 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:13 smithi112 ceph-mon[40655]: pgmap v77: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:13.478 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-10-08T19:24:13.479 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:13.780 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:24:13 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:24:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:14.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:14 smithi142 ceph-mon[33432]: poll took 3042.685 ms: 1 events 2021-10-08T19:24:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:14 smithi142 ceph-mon[33432]: Deploying daemon osd.2 on smithi112 2021-10-08T19:24:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:14 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:14 smithi142 ceph-mon[33432]: Detected new or changed devices on smithi112 2021-10-08T19:24:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:14 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:24:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:14 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:24:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:14.805 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[40655]: poll took 3042.685 ms: 1 events 2021-10-08T19:24:14.805 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[40655]: Deploying daemon osd.2 on smithi112 2021-10-08T19:24:14.805 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:14.806 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[40655]: Detected new or changed devices on smithi112 2021-10-08T19:24:14.806 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:24:14.806 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:24:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:14.806 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[31694]: poll took 3042.685 ms: 1 events 2021-10-08T19:24:14.807 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[31694]: Deploying daemon osd.2 on smithi112 2021-10-08T19:24:14.807 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:14.807 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[31694]: Detected new or changed devices on smithi112 2021-10-08T19:24:14.808 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:24:14.808 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:14 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:24:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:15.210 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:24:15 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:24:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:15.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:15 smithi142 ceph-mon[33432]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:15 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:15 smithi112 ceph-mon[31694]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:15 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:15.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:15 smithi112 ceph-mon[40655]: pgmap v78: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:15 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.409 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 2 on host 'smithi112' 2021-10-08T19:24:16.409 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.406+0000 7f22b6ffd700 1 -- 172.21.15.112:0/1277108641 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f22c8103480 con 0x7f22b00634b0 2021-10-08T19:24:16.410 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.408+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f22b00634b0 msgr2=0x7f22b0065960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:16.411 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.408+0000 7f22cce6c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f22b00634b0 0x7f22b0065960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22bc007fc0 tx=0x7f22bc00b040 comp rx=0 tx=0).stop 2021-10-08T19:24:16.411 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.408+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c80f87d0 msgr2=0x7f22c8108990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:16.411 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.408+0000 7f22cce6c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c80f87d0 0x7f22c8108990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009880 tx=0x7f22b8009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:16.411 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.409+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 shutdown_connections 2021-10-08T19:24:16.411 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.409+0000 7f22cce6c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f22b00634b0 0x7f22b0065960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:16.412 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.409+0000 7f22cce6c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f22c80fa400 0x7f22c810ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:16.412 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.409+0000 7f22cce6c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22c80f87d0 0x7f22c8108990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:16.412 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.409+0000 7f22cce6c700 1 --2- 172.21.15.112:0/1277108641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c80f9a70 0x7f22c8108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:16.412 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.409+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 >> 172.21.15.112:0/1277108641 conn(0x7f22c80f4000 msgr2=0x7f22c80fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:16.413 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.409+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 shutdown_connections 2021-10-08T19:24:16.413 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:16.409+0000 7f22cce6c700 1 -- 172.21.15.112:0/1277108641 wait complete. 2021-10-08T19:24:16.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:24:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:24:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:16 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:24:16.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:24:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:16.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:24:16.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:24:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:16.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:16.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:16.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:16.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:16.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:16.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:16 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:17.049 DEBUG:teuthology.orchestra.run.smithi112:osd.2> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@osd.2.service 2021-10-08T19:24:17.051 INFO:tasks.cephadm:Deploying osd.3 on smithi112 with /dev/vg_nvme/lv_1... 2021-10-08T19:24:17.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-10-08T19:24:17.079 INFO:journalctl@ceph.osd.2.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:24:17.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:17 smithi142 ceph-mon[33432]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:17 smithi142 ceph-mon[33432]: poll took 3150.085 ms: 1 events 2021-10-08T19:24:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:17 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi112 to 5041M 2021-10-08T19:24:17.780 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:17 smithi112 ceph-mon[31694]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:17.781 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:17 smithi112 ceph-mon[31694]: poll took 3150.085 ms: 1 events 2021-10-08T19:24:17.781 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:17 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi112 to 5041M 2021-10-08T19:24:17.781 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:17 smithi112 ceph-mon[40655]: pgmap v79: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:17.781 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:17 smithi112 ceph-mon[40655]: poll took 3150.085 ms: 1 events 2021-10-08T19:24:17.782 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:17 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi112 to 5041M 2021-10-08T19:24:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-10-08T19:24:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-10-08T19:24:19.073 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2021-10-08T19:24:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2021-10-08T19:24:19.073 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123754 s, 847 MB/s 2021-10-08T19:24:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2021-10-08T19:24:19.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:19 smithi142 ceph-mon[33432]: pgmap v80: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:19.779 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:19 smithi112 ceph-mon[31694]: pgmap v80: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:19.780 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:19 smithi112 ceph-mon[40655]: pgmap v80: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:19.781 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:19 smithi112 conmon[53645]: 2021-10-08T19:24:19.599+0000 7f278fa0b0c0 -1 osd.2 0 log_to_monitors {default=true} 2021-10-08T19:24:19.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi112:vg_nvme/lv_1 2021-10-08T19:24:20.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:20 smithi112 ceph-mon[31694]: from='osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:24:20.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:20 smithi112 ceph-mon[31694]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:24:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:20 smithi112 ceph-mon[40655]: from='osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:24:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:20 smithi112 ceph-mon[40655]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:24:20.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:20 smithi142 ceph-mon[33432]: from='osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:24:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:20 smithi142 ceph-mon[33432]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-10-08T19:24:21.497 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.494+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/350505285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f9830 msgr2=0x7fdea40f9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:21.498 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.494+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/350505285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f9830 0x7fdea40f9c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde980046e0 tx=0x7fde98009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:21.498 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.494+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/350505285 shutdown_connections 2021-10-08T19:24:21.498 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.494+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/350505285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdea40fa1c0 0x7fdea4100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.494+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/350505285 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea40f8590 0x7fdea40f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.494+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/350505285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f9830 0x7fdea40f9c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.494+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/350505285 >> 172.21.15.112:0/350505285 conn(0x7fdea40f3d80 msgr2=0x7fdea40f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:21.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.494+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/350505285 shutdown_connections 2021-10-08T19:24:21.500 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/350505285 wait complete. 2021-10-08T19:24:21.500 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 Processor -- start 2021-10-08T19:24:21.500 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 -- start start 2021-10-08T19:24:21.500 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f8590 0x7fdea4108780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:21.501 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea40f9830 0x7fdea4108cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:21.501 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdea40fa1c0 0x7fdea410fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:21.501 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea4110290 con 0x7fdea40f8590 2021-10-08T19:24:21.502 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea4110400 con 0x7fdea40fa1c0 2021-10-08T19:24:21.502 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdeaa9c8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea41105c0 con 0x7fdea40f9830 2021-10-08T19:24:21.502 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdea3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f8590 0x7fdea4108780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:21.502 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdea37fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea40f9830 0x7fdea4108cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:21.503 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdea3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f8590 0x7fdea4108780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33278/0 (socket says 172.21.15.112:33278) 2021-10-08T19:24:21.503 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.495+0000 7fdea3fff700 1 -- 172.21.15.112:0/2154009962 learned_addr learned my addr 172.21.15.112:0/2154009962 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:24:21.503 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea37fe700 1 -- 172.21.15.112:0/2154009962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdea40fa1c0 msgr2=0x7fdea410fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:21.504 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea37fe700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdea40fa1c0 0x7fdea410fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.504 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea37fe700 1 -- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f8590 msgr2=0x7fdea4108780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:21.504 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea37fe700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f8590 0x7fdea4108780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:21.504 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea37fe700 1 -- 172.21.15.112:0/2154009962 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94005040 con 0x7fdea40f9830 2021-10-08T19:24:21.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea3fff700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f8590 0x7fdea4108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:24:21.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea37fe700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea40f9830 0x7fdea4108cc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde98009880 tx=0x7fde98009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:21.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea0ff9700 1 -- 172.21.15.112:0/2154009962 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98007920 con 0x7fdea40f9830 2021-10-08T19:24:21.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea0ff9700 1 -- 172.21.15.112:0/2154009962 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fde9801c3f0 con 0x7fdea40f9830 2021-10-08T19:24:21.506 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde98005040 con 0x7fdea40f9830 2021-10-08T19:24:21.506 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdea0ff9700 1 -- 172.21.15.112:0/2154009962 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98012630 con 0x7fdea40f9830 2021-10-08T19:24:21.507 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.496+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea4110b90 con 0x7fdea40f9830 2021-10-08T19:24:21.508 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.497+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea4047b50 con 0x7fdea40f9830 2021-10-08T19:24:21.508 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.497+0000 7fdea0ff9700 1 -- 172.21.15.112:0/2154009962 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 14) v1 ==== 80765+0+0 (secure 0 0 0) 0x7fde98007a80 con 0x7fdea40f9830 2021-10-08T19:24:21.508 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.498+0000 7fdea0ff9700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fde8c0634b0 0x7fde8c065960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:21.509 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.498+0000 7fdea0ff9700 1 -- 172.21.15.112:0/2154009962 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2331+0+0 (secure 0 0 0) 0x7fde9807fc20 con 0x7fdea40f9830 2021-10-08T19:24:21.509 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.498+0000 7fdea3fff700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fde8c0634b0 0x7fde8c065960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:21.509 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.498+0000 7fdea3fff700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fde8c0634b0 0x7fde8c065960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde94009fd0 tx=0x7fde9400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:21.509 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.502+0000 7fdea0ff9700 1 -- 172.21.15.112:0/2154009962 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fde9804fde0 con 0x7fdea40f9830 2021-10-08T19:24:21.570 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:21 smithi112 conmon[53645]: 2021-10-08T19:24:21.511+0000 7f27861b3700 -1 osd.2 0 waiting for initial osdmap 2021-10-08T19:24:21.571 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:21 smithi112 conmon[53645]: 2021-10-08T19:24:21.515+0000 7f277fb48700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:24:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[31694]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[31694]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:24:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[31694]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:24:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[31694]: from='osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[31694]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:21.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[40655]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:21.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[40655]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:24:21.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[40655]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:24:21.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:21.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[40655]: from='osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:21.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:21 smithi112 ceph-mon[40655]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:21.674 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:21.672+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdea4059800 con 0x7fde8c0634b0 2021-10-08T19:24:21.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:21 smithi142 ceph-mon[33432]: pgmap v81: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:21.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:21 smithi142 ceph-mon[33432]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-10-08T19:24:21.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:21 smithi142 ceph-mon[33432]: osdmap e16: 3 total, 2 up, 3 in 2021-10-08T19:24:21.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:21.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:21 smithi142 ceph-mon[33432]: from='osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:21.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:21 smithi142 ceph-mon[33432]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:22.570 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:24:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:22.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:22.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:22.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[40655]: poll took 5280.329 ms: 1 events 2021-10-08T19:24:22.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:22.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:24:22.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:22.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:22.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:22.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:22.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:22.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:22.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:22 smithi112 ceph-mon[31694]: poll took 5280.329 ms: 1 events 2021-10-08T19:24:22.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:22.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: osdmap e17: 3 total, 2 up, 3 in 2021-10-08T19:24:22.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:22.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:22.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:22.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:22.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:22.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:22.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:22 smithi142 ceph-mon[33432]: poll took 5280.329 ms: 1 events 2021-10-08T19:24:23.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[31694]: purged_snaps scrub starts 2021-10-08T19:24:23.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[31694]: purged_snaps scrub ok 2021-10-08T19:24:23.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[31694]: pgmap v84: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:23.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:23.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[31694]: osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] boot 2021-10-08T19:24:23.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[31694]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:24:23.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:23.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[40655]: purged_snaps scrub starts 2021-10-08T19:24:23.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[40655]: purged_snaps scrub ok 2021-10-08T19:24:23.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[40655]: pgmap v84: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:23.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:23.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[40655]: osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] boot 2021-10-08T19:24:23.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[40655]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:24:23.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:23 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:24.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:23 smithi142 ceph-mon[33432]: purged_snaps scrub starts 2021-10-08T19:24:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:23 smithi142 ceph-mon[33432]: purged_snaps scrub ok 2021-10-08T19:24:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:23 smithi142 ceph-mon[33432]: pgmap v84: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2021-10-08T19:24:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:24.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:23 smithi142 ceph-mon[33432]: osd.2 [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] boot 2021-10-08T19:24:24.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:23 smithi142 ceph-mon[33432]: osdmap e18: 3 total, 3 up, 3 in 2021-10-08T19:24:24.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:23 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:24:25.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:24 smithi142 ceph-mon[33432]: osdmap e19: 3 total, 3 up, 3 in 2021-10-08T19:24:25.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2276103832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]: dispatch 2021-10-08T19:24:25.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]: dispatch 2021-10-08T19:24:25.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]': finished 2021-10-08T19:24:25.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:24 smithi142 ceph-mon[33432]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:24:25.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:24 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:25.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[31694]: osdmap e19: 3 total, 3 up, 3 in 2021-10-08T19:24:25.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2276103832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]: dispatch 2021-10-08T19:24:25.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]: dispatch 2021-10-08T19:24:25.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]': finished 2021-10-08T19:24:25.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[31694]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:24:25.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:25.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[40655]: osdmap e19: 3 total, 3 up, 3 in 2021-10-08T19:24:25.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2276103832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]: dispatch 2021-10-08T19:24:25.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]: dispatch 2021-10-08T19:24:25.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09598391-54ae-4362-9b9b-d61d813c967d"}]': finished 2021-10-08T19:24:25.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[40655]: osdmap e20: 4 total, 3 up, 4 in 2021-10-08T19:24:25.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:24 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:26.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:25 smithi142 ceph-mon[33432]: pgmap v87: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:24:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1987435555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:24:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:25 smithi142 ceph-mon[33432]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:24:26.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:26.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:25 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:24:26.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[40655]: pgmap v87: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:26.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:24:26.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1987435555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:26.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:24:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[40655]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:24:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:24:26.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[31694]: pgmap v87: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-10-08T19:24:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1987435555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1}]': finished 2021-10-08T19:24:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[31694]: osdmap e21: 4 total, 3 up, 4 in 2021-10-08T19:24:26.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:26.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:25 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:24:26.620 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55956]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:24:26.621 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55956]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:26.621 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55956]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:26.621 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55956]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:26.893 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55961]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:24:26.894 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55961]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:26.894 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55961]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:26.894 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55961]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:27.159 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[40655]: pgmap v90: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:27.159 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:24:27.159 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[40655]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:24:27.159 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:27.160 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:27.160 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55987]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:24:27.160 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55987]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:27.161 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55987]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:27.161 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:26 smithi112 sudo[55987]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:27.161 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[31694]: pgmap v90: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:27.161 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:24:27.162 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[31694]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:24:27.162 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:27.162 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:27.418 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56026]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:24:27.419 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56026]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:27.419 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56026]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:27.419 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56026]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:27.420 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56023]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:24:27.420 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56023]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:27.420 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56023]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:27.420 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56023]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:27.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:27 smithi142 ceph-mon[33432]: pgmap v90: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:27.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:24:27.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:27 smithi142 ceph-mon[33432]: osdmap e22: 4 total, 3 up, 4 in 2021-10-08T19:24:27.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:27.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:27.592 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:27.590+0000 7fdea0ff9700 1 -- 172.21.15.112:0/2154009962 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7fde98007d10 con 0x7fdea40f9830 2021-10-08T19:24:27.668 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56042]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:24:27.668 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56042]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:27.669 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56042]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:27.669 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56042]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:28.191 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56098]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:24:28.192 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56098]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:28.192 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56098]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:28.192 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:27 smithi112 sudo[56098]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:28.473 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 ceph-mon[40655]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:24:28.474 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:28.474 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 ceph-mon[40655]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:24:28.474 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56179]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:24:28.475 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56179]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:28.475 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56179]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:28.475 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56179]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:28.475 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:28 smithi112 ceph-mon[31694]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:24:28.475 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:28 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:28.476 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:28 smithi112 ceph-mon[31694]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:24:28.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:28 smithi142 ceph-mon[33432]: osdmap e23: 4 total, 3 up, 4 in 2021-10-08T19:24:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:28 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:28 smithi142 ceph-mon[33432]: mgrmap e15: y(active, since 2m), standbys: x 2021-10-08T19:24:28.746 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56201]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:24:28.746 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56201]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:28.746 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56201]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:28.747 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56201]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:29.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56256]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:24:29.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56256]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56256]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:28 smithi112 sudo[56256]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:29.241 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:28 smithi142 sudo[37255]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2021-10-08T19:24:29.241 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:28 smithi142 sudo[37255]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:29.241 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:28 smithi142 sudo[37255]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:29.242 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 sudo[37255]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:29.472 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: poll took 5488.579 ms: 1 events 2021-10-08T19:24:29.473 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:29.473 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:29.473 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:29.474 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.474 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.474 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:29.475 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:29.475 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.475 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.475 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:29.475 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:29.476 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.476 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.476 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:29.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: poll took 5488.579 ms: 1 events 2021-10-08T19:24:29.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:29.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:29.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:29.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.478 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.478 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:29.478 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:29.478 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.479 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.479 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:29.479 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:29.479 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.479 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.480 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:29 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:29.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 sudo[37258]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2021-10-08T19:24:29.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 sudo[37258]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2021-10-08T19:24:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 sudo[37258]: pam_unix(sudo:session): session opened for user root by (uid=0) 2021-10-08T19:24:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 sudo[37258]: pam_unix(sudo:session): session closed for user root 2021-10-08T19:24:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: poll took 5488.579 ms: 1 events 2021-10-08T19:24:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:29.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:29.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:29.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:29.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:24:29.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:24:29.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:29 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:24:30.253 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:30 smithi112 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:30.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:30 smithi142 ceph-mon[33432]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:30 smithi142 ceph-mon[33432]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:30 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:30.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:30 smithi112 ceph-mon[31694]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:30.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:30 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:30 smithi112 ceph-mon[40655]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-10-08T19:24:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:30 smithi112 ceph-mon[40655]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-10-08T19:24:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:30 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:31.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:31 smithi142 ceph-mon[33432]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:31.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:31 smithi142 ceph-mon[33432]: poll took 2494.481 ms: 1 events 2021-10-08T19:24:31.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:24:31.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:31.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:31 smithi142 ceph-mon[33432]: Deploying daemon osd.3 on smithi112 2021-10-08T19:24:31.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[31694]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:31.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[31694]: poll took 2494.481 ms: 1 events 2021-10-08T19:24:31.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:24:31.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:31.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[31694]: Deploying daemon osd.3 on smithi112 2021-10-08T19:24:31.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[40655]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:31.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[40655]: poll took 2494.481 ms: 1 events 2021-10-08T19:24:31.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-10-08T19:24:31.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:31.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:31 smithi112 ceph-mon[40655]: Deploying daemon osd.3 on smithi112 2021-10-08T19:24:33.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:33 smithi112 ceph-mon[31694]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:33.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:33 smithi112 ceph-mon[40655]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:33.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:33 smithi142 ceph-mon[33432]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:34.953 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 3 on host 'smithi112' 2021-10-08T19:24:34.953 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.950+0000 7fdea0ff9700 1 -- 172.21.15.112:0/2154009962 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdea4059800 con 0x7fde8c0634b0 2021-10-08T19:24:34.954 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fde8c0634b0 msgr2=0x7fde8c065960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fde8c0634b0 0x7fde8c065960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde94009fd0 tx=0x7fde9400b040 comp rx=0 tx=0).stop 2021-10-08T19:24:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea40f9830 msgr2=0x7fdea4108cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea40f9830 0x7fdea4108cc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde98009880 tx=0x7fde98009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 shutdown_connections 2021-10-08T19:24:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fde8c0634b0 0x7fde8c065960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdea40fa1c0 0x7fdea410fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea40f8590 0x7fdea4108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 --2- 172.21.15.112:0/2154009962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea40f9830 0x7fdea4108cc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 >> 172.21.15.112:0/2154009962 conn(0x7fdea40f3d80 msgr2=0x7fdea40f6120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 shutdown_connections 2021-10-08T19:24:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:24:34.953+0000 7fdeaa9c8700 1 -- 172.21.15.112:0/2154009962 wait complete. 2021-10-08T19:24:35.444 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:35.445 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.446 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.446 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.446 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.446 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.447 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.447 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.447 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.447 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.448 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.448 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.449 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.449 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.450 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.450 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:35.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.452 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.452 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.452 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.453 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.453 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.453 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.454 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.454 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.454 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.454 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.455 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.455 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:35.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:35.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:35.807 DEBUG:teuthology.orchestra.run.smithi112:osd.3> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@osd.3.service 2021-10-08T19:24:35.810 INFO:tasks.cephadm:Deploying osd.4 on smithi142 with /dev/vg_nvme/lv_4... 2021-10-08T19:24:35.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-10-08T19:24:35.839 INFO:journalctl@ceph.osd.3.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:24:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:36 smithi112 ceph-mon[40655]: poll took 3881.218 ms: 1 events 2021-10-08T19:24:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:36 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi112 to 3781M 2021-10-08T19:24:36.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:36 smithi112 ceph-mon[31694]: poll took 3881.218 ms: 1 events 2021-10-08T19:24:36.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:36 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi112 to 3781M 2021-10-08T19:24:36.609 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:36 smithi142 ceph-mon[33432]: poll took 3881.218 ms: 1 events 2021-10-08T19:24:36.609 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:36 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi112 to 3781M 2021-10-08T19:24:37.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:37 smithi112 ceph-mon[31694]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:37 smithi112 ceph-mon[40655]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:37.767 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:37 smithi142 ceph-mon[33432]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:38.379 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-10-08T19:24:38.379 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-10-08T19:24:38.380 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2021-10-08T19:24:38.380 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2021-10-08T19:24:38.380 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126846 s, 827 MB/s 2021-10-08T19:24:38.380 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2021-10-08T19:24:38.571 INFO:journalctl@ceph.osd.3.smithi112.stdout:Oct 08 19:24:38 smithi112 conmon[57287]: 2021-10-08T19:24:38.114+0000 7f66314f40c0 -1 osd.3 0 log_to_monitors {default=true} 2021-10-08T19:24:38.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:38 smithi112 ceph-mon[31694]: from='osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:24:38.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:38 smithi112 ceph-mon[31694]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:24:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:38 smithi112 ceph-mon[40655]: from='osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:24:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:38 smithi112 ceph-mon[40655]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:24:38.583 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:38 smithi142 ceph-mon[33432]: from='osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:24:38.584 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:38 smithi142 ceph-mon[33432]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-10-08T19:24:39.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi142:vg_nvme/lv_4 2021-10-08T19:24:39.310 INFO:journalctl@ceph.osd.3.smithi112.stdout:Oct 08 19:24:39 smithi112 conmon[57287]: 2021-10-08T19:24:39.302+0000 7f6627c9c700 -1 osd.3 0 waiting for initial osdmap 2021-10-08T19:24:39.311 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:24:39 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:39.312 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[40655]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:39.312 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[40655]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:24:39.313 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[40655]: osdmap e24: 4 total, 3 up, 4 in 2021-10-08T19:24:39.313 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:39.313 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[40655]: from='osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:39.313 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[40655]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:39.313 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:39.314 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[31694]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:39.314 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[31694]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:24:39.315 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[31694]: osdmap e24: 4 total, 3 up, 4 in 2021-10-08T19:24:39.315 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:39.316 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[31694]: from='osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:39.316 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[31694]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:39.316 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:39 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:39.570 INFO:journalctl@ceph.osd.3.smithi112.stdout:Oct 08 19:24:39 smithi112 conmon[57287]: 2021-10-08T19:24:39.308+0000 7f662062f700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:24:39.657 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:39 smithi142 ceph-mon[33432]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:39.657 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:39 smithi142 ceph-mon[33432]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-10-08T19:24:39.657 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:39 smithi142 ceph-mon[33432]: osdmap e24: 4 total, 3 up, 4 in 2021-10-08T19:24:39.658 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:39.658 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:39 smithi142 ceph-mon[33432]: from='osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:39.658 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:39 smithi142 ceph-mon[33432]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2021-10-08T19:24:39.658 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:39 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:40.303 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:24:39 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:40.509 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:40 smithi142 ceph-mon[33432]: Detected new or changed devices on smithi112 2021-10-08T19:24:40.510 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:40 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:24:40.510 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:40 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:40.510 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:40 smithi142 ceph-mon[33432]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:40.511 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:40 smithi142 ceph-mon[33432]: osdmap e25: 4 total, 3 up, 4 in 2021-10-08T19:24:40.511 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:40 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:40.511 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:40 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:40.511 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:40 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:40.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[31694]: Detected new or changed devices on smithi112 2021-10-08T19:24:40.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:24:40.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[31694]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[31694]: osdmap e25: 4 total, 3 up, 4 in 2021-10-08T19:24:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:40.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[40655]: Detected new or changed devices on smithi112 2021-10-08T19:24:40.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:24:40.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:40.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[40655]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2021-10-08T19:24:40.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[40655]: osdmap e25: 4 total, 3 up, 4 in 2021-10-08T19:24:40.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:40.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:40.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:40 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:41.019 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 -- 172.21.15.142:0/1276222085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 msgr2=0x7f6d5c0f89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:41.019 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 --2- 172.21.15.142:0/1276222085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 0x7f6d5c0f89a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009a60 tx=0x7f6d58004d10 comp rx=0 tx=0).stop 2021-10-08T19:24:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 -- 172.21.15.142:0/1276222085 shutdown_connections 2021-10-08T19:24:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 --2- 172.21.15.142:0/1276222085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d5c0fa1c0 0x7f6d5c100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 --2- 172.21.15.142:0/1276222085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 0x7f6d5c0f89a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 --2- 172.21.15.142:0/1276222085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d5c0f9830 0x7f6d5c0f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 -- 172.21.15.142:0/1276222085 >> 172.21.15.142:0/1276222085 conn(0x7f6d5c0f3d80 msgr2=0x7f6d5c0f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 -- 172.21.15.142:0/1276222085 shutdown_connections 2021-10-08T19:24:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 -- 172.21.15.142:0/1276222085 wait complete. 2021-10-08T19:24:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 Processor -- start 2021-10-08T19:24:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.015+0000 7f6d63309700 1 -- start start 2021-10-08T19:24:41.022 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d63309700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 0x7f6d5c108860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:41.022 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d63309700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d5c0f9830 0x7f6d5c108da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:41.022 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d63309700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d5c0fa1c0 0x7f6d5c10fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:41.022 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d63309700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c110400 con 0x7f6d5c0f9830 2021-10-08T19:24:41.023 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d63309700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c110570 con 0x7f6d5c0f8590 2021-10-08T19:24:41.023 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d63309700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c110730 con 0x7f6d5c0fa1c0 2021-10-08T19:24:41.023 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 0x7f6d5c108860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:41.023 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 0x7f6d5c108860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59106/0 (socket says 172.21.15.142:59106) 2021-10-08T19:24:41.024 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 -- 172.21.15.142:0/322911914 learned_addr learned my addr 172.21.15.142:0/322911914 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:24:41.024 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d608a4700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d5c0f9830 0x7f6d5c108da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:41.024 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d618a6700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d5c0fa1c0 0x7f6d5c10fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:41.025 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 -- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d5c0fa1c0 msgr2=0x7f6d5c10fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:41.025 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d5c0fa1c0 0x7f6d5c10fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:41.025 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 -- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d5c0f9830 msgr2=0x7f6d5c108da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:41.025 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d5c0f9830 0x7f6d5c108da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:41.026 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 -- 172.21.15.142:0/322911914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58009640 con 0x7f6d5c0f8590 2021-10-08T19:24:41.026 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d618a6700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d5c0fa1c0 0x7f6d5c10fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:24:41.026 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d610a5700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 0x7f6d5c108860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d58015040 tx=0x7f6d58004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:41.026 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d51ffb700 1 -- 172.21.15.142:0/322911914 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5800e030 con 0x7f6d5c0f8590 2021-10-08T19:24:41.027 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d51ffb700 1 -- 172.21.15.142:0/322911914 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6d5801c440 con 0x7f6d5c0f8590 2021-10-08T19:24:41.027 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d51ffb700 1 -- 172.21.15.142:0/322911914 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58012680 con 0x7f6d5c0f8590 2021-10-08T19:24:41.027 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.016+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c1109b0 con 0x7f6d5c0f8590 2021-10-08T19:24:41.027 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.017+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c110e50 con 0x7f6d5c0f8590 2021-10-08T19:24:41.027 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.017+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c0289c0 con 0x7f6d5c0f8590 2021-10-08T19:24:41.029 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.018+0000 7f6d51ffb700 1 -- 172.21.15.142:0/322911914 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7f6d5802c070 con 0x7f6d5c0f8590 2021-10-08T19:24:41.029 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.018+0000 7f6d51ffb700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f6d480634f0 0x7f6d480659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:41.029 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.018+0000 7f6d51ffb700 1 -- 172.21.15.142:0/322911914 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3429+0+0 (secure 0 0 0) 0x7f6d58080e80 con 0x7f6d5c0f8590 2021-10-08T19:24:41.029 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.018+0000 7f6d608a4700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f6d480634f0 0x7f6d480659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:41.030 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.019+0000 7f6d608a4700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f6d480634f0 0x7f6d480659a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c006fd0 tx=0x7f6d4c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:41.030 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.022+0000 7f6d51ffb700 1 -- 172.21.15.142:0/322911914 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f6d58050ae0 con 0x7f6d5c0f8590 2021-10-08T19:24:41.190 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:41.188+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d5c059800 con 0x7f6d480634f0 2021-10-08T19:24:41.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: purged_snaps scrub starts 2021-10-08T19:24:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: purged_snaps scrub ok 2021-10-08T19:24:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:24:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] boot 2021-10-08T19:24:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: osdmap e26: 4 total, 4 up, 4 in 2021-10-08T19:24:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:41 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:41.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: purged_snaps scrub starts 2021-10-08T19:24:41.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: purged_snaps scrub ok 2021-10-08T19:24:41.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:24:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] boot 2021-10-08T19:24:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: osdmap e26: 4 total, 4 up, 4 in 2021-10-08T19:24:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:41.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: purged_snaps scrub starts 2021-10-08T19:24:41.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: purged_snaps scrub ok 2021-10-08T19:24:41.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:24:41.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:24:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:24:41.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2021-10-08T19:24:41.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:41.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: osd.3 [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] boot 2021-10-08T19:24:41.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: osdmap e26: 4 total, 4 up, 4 in 2021-10-08T19:24:41.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:24:41.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:24:41.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:24:41.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:41 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:42.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:42 smithi142 ceph-mon[33432]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:42 smithi142 ceph-mon[33432]: poll took 6264.321 ms: 1 events 2021-10-08T19:24:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:42 smithi142 ceph-mon[33432]: osdmap e27: 4 total, 4 up, 4 in 2021-10-08T19:24:42.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:42 smithi112 ceph-mon[31694]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:42.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:42 smithi112 ceph-mon[31694]: poll took 6264.321 ms: 1 events 2021-10-08T19:24:42.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:42 smithi112 ceph-mon[31694]: osdmap e27: 4 total, 4 up, 4 in 2021-10-08T19:24:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:42 smithi112 ceph-mon[40655]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:24:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:42 smithi112 ceph-mon[40655]: poll took 6264.321 ms: 1 events 2021-10-08T19:24:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:42 smithi112 ceph-mon[40655]: osdmap e27: 4 total, 4 up, 4 in 2021-10-08T19:24:43.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:43 smithi112 ceph-mon[40655]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:43.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:43 smithi112 ceph-mon[31694]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:43.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:43 smithi142 ceph-mon[33432]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:44.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/2565078488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]: dispatch 2021-10-08T19:24:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]: dispatch 2021-10-08T19:24:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]': finished 2021-10-08T19:24:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[31694]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:24:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/4036775694' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:44.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/2565078488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]: dispatch 2021-10-08T19:24:44.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]: dispatch 2021-10-08T19:24:44.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]': finished 2021-10-08T19:24:44.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[40655]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:24:44.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:44.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/4036775694' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:44.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/2565078488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]: dispatch 2021-10-08T19:24:44.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]: dispatch 2021-10-08T19:24:44.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7a8fbce-2e6e-4ae0-8b21-53e294747dbc"}]': finished 2021-10-08T19:24:44.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:44 smithi142 ceph-mon[33432]: osdmap e28: 5 total, 4 up, 5 in 2021-10-08T19:24:44.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:44 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:44.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/4036775694' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:24:46.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:45 smithi142 ceph-mon[33432]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:46.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:45 smithi112 ceph-mon[31694]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:46.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:45 smithi112 ceph-mon[40655]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:47.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:46 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:47.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:46 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:47.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:46 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:47.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:46 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:47.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:24:47.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:46 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:24:47.907 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:47 smithi142 ceph-mon[33432]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:48.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:47 smithi112 ceph-mon[31694]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:48.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:47 smithi112 ceph-mon[40655]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:48.738 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:48 smithi142 ceph-mon[33432]: poll took 5389.489 ms: 1 events 2021-10-08T19:24:49.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:48 smithi112 ceph-mon[31694]: poll took 5389.489 ms: 1 events 2021-10-08T19:24:49.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:48 smithi112 ceph-mon[40655]: poll took 5389.489 ms: 1 events 2021-10-08T19:24:50.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:49 smithi142 ceph-mon[33432]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:50.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:49 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:24:50.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:49 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:50.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:49 smithi112 ceph-mon[31694]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:50.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:49 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:24:50.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:49 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:50.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:49 smithi112 ceph-mon[40655]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:50.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:49 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-10-08T19:24:50.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:49 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:51.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:50 smithi142 ceph-mon[33432]: poll took 2084.093 ms: 1 events 2021-10-08T19:24:51.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:50 smithi142 ceph-mon[33432]: Deploying daemon osd.4 on smithi142 2021-10-08T19:24:51.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:50 smithi112 ceph-mon[31694]: poll took 2084.093 ms: 1 events 2021-10-08T19:24:51.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:50 smithi112 ceph-mon[31694]: Deploying daemon osd.4 on smithi142 2021-10-08T19:24:51.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:50 smithi112 ceph-mon[40655]: poll took 2084.093 ms: 1 events 2021-10-08T19:24:51.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:50 smithi112 ceph-mon[40655]: Deploying daemon osd.4 on smithi142 2021-10-08T19:24:52.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:51 smithi142 ceph-mon[33432]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:52.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:51 smithi112 ceph-mon[31694]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:52.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:51 smithi112 ceph-mon[40655]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:53.513 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 4 on host 'smithi142' 2021-10-08T19:24:53.515 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.511+0000 7f6d51ffb700 1 -- 172.21.15.142:0/322911914 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6d5c059800 con 0x7f6d480634f0 2021-10-08T19:24:53.515 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f6d480634f0 msgr2=0x7f6d480659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:53.515 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f6d480634f0 0x7f6d480659a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c006fd0 tx=0x7f6d4c008040 comp rx=0 tx=0).stop 2021-10-08T19:24:53.515 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 msgr2=0x7f6d5c108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:53.516 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 0x7f6d5c108860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d58015040 tx=0x7f6d58004d10 comp rx=0 tx=0).stop 2021-10-08T19:24:53.516 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 shutdown_connections 2021-10-08T19:24:53.516 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f6d480634f0 0x7f6d480659a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:53.516 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d5c0fa1c0 0x7f6d5c10fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:53.517 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5c0f8590 0x7f6d5c108860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:53.517 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 --2- 172.21.15.142:0/322911914 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d5c0f9830 0x7f6d5c108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:53.517 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 >> 172.21.15.142:0/322911914 conn(0x7f6d5c0f3d80 msgr2=0x7f6d5c0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:53.517 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 shutdown_connections 2021-10-08T19:24:53.517 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:53.514+0000 7f6d63309700 1 -- 172.21.15.142:0/322911914 wait complete. 2021-10-08T19:24:53.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:53.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:53.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:53.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:53.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:53.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:53.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:53.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:53.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:53.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:53.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:53.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:53.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:53 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:54.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:54.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:54.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:54.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:54.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:54.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:54.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:54.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:24:54.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:24:54.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:24:54.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:24:54.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:53 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:24:54.263 DEBUG:teuthology.orchestra.run.smithi142:osd.4> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@osd.4.service 2021-10-08T19:24:54.267 INFO:tasks.cephadm:Deploying osd.5 on smithi142 with /dev/vg_nvme/lv_3... 2021-10-08T19:24:54.268 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-10-08T19:24:54.296 INFO:journalctl@ceph.osd.4.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:24:55.001 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:54 smithi142 ceph-mon[33432]: poll took 3433.851 ms: 1 events 2021-10-08T19:24:55.002 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:54 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi142 to 16148M 2021-10-08T19:24:55.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:54 smithi112 ceph-mon[31694]: poll took 3433.851 ms: 1 events 2021-10-08T19:24:55.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:54 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi142 to 16148M 2021-10-08T19:24:55.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:54 smithi112 ceph-mon[40655]: poll took 3433.851 ms: 1 events 2021-10-08T19:24:55.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:54 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi142 to 16148M 2021-10-08T19:24:55.930 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:55 smithi142 ceph-mon[33432]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:56.070 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:55 smithi112 ceph-mon[40655]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:56.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:55 smithi112 ceph-mon[31694]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:56.333 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-10-08T19:24:56.333 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-10-08T19:24:56.333 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2021-10-08T19:24:56.334 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2021-10-08T19:24:56.334 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120203 s, 872 MB/s 2021-10-08T19:24:56.334 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2021-10-08T19:24:56.933 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:56 smithi142 ceph-mon[33432]: from='osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:56.933 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:56 smithi142 ceph-mon[33432]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:56.934 INFO:journalctl@ceph.osd.4.smithi142.stdout:Oct 08 19:24:56 smithi142 conmon[40749]: 2021-10-08T19:24:56.652+0000 7f68302790c0 -1 osd.4 0 log_to_monitors {default=true} 2021-10-08T19:24:56.995 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi142:vg_nvme/lv_3 2021-10-08T19:24:57.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:56 smithi112 ceph-mon[31694]: from='osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:57.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:56 smithi112 ceph-mon[31694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:57.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:56 smithi112 ceph-mon[40655]: from='osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:57.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:56 smithi112 ceph-mon[40655]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-10-08T19:24:57.772 INFO:journalctl@ceph.osd.4.smithi142.stdout:Oct 08 19:24:57 smithi142 conmon[40749]: 2021-10-08T19:24:57.686+0000 7f6826a21700 -1 osd.4 0 waiting for initial osdmap 2021-10-08T19:24:57.773 INFO:journalctl@ceph.osd.4.smithi142.stdout:Oct 08 19:24:57 smithi142 conmon[40749]: 2021-10-08T19:24:57.690+0000 7f681f3b4700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:24:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:57 smithi142 ceph-mon[33432]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:57 smithi142 ceph-mon[33432]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:24:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:57 smithi142 ceph-mon[33432]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:24:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:57 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:57 smithi142 ceph-mon[33432]: from='osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:24:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:57 smithi142 ceph-mon[33432]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:24:58.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[40655]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:58.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[40655]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:24:58.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[40655]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:24:58.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:58.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[40655]: from='osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:24:58.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[40655]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:24:58.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[31694]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:24:58.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[31694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-10-08T19:24:58.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[31694]: osdmap e29: 5 total, 4 up, 5 in 2021-10-08T19:24:58.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:58.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[31694]: from='osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:24:58.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:57 smithi112 ceph-mon[31694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:24:58.659 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.654+0000 7f002b59e700 1 -- 172.21.15.142:0/2709452258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 msgr2=0x7f002c0f88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:58.659 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.654+0000 7f002b59e700 1 --2- 172.21.15.142:0/2709452258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 0x7f002c0f88b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f001c0046e0 tx=0x7f001c009b30 comp rx=0 tx=0).stop 2021-10-08T19:24:58.659 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 -- 172.21.15.142:0/2709452258 shutdown_connections 2021-10-08T19:24:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 --2- 172.21.15.142:0/2709452258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002c0fa0d0 0x7f002c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 --2- 172.21.15.142:0/2709452258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 0x7f002c0f88b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 --2- 172.21.15.142:0/2709452258 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f002c0f9740 0x7f002c0f9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 -- 172.21.15.142:0/2709452258 >> 172.21.15.142:0/2709452258 conn(0x7f002c0f3bf0 msgr2=0x7f002c0f6020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:24:58.661 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 -- 172.21.15.142:0/2709452258 shutdown_connections 2021-10-08T19:24:58.661 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 -- 172.21.15.142:0/2709452258 wait complete. 2021-10-08T19:24:58.661 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 Processor -- start 2021-10-08T19:24:58.661 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 -- start start 2021-10-08T19:24:58.662 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 0x7f002c108800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:58.662 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002c0f9740 0x7f002c108d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:58.662 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f002c0fa0d0 0x7f002c109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:58.662 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c10a200 con 0x7f002c0f9740 2021-10-08T19:24:58.663 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c10a370 con 0x7f002c0f84a0 2021-10-08T19:24:58.663 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002b59e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c10a530 con 0x7f002c0fa0d0 2021-10-08T19:24:58.663 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 0x7f002c108800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:58.663 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 0x7f002c108800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59184/0 (socket says 172.21.15.142:59184) 2021-10-08T19:24:58.663 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f002a59c700 1 -- 172.21.15.142:0/4009222370 learned_addr learned my addr 172.21.15.142:0/4009222370 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:24:58.664 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.655+0000 7f0029d9b700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002c0f9740 0x7f002c108d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:58.664 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002ad9d700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f002c0fa0d0 0x7f002c109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:58.664 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002a59c700 1 -- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f002c0fa0d0 msgr2=0x7f002c109be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:58.664 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002a59c700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f002c0fa0d0 0x7f002c109be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:58.665 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002a59c700 1 -- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002c0f9740 msgr2=0x7f002c108d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:24:58.665 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002a59c700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002c0f9740 0x7f002c108d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:24:58.665 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002a59c700 1 -- 172.21.15.142:0/4009222370 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c005040 con 0x7f002c0f84a0 2021-10-08T19:24:58.665 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002a59c700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 0x7f002c108800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f001c009880 tx=0x7f001c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:58.665 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f001affd700 1 -- 172.21.15.142:0/4009222370 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c00e040 con 0x7f002c0f84a0 2021-10-08T19:24:58.666 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f001affd700 1 -- 172.21.15.142:0/4009222370 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f001c000d10 con 0x7f002c0f84a0 2021-10-08T19:24:58.666 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c10a7b0 con 0x7f002c0f84a0 2021-10-08T19:24:58.666 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f001affd700 1 -- 172.21.15.142:0/4009222370 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c01c840 con 0x7f002c0f84a0 2021-10-08T19:24:58.666 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.656+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c110ff0 con 0x7f002c0f84a0 2021-10-08T19:24:58.666 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.657+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002c0472f0 con 0x7f002c0f84a0 2021-10-08T19:24:58.667 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.657+0000 7f001affd700 1 -- 172.21.15.142:0/4009222370 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7f001c007920 con 0x7f002c0f84a0 2021-10-08T19:24:58.667 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.658+0000 7f001affd700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f0014063440 0x7f00140658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:24:58.667 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.658+0000 7f001affd700 1 -- 172.21.15.142:0/4009222370 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4004+0+0 (secure 0 0 0) 0x7f001c080150 con 0x7f002c0f84a0 2021-10-08T19:24:58.667 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.658+0000 7f0029d9b700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f0014063440 0x7f00140658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:24:58.668 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.658+0000 7f0029d9b700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f0014063440 0x7f00140658f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0020004c40 tx=0x7f002000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:24:58.668 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.662+0000 7f001affd700 1 -- 172.21.15.142:0/4009222370 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f001c04fbb0 con 0x7f002c0f84a0 2021-10-08T19:24:58.830 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:24:58.829+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f002c103180 con 0x7f0014063440 2021-10-08T19:24:59.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:58 smithi142 ceph-mon[33432]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:24:59.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:58 smithi142 ceph-mon[33432]: osdmap e30: 5 total, 4 up, 5 in 2021-10-08T19:24:59.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:59.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:59.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:58 smithi142 ceph-mon[33432]: osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] boot 2021-10-08T19:24:59.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:58 smithi142 ceph-mon[33432]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:24:59.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:58 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:59.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[40655]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:24:59.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[40655]: osdmap e30: 5 total, 4 up, 5 in 2021-10-08T19:24:59.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:59.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:59.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[40655]: osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] boot 2021-10-08T19:24:59.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[40655]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:24:59.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:59.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[31694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:24:59.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[31694]: osdmap e30: 5 total, 4 up, 5 in 2021-10-08T19:24:59.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:59.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:24:59.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[31694]: osd.4 [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] boot 2021-10-08T19:24:59.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[31694]: osdmap e31: 5 total, 5 up, 5 in 2021-10-08T19:24:59.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:58 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:25:00.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:59 smithi142 ceph-mon[33432]: purged_snaps scrub starts 2021-10-08T19:25:00.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:59 smithi142 ceph-mon[33432]: purged_snaps scrub ok 2021-10-08T19:25:00.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:59 smithi142 ceph-mon[33432]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:25:00.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:59 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:00.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:59 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:00.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:59 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:00.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:24:59 smithi142 ceph-mon[33432]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:25:00.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[31694]: purged_snaps scrub starts 2021-10-08T19:25:00.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[31694]: purged_snaps scrub ok 2021-10-08T19:25:00.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[31694]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:25:00.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:00.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:00.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:00.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[31694]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:25:00.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[40655]: purged_snaps scrub starts 2021-10-08T19:25:00.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[40655]: purged_snaps scrub ok 2021-10-08T19:25:00.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[40655]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2021-10-08T19:25:00.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:00.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:00.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:00.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:24:59 smithi112 ceph-mon[40655]: osdmap e32: 5 total, 5 up, 5 in 2021-10-08T19:25:01.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:00 smithi142 ceph-mon[33432]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:01.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:00 smithi142 ceph-mon[33432]: poll took 5333.825 ms: 1 events 2021-10-08T19:25:01.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:00 smithi142 ceph-mon[33432]: osdmap e33: 5 total, 5 up, 5 in 2021-10-08T19:25:01.030 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:00 smithi112 ceph-mon[40655]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:01.030 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:00 smithi112 ceph-mon[40655]: poll took 5333.825 ms: 1 events 2021-10-08T19:25:01.030 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:00 smithi112 ceph-mon[40655]: osdmap e33: 5 total, 5 up, 5 in 2021-10-08T19:25:01.031 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:00 smithi112 ceph-mon[31694]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:01.031 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:00 smithi112 ceph-mon[31694]: poll took 5333.825 ms: 1 events 2021-10-08T19:25:01.031 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:00 smithi112 ceph-mon[31694]: osdmap e33: 5 total, 5 up, 5 in 2021-10-08T19:25:02.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:01 smithi142 ceph-mon[33432]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:02.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:01 smithi142 ceph-mon[33432]: osdmap e34: 5 total, 5 up, 5 in 2021-10-08T19:25:02.070 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:01 smithi112 ceph-mon[40655]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:02.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:01 smithi112 ceph-mon[40655]: osdmap e34: 5 total, 5 up, 5 in 2021-10-08T19:25:02.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:01 smithi112 ceph-mon[31694]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:02.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:01 smithi112 ceph-mon[31694]: osdmap e34: 5 total, 5 up, 5 in 2021-10-08T19:25:03.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/2960555753' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]: dispatch 2021-10-08T19:25:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]: dispatch 2021-10-08T19:25:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]': finished 2021-10-08T19:25:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:02 smithi142 ceph-mon[33432]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:25:03.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:02 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:03.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/3589776865' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:03.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/2960555753' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]: dispatch 2021-10-08T19:25:03.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]: dispatch 2021-10-08T19:25:03.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]': finished 2021-10-08T19:25:03.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[40655]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:25:03.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:03.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/3589776865' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:03.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/2960555753' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]: dispatch 2021-10-08T19:25:03.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]: dispatch 2021-10-08T19:25:03.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bc6f6dd-7196-4779-86cb-679b6fc75a0b"}]': finished 2021-10-08T19:25:03.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[31694]: osdmap e35: 6 total, 5 up, 6 in 2021-10-08T19:25:03.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:03.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/3589776865' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:04.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:03 smithi142 ceph-mon[33432]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:03 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:03 smithi112 ceph-mon[31694]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:03 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:04.072 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:25:03 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:25:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:04.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:03 smithi112 ceph-mon[40655]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:04.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:03 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:05.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:04 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:05.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:04 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:25:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:05.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:04 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:05.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:04 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:25:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:05.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:04 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:05.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:04 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:25:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:05.970 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:05 smithi142 ceph-mon[33432]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:06.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:05 smithi112 ceph-mon[31694]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:06.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:05 smithi112 ceph-mon[40655]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:07.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:06 smithi142 ceph-mon[33432]: poll took 5957.697 ms: 1 events 2021-10-08T19:25:07.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:06 smithi112 ceph-mon[31694]: poll took 5957.697 ms: 1 events 2021-10-08T19:25:07.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:06 smithi112 ceph-mon[40655]: poll took 5957.697 ms: 1 events 2021-10-08T19:25:08.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:07 smithi142 ceph-mon[33432]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:25:08.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:07 smithi112 ceph-mon[31694]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:25:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:07 smithi112 ceph-mon[40655]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:25:09.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:09 smithi142 ceph-mon[33432]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:25:09.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:09 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:25:09.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:09 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:09.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:25:09 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:25:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:09.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:09 smithi112 ceph-mon[31694]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:25:09.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:09 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:25:09.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:09 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:09 smithi112 ceph-mon[40655]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 75 KiB/s, 0 objects/s recovering 2021-10-08T19:25:09.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:09 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-10-08T19:25:09.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:09 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:10.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:10 smithi142 ceph-mon[33432]: poll took 3249.087 ms: 1 events 2021-10-08T19:25:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:10 smithi142 ceph-mon[33432]: Deploying daemon osd.5 on smithi142 2021-10-08T19:25:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:10 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:10 smithi142 ceph-mon[33432]: Detected new or changed devices on smithi142 2021-10-08T19:25:10.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:10 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:25:10.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:10 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:25:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:10.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[31694]: poll took 3249.087 ms: 1 events 2021-10-08T19:25:10.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[31694]: Deploying daemon osd.5 on smithi142 2021-10-08T19:25:10.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:10.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[31694]: Detected new or changed devices on smithi142 2021-10-08T19:25:10.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:25:10.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:25:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[40655]: poll took 3249.087 ms: 1 events 2021-10-08T19:25:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[40655]: Deploying daemon osd.5 on smithi142 2021-10-08T19:25:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[40655]: Detected new or changed devices on smithi142 2021-10-08T19:25:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:25:10.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:10 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:25:09] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:11.506 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:11 smithi142 ceph-mon[33432]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2021-10-08T19:25:11.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:11 smithi112 ceph-mon[31694]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2021-10-08T19:25:11.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:11 smithi112 ceph-mon[40655]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2021-10-08T19:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 5 on host 'smithi142' 2021-10-08T19:25:12.830 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.827+0000 7f001affd700 1 -- 172.21.15.142:0/4009222370 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f002c103180 con 0x7f0014063440 2021-10-08T19:25:12.830 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f0014063440 msgr2=0x7f00140658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f0014063440 0x7f00140658f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0020004c40 tx=0x7f002000b040 comp rx=0 tx=0).stop 2021-10-08T19:25:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 msgr2=0x7f002c108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 0x7f002c108800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f001c009880 tx=0x7f001c009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 shutdown_connections 2021-10-08T19:25:12.832 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f0014063440 0x7f00140658f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.832 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f002c0fa0d0 0x7f002c109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.832 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f002c0f84a0 0x7f002c108800 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.832 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 --2- 172.21.15.142:0/4009222370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002c0f9740 0x7f002c108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:12.833 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 >> 172.21.15.142:0/4009222370 conn(0x7f002c0f3bf0 msgr2=0x7f002c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:12.833 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 shutdown_connections 2021-10-08T19:25:12.833 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:12.830+0000 7f002b59e700 1 -- 172.21.15.142:0/4009222370 wait complete. 2021-10-08T19:25:13.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 57 KiB/s, 0 objects/s recovering 2021-10-08T19:25:13.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:13.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:13.521 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:13.521 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.521 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:13.521 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:13.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:13.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:13.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:13 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.524 DEBUG:teuthology.orchestra.run.smithi142:osd.5> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@osd.5.service 2021-10-08T19:25:13.526 INFO:tasks.cephadm:Deploying osd.6 on smithi142 with /dev/vg_nvme/lv_2... 2021-10-08T19:25:13.527 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-10-08T19:25:13.555 INFO:journalctl@ceph.osd.5.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:25:13.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 57 KiB/s, 0 objects/s recovering 2021-10-08T19:25:13.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:13.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:13.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:13.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:13.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 57 KiB/s, 0 objects/s recovering 2021-10-08T19:25:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:13.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:13.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:13.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:13.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:13.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:13.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:13.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:13.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:13 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:14.460 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:14 smithi142 ceph-mon[33432]: poll took 3334.864 ms: 1 events 2021-10-08T19:25:14.460 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:14 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi142 to 8074M 2021-10-08T19:25:14.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:14 smithi112 ceph-mon[31694]: poll took 3334.864 ms: 1 events 2021-10-08T19:25:14.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:14 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi142 to 8074M 2021-10-08T19:25:14.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:14 smithi112 ceph-mon[40655]: poll took 3334.864 ms: 1 events 2021-10-08T19:25:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:14 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi142 to 8074M 2021-10-08T19:25:15.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:15 smithi142 ceph-mon[33432]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:15.563 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-10-08T19:25:15.564 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-10-08T19:25:15.564 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2021-10-08T19:25:15.564 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2021-10-08T19:25:15.564 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122925 s, 853 MB/s 2021-10-08T19:25:15.565 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2021-10-08T19:25:15.570 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:15 smithi112 ceph-mon[40655]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:15.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:15 smithi112 ceph-mon[31694]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:16.255 INFO:journalctl@ceph.osd.5.smithi142.stdout:Oct 08 19:25:15 smithi142 conmon[44867]: 2021-10-08T19:25:15.986+0000 7fe559fed0c0 -1 osd.5 0 log_to_monitors {default=true} 2021-10-08T19:25:16.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi142:vg_nvme/lv_2 2021-10-08T19:25:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:16 smithi142 ceph-mon[33432]: from='osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:25:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:16 smithi142 ceph-mon[33432]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:25:16.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:16 smithi112 ceph-mon[31694]: from='osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:25:16.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:16 smithi112 ceph-mon[31694]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:25:16.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:16 smithi112 ceph-mon[40655]: from='osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:25:16.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:16 smithi112 ceph-mon[40655]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-10-08T19:25:17.522 INFO:journalctl@ceph.osd.5.smithi142.stdout:Oct 08 19:25:17 smithi142 conmon[44867]: 2021-10-08T19:25:17.288+0000 7fe550795700 -1 osd.5 0 waiting for initial osdmap 2021-10-08T19:25:17.523 INFO:journalctl@ceph.osd.5.smithi142.stdout:Oct 08 19:25:17 smithi142 conmon[44867]: 2021-10-08T19:25:17.293+0000 7fe549929700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:25:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:17 smithi142 ceph-mon[33432]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:17 smithi142 ceph-mon[33432]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:25:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:17 smithi142 ceph-mon[33432]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:25:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:17 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:17 smithi142 ceph-mon[33432]: from='osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:17 smithi142 ceph-mon[33432]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:17.570 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[40655]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[40655]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:25:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[40655]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:25:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[40655]: from='osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:17.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[40655]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:17.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[31694]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:17.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[31694]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-10-08T19:25:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[31694]: osdmap e36: 6 total, 5 up, 6 in 2021-10-08T19:25:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[31694]: from='osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:17 smithi112 ceph-mon[31694]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:18.046 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 -- 172.21.15.142:0/1910442335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7070 msgr2=0x7f91400f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:18.046 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 --2- 172.21.15.142:0/1910442335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7070 0x7f91400f74c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91300046e0 tx=0x7f9130009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:18.046 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 -- 172.21.15.142:0/1910442335 shutdown_connections 2021-10-08T19:25:18.047 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 --2- 172.21.15.142:0/1910442335 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91400f7a00 0x7f91400ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:18.047 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 --2- 172.21.15.142:0/1910442335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91400f8a60 0x7f91400f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:18.047 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 --2- 172.21.15.142:0/1910442335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7070 0x7f91400f74c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:18.047 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 -- 172.21.15.142:0/1910442335 >> 172.21.15.142:0/1910442335 conn(0x7f91400f2b20 msgr2=0x7f91400f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:18.048 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 -- 172.21.15.142:0/1910442335 shutdown_connections 2021-10-08T19:25:18.048 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 -- 172.21.15.142:0/1910442335 wait complete. 2021-10-08T19:25:18.048 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 Processor -- start 2021-10-08T19:25:18.048 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 -- start start 2021-10-08T19:25:18.049 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.043+0000 7f9146aa9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91400f7070 0x7f914010b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:18.049 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f9146aa9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7a00 0x7f914010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:18.049 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f9146aa9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91400f8a60 0x7f914010ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:18.049 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f9146aa9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401104a0 con 0x7f91400f8a60 2021-10-08T19:25:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f9146aa9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401105e0 con 0x7f91400f7a00 2021-10-08T19:25:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f9146aa9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9140110750 con 0x7f91400f7070 2021-10-08T19:25:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7a00 0x7f914010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7a00 0x7f914010da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59248/0 (socket says 172.21.15.142:59248) 2021-10-08T19:25:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 -- 172.21.15.142:0/2842910292 learned_addr learned my addr 172.21.15.142:0/2842910292 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:25:18.051 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f9145aa7700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91400f7070 0x7f914010b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:18.051 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91462a8700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91400f8a60 0x7f914010ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:18.051 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 -- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91400f7070 msgr2=0x7f914010b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:18.051 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91400f7070 0x7f914010b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:18.052 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 -- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91400f8a60 msgr2=0x7f914010ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:18.052 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91400f8a60 0x7f914010ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:18.052 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 -- 172.21.15.142:0/2842910292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9130005040 con 0x7f91400f7a00 2021-10-08T19:25:18.053 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91462a8700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91400f8a60 0x7f914010ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:25:18.053 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91452a6700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7a00 0x7f914010da10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9130014e00 tx=0x7f9130009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:18.053 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91367fc700 1 -- 172.21.15.142:0/2842910292 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000e040 con 0x7f91400f7a00 2021-10-08T19:25:18.053 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91367fc700 1 -- 172.21.15.142:0/2842910292 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f9130007d70 con 0x7f91400f7a00 2021-10-08T19:25:18.054 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91401109d0 con 0x7f91400f7a00 2021-10-08T19:25:18.054 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f91367fc700 1 -- 172.21.15.142:0/2842910292 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913001cb40 con 0x7f91400f7a00 2021-10-08T19:25:18.054 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.044+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9140110eb0 con 0x7f91400f7a00 2021-10-08T19:25:18.054 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.045+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91400472f0 con 0x7f91400f7a00 2021-10-08T19:25:18.055 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.045+0000 7f91367fc700 1 -- 172.21.15.142:0/2842910292 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7f913001c3f0 con 0x7f91400f7a00 2021-10-08T19:25:18.056 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.046+0000 7f91367fc700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f912c063440 0x7f912c0658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:18.056 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.046+0000 7f91367fc700 1 -- 172.21.15.142:0/2842910292 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4123+0+0 (secure 0 0 0) 0x7f9130080460 con 0x7f91400f7a00 2021-10-08T19:25:18.056 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.046+0000 7f9145aa7700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f912c063440 0x7f912c0658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:18.056 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.046+0000 7f9145aa7700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f912c063440 0x7f912c0658f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f91400622c0 tx=0x7f913c009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:18.056 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.050+0000 7f91367fc700 1 -- 172.21.15.142:0/2842910292 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f913004fe50 con 0x7f91400f7a00 2021-10-08T19:25:18.214 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:18.213+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9140059800 con 0x7f912c063440 2021-10-08T19:25:18.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: osdmap e37: 6 total, 5 up, 6 in 2021-10-08T19:25:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] boot 2021-10-08T19:25:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:25:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:18 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: osdmap e37: 6 total, 5 up, 6 in 2021-10-08T19:25:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] boot 2021-10-08T19:25:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:25:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:18.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: osdmap e37: 6 total, 5 up, 6 in 2021-10-08T19:25:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: osd.5 [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] boot 2021-10-08T19:25:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: osdmap e38: 6 total, 6 up, 6 in 2021-10-08T19:25:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:25:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:18 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:19.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:19 smithi142 ceph-mon[33432]: purged_snaps scrub starts 2021-10-08T19:25:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:19 smithi142 ceph-mon[33432]: purged_snaps scrub ok 2021-10-08T19:25:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:19 smithi142 ceph-mon[33432]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:19 smithi142 ceph-mon[33432]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:19 smithi142 ceph-mon[33432]: poll took 5402.941 ms: 1 events 2021-10-08T19:25:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:19 smithi142 ceph-mon[33432]: osdmap e39: 6 total, 6 up, 6 in 2021-10-08T19:25:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[31694]: purged_snaps scrub starts 2021-10-08T19:25:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[31694]: purged_snaps scrub ok 2021-10-08T19:25:19.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[31694]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:19.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[31694]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:19.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[31694]: poll took 5402.941 ms: 1 events 2021-10-08T19:25:19.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[31694]: osdmap e39: 6 total, 6 up, 6 in 2021-10-08T19:25:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[40655]: purged_snaps scrub starts 2021-10-08T19:25:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[40655]: purged_snaps scrub ok 2021-10-08T19:25:19.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[40655]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2021-10-08T19:25:19.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[40655]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:19.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[40655]: poll took 5402.941 ms: 1 events 2021-10-08T19:25:19.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:19 smithi112 ceph-mon[40655]: osdmap e39: 6 total, 6 up, 6 in 2021-10-08T19:25:21.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:21 smithi142 ceph-mon[33432]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:21 smithi142 ceph-mon[33432]: osdmap e40: 6 total, 6 up, 6 in 2021-10-08T19:25:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/259746551' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]: dispatch 2021-10-08T19:25:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]: dispatch 2021-10-08T19:25:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]': finished 2021-10-08T19:25:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:21 smithi142 ceph-mon[33432]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:25:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:21 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/2215958251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[31694]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[31694]: osdmap e40: 6 total, 6 up, 6 in 2021-10-08T19:25:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/259746551' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]: dispatch 2021-10-08T19:25:21.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]: dispatch 2021-10-08T19:25:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]': finished 2021-10-08T19:25:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[31694]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:25:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/2215958251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:21.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[40655]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:21.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[40655]: osdmap e40: 6 total, 6 up, 6 in 2021-10-08T19:25:21.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/259746551' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]: dispatch 2021-10-08T19:25:21.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]: dispatch 2021-10-08T19:25:21.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a299c900-e42a-4a11-b6d9-ee294f904be5"}]': finished 2021-10-08T19:25:21.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[40655]: osdmap e41: 7 total, 6 up, 7 in 2021-10-08T19:25:21.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:21.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/2215958251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:23.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:22 smithi142 ceph-mon[33432]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:25:23.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:22 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:23.070 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:22 smithi112 ceph-mon[31694]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:25:23.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:22 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:23.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:22 smithi112 ceph-mon[40655]: osdmap e42: 7 total, 6 up, 7 in 2021-10-08T19:25:23.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:22 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:23.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:23 smithi142 ceph-mon[33432]: pgmap v139: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2021-10-08T19:25:23.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:23 smithi142 ceph-mon[33432]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:25:23.895 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:23 smithi112 ceph-mon[40655]: pgmap v139: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2021-10-08T19:25:23.895 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:23 smithi112 ceph-mon[40655]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:25:23.896 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:23 smithi112 ceph-mon[31694]: pgmap v139: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2021-10-08T19:25:23.896 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:23 smithi112 ceph-mon[31694]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-10-08T19:25:24.929 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:24 smithi112 ceph-mon[40655]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2021-10-08T19:25:24.929 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:24 smithi112 ceph-mon[40655]: Cluster is now healthy 2021-10-08T19:25:24.929 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:24 smithi112 ceph-mon[31694]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2021-10-08T19:25:24.930 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:24 smithi112 ceph-mon[31694]: Cluster is now healthy 2021-10-08T19:25:24.951 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:24 smithi142 ceph-mon[33432]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2021-10-08T19:25:24.951 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:24 smithi142 ceph-mon[33432]: Cluster is now healthy 2021-10-08T19:25:25.811 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:25 smithi142 ceph-mon[33432]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:25.811 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:25 smithi142 ceph-mon[33432]: poll took 5387.848 ms: 1 events 2021-10-08T19:25:26.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:25 smithi112 ceph-mon[31694]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:26.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:25 smithi112 ceph-mon[31694]: poll took 5387.848 ms: 1 events 2021-10-08T19:25:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:25 smithi112 ceph-mon[40655]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:25 smithi112 ceph-mon[40655]: poll took 5387.848 ms: 1 events 2021-10-08T19:25:27.916 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:27 smithi142 ceph-mon[33432]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:27.916 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:25:27.917 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:27 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:28.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:27 smithi112 ceph-mon[31694]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:28.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:25:28.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:27 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:28.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:27 smithi112 ceph-mon[40655]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:28.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-10-08T19:25:28.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:27 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:28.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:25:28 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:25:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:28.915 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:28 smithi142 ceph-mon[33432]: poll took 2384.210 ms: 1 events 2021-10-08T19:25:28.915 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:28 smithi142 ceph-mon[33432]: Deploying daemon osd.6 on smithi142 2021-10-08T19:25:28.916 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:28 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:29.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:28 smithi112 ceph-mon[31694]: poll took 2384.210 ms: 1 events 2021-10-08T19:25:29.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:28 smithi112 ceph-mon[31694]: Deploying daemon osd.6 on smithi142 2021-10-08T19:25:29.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:28 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:28 smithi112 ceph-mon[40655]: poll took 2384.210 ms: 1 events 2021-10-08T19:25:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:28 smithi112 ceph-mon[40655]: Deploying daemon osd.6 on smithi142 2021-10-08T19:25:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:28 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:29.916 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:29 smithi142 ceph-mon[33432]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:29.917 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:29 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:29.917 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:29 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:25:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:30.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:29 smithi112 ceph-mon[31694]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:30.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:29 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:30.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:29 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:25:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:30.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:29 smithi112 ceph-mon[40655]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:30.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:29 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:30.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:29 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:25:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:31.248 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 6 on host 'smithi142' 2021-10-08T19:25:31.249 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.246+0000 7f91367fc700 1 -- 172.21.15.142:0/2842910292 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9140059800 con 0x7f912c063440 2021-10-08T19:25:31.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f912c063440 msgr2=0x7f912c0658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:31.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f912c063440 0x7f912c0658f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f91400622c0 tx=0x7f913c009040 comp rx=0 tx=0).stop 2021-10-08T19:25:31.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7a00 msgr2=0x7f914010da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:31.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7a00 0x7f914010da10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9130014e00 tx=0x7f9130009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:31.251 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 shutdown_connections 2021-10-08T19:25:31.251 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f912c063440 0x7f912c0658f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:31.251 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91400f8a60 0x7f914010ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:31.251 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91400f7070 0x7f914010b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:31.252 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 --2- 172.21.15.142:0/2842910292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91400f7a00 0x7f914010da10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:31.252 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 >> 172.21.15.142:0/2842910292 conn(0x7f91400f2b20 msgr2=0x7f91400f4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:31.252 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 shutdown_connections 2021-10-08T19:25:31.252 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:31.248+0000 7f9146aa9700 1 -- 172.21.15.142:0/2842910292 wait complete. 2021-10-08T19:25:32.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2021-10-08T19:25:32.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:32.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:32.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:32.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:32.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:32.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:32.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:31 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2021-10-08T19:25:32.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:32.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:32.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:32.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:32.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:32.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:32.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2021-10-08T19:25:32.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:32.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:32.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:32.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:32.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:32.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:32.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:32.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:31 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:32.180 DEBUG:teuthology.orchestra.run.smithi142:osd.6> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@osd.6.service 2021-10-08T19:25:32.183 INFO:tasks.cephadm:Deploying osd.7 on smithi142 with /dev/vg_nvme/lv_1... 2021-10-08T19:25:32.183 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-10-08T19:25:32.212 INFO:journalctl@ceph.osd.6.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:25:32.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:32 smithi142 ceph-mon[33432]: poll took 3848.311 ms: 1 events 2021-10-08T19:25:32.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:32 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi142 to 5382M 2021-10-08T19:25:33.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:32 smithi112 ceph-mon[31694]: poll took 3848.311 ms: 1 events 2021-10-08T19:25:33.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:32 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi142 to 5382M 2021-10-08T19:25:33.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:32 smithi112 ceph-mon[40655]: poll took 3848.311 ms: 1 events 2021-10-08T19:25:33.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:32 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi142 to 5382M 2021-10-08T19:25:33.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:33 smithi142 ceph-mon[33432]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2021-10-08T19:25:34.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:33 smithi112 ceph-mon[31694]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2021-10-08T19:25:34.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:33 smithi112 ceph-mon[40655]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2021-10-08T19:25:34.523 INFO:journalctl@ceph.osd.6.smithi142.stdout:Oct 08 19:25:34 smithi142 conmon[48464]: 2021-10-08T19:25:34.439+0000 7fbd1beb60c0 -1 osd.6 0 log_to_monitors {default=true} 2021-10-08T19:25:34.764 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-10-08T19:25:34.765 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-10-08T19:25:34.765 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2021-10-08T19:25:34.765 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2021-10-08T19:25:34.766 INFO:teuthology.orchestra.run.smithi142.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012104 s, 866 MB/s 2021-10-08T19:25:34.766 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2021-10-08T19:25:35.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:34 smithi142 ceph-mon[33432]: from='osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:25:35.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:34 smithi142 ceph-mon[33432]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:25:35.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:34 smithi112 ceph-mon[31694]: from='osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:25:35.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:34 smithi112 ceph-mon[31694]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:25:35.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:34 smithi112 ceph-mon[40655]: from='osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:25:35.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:34 smithi112 ceph-mon[40655]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-10-08T19:25:35.537 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch daemon add osd smithi142:vg_nvme/lv_1 2021-10-08T19:25:35.723 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:35 smithi142 ceph-mon[33432]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:35.724 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:35 smithi142 ceph-mon[33432]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:25:35.724 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:35 smithi142 ceph-mon[33432]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:25:35.724 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:35 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:35.725 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:35 smithi142 ceph-mon[33432]: from='osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:35.725 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:35 smithi142 ceph-mon[33432]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:35.725 INFO:journalctl@ceph.osd.6.smithi142.stdout:Oct 08 19:25:35 smithi142 conmon[48464]: 2021-10-08T19:25:35.721+0000 7fbd1265e700 -1 osd.6 0 waiting for initial osdmap 2021-10-08T19:25:36.022 INFO:journalctl@ceph.osd.6.smithi142.stdout:Oct 08 19:25:35 smithi142 conmon[48464]: 2021-10-08T19:25:35.729+0000 7fbd0b7f2700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:25:36.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:25:35 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:25:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:36.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[31694]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:36.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[31694]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:25:36.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[31694]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:25:36.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:36.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[31694]: from='osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:36.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[31694]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:36.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[40655]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2021-10-08T19:25:36.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[40655]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-10-08T19:25:36.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[40655]: osdmap e43: 7 total, 6 up, 7 in 2021-10-08T19:25:36.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:36.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[40655]: from='osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:36.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:35 smithi112 ceph-mon[40655]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:36.718 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:36.719 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: osdmap e44: 7 total, 6 up, 7 in 2021-10-08T19:25:36.719 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:36.719 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:36.720 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:36.720 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: Detected new or changed devices on smithi142 2021-10-08T19:25:36.720 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:25:36.720 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:25:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:36.720 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:36.721 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] boot 2021-10-08T19:25:36.721 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: osdmap e45: 7 total, 7 up, 7 in 2021-10-08T19:25:36.721 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:36 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:37.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:37.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: osdmap e44: 7 total, 6 up, 7 in 2021-10-08T19:25:37.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:37.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:37.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:37.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: Detected new or changed devices on smithi142 2021-10-08T19:25:37.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:25:37.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:25:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:37.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:37.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] boot 2021-10-08T19:25:37.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: osdmap e45: 7 total, 7 up, 7 in 2021-10-08T19:25:37.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:37.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:37.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: osdmap e44: 7 total, 6 up, 7 in 2021-10-08T19:25:37.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:37.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:37.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:37.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: Detected new or changed devices on smithi142 2021-10-08T19:25:37.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:25:37.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:25:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:37.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2021-10-08T19:25:37.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: osd.6 [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] boot 2021-10-08T19:25:37.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: osdmap e45: 7 total, 7 up, 7 in 2021-10-08T19:25:37.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:36 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:25:37.308 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 -- 172.21.15.142:0/4207470954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f9000 msgr2=0x7f3df80ff8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 --2- 172.21.15.142:0/4207470954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f9000 0x7f3df80ff8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009a60 tx=0x7f3df0004d10 comp rx=0 tx=0).stop 2021-10-08T19:25:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 -- 172.21.15.142:0/4207470954 shutdown_connections 2021-10-08T19:25:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 --2- 172.21.15.142:0/4207470954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f9000 0x7f3df80ff8c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:37.309 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 --2- 172.21.15.142:0/4207470954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df80f73d0 0x7f3df80f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:37.310 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 --2- 172.21.15.142:0/4207470954 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3df80f8670 0x7f3df80f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:37.310 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 -- 172.21.15.142:0/4207470954 >> 172.21.15.142:0/4207470954 conn(0x7f3df80f2b20 msgr2=0x7f3df80f4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:37.310 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 -- 172.21.15.142:0/4207470954 shutdown_connections 2021-10-08T19:25:37.310 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.307+0000 7f3df7fff700 1 -- 172.21.15.142:0/4207470954 wait complete. 2021-10-08T19:25:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df7fff700 1 Processor -- start 2021-10-08T19:25:37.313 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df7fff700 1 -- start start 2021-10-08T19:25:37.314 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df80f73d0 0x7f3df81075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:37.314 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f8670 0x7f3df8107b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:37.314 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df7fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3df80f9000 0x7f3df81089a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df7fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8109140 con 0x7f3df80f73d0 2021-10-08T19:25:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df81092b0 con 0x7f3df80f8670 2021-10-08T19:25:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df7fff700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8109470 con 0x7f3df80f9000 2021-10-08T19:25:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df67fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f8670 0x7f3df8107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:37.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df67fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f8670 0x7f3df8107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59378/0 (socket says 172.21.15.142:59378) 2021-10-08T19:25:37.316 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df67fc700 1 -- 172.21.15.142:0/3867602027 learned_addr learned my addr 172.21.15.142:0/3867602027 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:25:37.316 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df77fe700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3df80f9000 0x7f3df81089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:37.316 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.308+0000 7f3df6ffd700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df80f73d0 0x7f3df81075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:37.317 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3df67fc700 1 -- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3df80f9000 msgr2=0x7f3df81089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:37.317 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3df67fc700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3df80f9000 0x7f3df81089a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:37.318 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3df67fc700 1 -- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df80f73d0 msgr2=0x7f3df81075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:37.318 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3df67fc700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df80f73d0 0x7f3df81075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:37.318 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3df67fc700 1 -- 172.21.15.142:0/3867602027 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0009640 con 0x7f3df80f8670 2021-10-08T19:25:37.318 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3df67fc700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f8670 0x7f3df8107b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00b490 tx=0x7f3dec006ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:37.319 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3ddf7fe700 1 -- 172.21.15.142:0/3867602027 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00be00 con 0x7f3df80f8670 2021-10-08T19:25:37.319 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df8109750 con 0x7f3df80f8670 2021-10-08T19:25:37.319 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3ddf7fe700 1 -- 172.21.15.142:0/3867602027 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3dec00f960 con 0x7f3df80f8670 2021-10-08T19:25:37.319 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3ddf7fe700 1 -- 172.21.15.142:0/3867602027 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec011960 con 0x7f3df80f8670 2021-10-08T19:25:37.320 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.309+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df810fec0 con 0x7f3df80f8670 2021-10-08T19:25:37.320 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.310+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df80f67c0 con 0x7f3df80f8670 2021-10-08T19:25:37.320 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.310+0000 7f3ddf7fe700 1 -- 172.21.15.142:0/3867602027 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7f3dec017020 con 0x7f3df80f8670 2021-10-08T19:25:37.320 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.311+0000 7f3ddf7fe700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3de0063440 0x7f3de00658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:37.320 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.311+0000 7f3ddf7fe700 1 -- 172.21.15.142:0/3867602027 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4868+0+0 (secure 0 0 0) 0x7f3dec07e9f0 con 0x7f3df80f8670 2021-10-08T19:25:37.321 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.311+0000 7f3df6ffd700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3de0063440 0x7f3de00658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:37.321 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.311+0000 7f3df6ffd700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3de0063440 0x7f3de00658f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3de8006fd0 tx=0x7f3de8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:37.322 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.315+0000 7f3ddf7fe700 1 -- 172.21.15.142:0/3867602027 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3dec045b00 con 0x7f3df80f8670 2021-10-08T19:25:37.483 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:37.482+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3df81020f0 con 0x7f3de0063440 2021-10-08T19:25:38.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[40655]: purged_snaps scrub starts 2021-10-08T19:25:38.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[40655]: purged_snaps scrub ok 2021-10-08T19:25:38.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[40655]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:38.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:38.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:38.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:38.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[40655]: poll took 6254.562 ms: 1 events 2021-10-08T19:25:38.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[40655]: osdmap e46: 7 total, 7 up, 7 in 2021-10-08T19:25:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[31694]: purged_snaps scrub starts 2021-10-08T19:25:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[31694]: purged_snaps scrub ok 2021-10-08T19:25:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[31694]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:38.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:38.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:38.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[31694]: poll took 6254.562 ms: 1 events 2021-10-08T19:25:38.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:37 smithi112 ceph-mon[31694]: osdmap e46: 7 total, 7 up, 7 in 2021-10-08T19:25:38.115 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:37 smithi142 ceph-mon[33432]: purged_snaps scrub starts 2021-10-08T19:25:38.116 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:37 smithi142 ceph-mon[33432]: purged_snaps scrub ok 2021-10-08T19:25:38.116 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:37 smithi142 ceph-mon[33432]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:25:38.116 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:37 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-10-08T19:25:38.116 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:37 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-10-08T19:25:38.117 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:37 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:38.117 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:37 smithi142 ceph-mon[33432]: poll took 6254.562 ms: 1 events 2021-10-08T19:25:38.117 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:37 smithi142 ceph-mon[33432]: osdmap e46: 7 total, 7 up, 7 in 2021-10-08T19:25:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:39 smithi142 ceph-mon[33432]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:39 smithi142 ceph-mon[33432]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:25:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:39 smithi112 ceph-mon[40655]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:39 smithi112 ceph-mon[40655]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:25:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:39 smithi112 ceph-mon[31694]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:39 smithi112 ceph-mon[31694]: osdmap e47: 7 total, 7 up, 7 in 2021-10-08T19:25:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/1009823300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]: dispatch 2021-10-08T19:25:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]: dispatch 2021-10-08T19:25:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]': finished 2021-10-08T19:25:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:40 smithi142 ceph-mon[33432]: osdmap e48: 8 total, 7 up, 8 in 2021-10-08T19:25:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:40 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/1009823300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]: dispatch 2021-10-08T19:25:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]: dispatch 2021-10-08T19:25:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]': finished 2021-10-08T19:25:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[40655]: osdmap e48: 8 total, 7 up, 8 in 2021-10-08T19:25:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/1009823300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]: dispatch 2021-10-08T19:25:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]: dispatch 2021-10-08T19:25:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12f6d2e1-a644-45cb-9df7-7b34880592a1"}]': finished 2021-10-08T19:25:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[31694]: osdmap e48: 8 total, 7 up, 8 in 2021-10-08T19:25:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:40 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:41.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:41 smithi142 ceph-mon[33432]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/3460724548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:41 smithi142 ceph-mon[33432]: osdmap e49: 8 total, 7 up, 8 in 2021-10-08T19:25:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:41 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:41.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:41 smithi112 ceph-mon[31694]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/3460724548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:41 smithi112 ceph-mon[31694]: osdmap e49: 8 total, 7 up, 8 in 2021-10-08T19:25:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:41 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:41 smithi112 ceph-mon[40655]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/3460724548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-10-08T19:25:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:41 smithi112 ceph-mon[40655]: osdmap e49: 8 total, 7 up, 8 in 2021-10-08T19:25:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:41 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:43.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:43 smithi142 ceph-mon[33432]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 137 KiB/s, 0 objects/s recovering 2021-10-08T19:25:43.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:43 smithi112 ceph-mon[40655]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 137 KiB/s, 0 objects/s recovering 2021-10-08T19:25:43.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:43 smithi112 ceph-mon[31694]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 137 KiB/s, 0 objects/s recovering 2021-10-08T19:25:44.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:44 smithi142 ceph-mon[33432]: poll took 5386.129 ms: 1 events 2021-10-08T19:25:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:44 smithi112 ceph-mon[31694]: poll took 5386.129 ms: 1 events 2021-10-08T19:25:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:44 smithi112 ceph-mon[40655]: poll took 5386.129 ms: 1 events 2021-10-08T19:25:45.231 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:45 smithi142 ceph-mon[33432]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:25:45.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:45 smithi112 ceph-mon[31694]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:25:45.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:45 smithi112 ceph-mon[40655]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2021-10-08T19:25:47.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:47 smithi142 ceph-mon[33432]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 80 KiB/s, 0 objects/s recovering 2021-10-08T19:25:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:47 smithi142 ceph-mon[33432]: poll took 2388.305 ms: 1 events 2021-10-08T19:25:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:47 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:25:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:47 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:47 smithi142 ceph-mon[33432]: Deploying daemon osd.7 on smithi142 2021-10-08T19:25:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:47 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:47 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:47.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[31694]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 80 KiB/s, 0 objects/s recovering 2021-10-08T19:25:47.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[31694]: poll took 2388.305 ms: 1 events 2021-10-08T19:25:47.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:25:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[31694]: Deploying daemon osd.7 on smithi142 2021-10-08T19:25:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:47.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[40655]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 80 KiB/s, 0 objects/s recovering 2021-10-08T19:25:47.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[40655]: poll took 2388.305 ms: 1 events 2021-10-08T19:25:47.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-10-08T19:25:47.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:47.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[40655]: Deploying daemon osd.7 on smithi142 2021-10-08T19:25:47.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:25:47.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:47 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:25:49.498 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:49 smithi112 ceph-mon[31694]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 71 KiB/s, 0 objects/s recovering 2021-10-08T19:25:49.498 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:49 smithi112 ceph-mon[40655]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 71 KiB/s, 0 objects/s recovering 2021-10-08T19:25:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:49 smithi142 ceph-mon[33432]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 71 KiB/s, 0 objects/s recovering 2021-10-08T19:25:49.860 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 7 on host 'smithi142' 2021-10-08T19:25:49.861 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.858+0000 7f3ddf7fe700 1 -- 172.21.15.142:0/3867602027 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3df81020f0 con 0x7f3de0063440 2021-10-08T19:25:49.862 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3de0063440 msgr2=0x7f3de00658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:49.862 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3de0063440 0x7f3de00658f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3de8006fd0 tx=0x7f3de8008040 comp rx=0 tx=0).stop 2021-10-08T19:25:49.862 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f8670 msgr2=0x7f3df8107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:49.862 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f8670 0x7f3df8107b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00b490 tx=0x7f3dec006ef0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.863 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 shutdown_connections 2021-10-08T19:25:49.863 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f3de0063440 0x7f3de00658f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.863 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3df80f9000 0x7f3df81089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.863 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3df80f73d0 0x7f3df81075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.864 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 --2- 172.21.15.142:0/3867602027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80f8670 0x7f3df8107b00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:49.864 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 >> 172.21.15.142:0/3867602027 conn(0x7f3df80f2b20 msgr2=0x7f3df80fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:49.864 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 shutdown_connections 2021-10-08T19:25:49.864 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:49.861+0000 7f3df7fff700 1 -- 172.21.15.142:0/3867602027 wait complete. 2021-10-08T19:25:50.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:50.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:50.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:50 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:50.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:50.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:50.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:50.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:50.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:25:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:25:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:25:50.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:25:50.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:50 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:50.580 DEBUG:teuthology.orchestra.run.smithi142:osd.7> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@osd.7.service 2021-10-08T19:25:50.583 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2021-10-08T19:25:50.584 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd stat -f json 2021-10-08T19:25:50.611 INFO:journalctl@ceph.osd.7.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:25:51.484 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:51 smithi112 ceph-mon[31694]: poll took 3171.307 ms: 1 events 2021-10-08T19:25:51.485 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:51 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi142 to 4037M 2021-10-08T19:25:51.485 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:51 smithi112 ceph-mon[31694]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2021-10-08T19:25:51.485 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:51 smithi112 ceph-mon[40655]: poll took 3171.307 ms: 1 events 2021-10-08T19:25:51.486 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:51 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi142 to 4037M 2021-10-08T19:25:51.486 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:51 smithi112 ceph-mon[40655]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2021-10-08T19:25:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:51 smithi142 ceph-mon[33432]: poll took 3171.307 ms: 1 events 2021-10-08T19:25:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:51 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi142 to 4037M 2021-10-08T19:25:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:51 smithi142 ceph-mon[33432]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2021-10-08T19:25:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 -- 172.21.15.112:0/2071589407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5c00f8fd0 msgr2=0x7fe5c00ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/2071589407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5c00f8fd0 0x7fe5c00ff890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009ab0 tx=0x7fe5b8004d00 comp rx=0 tx=0).stop 2021-10-08T19:25:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 -- 172.21.15.112:0/2071589407 shutdown_connections 2021-10-08T19:25:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/2071589407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5c00f8fd0 0x7fe5c00ff890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/2071589407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5c00f73a0 0x7fe5c00f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/2071589407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5c00f8640 0x7fe5c00f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 -- 172.21.15.112:0/2071589407 >> 172.21.15.112:0/2071589407 conn(0x7fe5c00f2af0 msgr2=0x7fe5c00f4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 -- 172.21.15.112:0/2071589407 shutdown_connections 2021-10-08T19:25:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 -- 172.21.15.112:0/2071589407 wait complete. 2021-10-08T19:25:52.554 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.548+0000 7fe5c49a6700 1 Processor -- start 2021-10-08T19:25:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5c49a6700 1 -- start start 2021-10-08T19:25:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5c49a6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5c00f73a0 0x7fe5c01085a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5c49a6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5c00f8640 0x7fe5c0108ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5c49a6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5c00f8fd0 0x7fe5c0109980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:52.555 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5c49a6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0109fa0 con 0x7fe5c00f73a0 2021-10-08T19:25:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5c49a6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c010a110 con 0x7fe5c00f8fd0 2021-10-08T19:25:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5c49a6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c010a2d0 con 0x7fe5c00f8640 2021-10-08T19:25:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5c00f73a0 0x7fe5c01085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5c00f73a0 0x7fe5c01085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33516/0 (socket says 172.21.15.112:33516) 2021-10-08T19:25:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 -- 172.21.15.112:0/1666446452 learned_addr learned my addr 172.21.15.112:0/1666446452 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:25:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5beffd700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5c00f8640 0x7fe5c0108ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:52.557 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bffff700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5c00f8fd0 0x7fe5c0109980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:52.558 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 -- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5c00f8640 msgr2=0x7fe5c0108ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.558 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5c00f8640 0x7fe5c0108ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.558 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 -- 172.21.15.112:0/1666446452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5c00f8fd0 msgr2=0x7fe5c0109980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.558 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5c00f8fd0 0x7fe5c0109980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.559 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 -- 172.21.15.112:0/1666446452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0005040 con 0x7fe5c00f73a0 2021-10-08T19:25:52.559 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.549+0000 7fe5bf7fe700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5c00f73a0 0x7fe5c01085a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e840 tx=0x7fe5b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:52.559 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.550+0000 7fe5a7fff700 1 -- 172.21.15.112:0/1666446452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40092e0 con 0x7fe5c00f73a0 2021-10-08T19:25:52.559 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.550+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b8009640 con 0x7fe5c00f73a0 2021-10-08T19:25:52.559 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.550+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c0110bd0 con 0x7fe5c00f73a0 2021-10-08T19:25:52.560 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.550+0000 7fe5a7fff700 1 -- 172.21.15.112:0/1666446452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fe5b400f040 con 0x7fe5c00f73a0 2021-10-08T19:25:52.560 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.550+0000 7fe5a7fff700 1 -- 172.21.15.112:0/1666446452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40144e0 con 0x7fe5c00f73a0 2021-10-08T19:25:52.562 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.551+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a0004de0 con 0x7fe5c00f73a0 2021-10-08T19:25:52.562 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.551+0000 7fe5a7fff700 1 -- 172.21.15.112:0/1666446452 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7fe5b401b030 con 0x7fe5c00f73a0 2021-10-08T19:25:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.551+0000 7fe5a7fff700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe5a8063440 0x7fe5a80658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:52.563 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.551+0000 7fe5a7fff700 1 -- 172.21.15.112:0/1666446452 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4950+0+0 (secure 0 0 0) 0x7fe5b407ef20 con 0x7fe5c00f73a0 2021-10-08T19:25:52.564 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.552+0000 7fe5beffd700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe5a8063440 0x7fe5a80658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:52.564 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.552+0000 7fe5beffd700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe5a8063440 0x7fe5a80658f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009050 tx=0x7fe5b000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:52.564 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.556+0000 7fe5a7fff700 1 -- 172.21.15.112:0/1666446452 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fe5b4048b00 con 0x7fe5c00f73a0 2021-10-08T19:25:52.745 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.743+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe5a0005090 con 0x7fe5c00f73a0 2021-10-08T19:25:52.745 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.744+0000 7fe5a7fff700 1 -- 172.21.15.112:0/1666446452 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v49) v1 ==== 74+0+130 (secure 0 0 0) 0x7fe5b40190a0 con 0x7fe5c00f73a0 2021-10-08T19:25:52.746 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:25:52.747 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.745+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe5a8063440 msgr2=0x7fe5a80658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.747 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.745+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe5a8063440 0x7fe5a80658f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009050 tx=0x7fe5b000b040 comp rx=0 tx=0).stop 2021-10-08T19:25:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.745+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5c00f73a0 msgr2=0x7fe5c01085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.745+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5c00f73a0 0x7fe5c01085a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e840 tx=0x7fe5b400b040 comp rx=0 tx=0).stop 2021-10-08T19:25:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.746+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 shutdown_connections 2021-10-08T19:25:52.748 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.746+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fe5a8063440 0x7fe5a80658f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.746+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5c00f8fd0 0x7fe5c0109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.746+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5c00f73a0 0x7fe5c01085a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.746+0000 7fe5c49a6700 1 --2- 172.21.15.112:0/1666446452 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5c00f8640 0x7fe5c0108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:52.749 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.746+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 >> 172.21.15.112:0/1666446452 conn(0x7fe5c00f2af0 msgr2=0x7fe5c00f4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:52.750 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.746+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 shutdown_connections 2021-10-08T19:25:52.750 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:52.746+0000 7fe5c49a6700 1 -- 172.21.15.112:0/1666446452 wait complete. 2021-10-08T19:25:53.415 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":49,"num_osds":8,"num_up_osds":7,"osd_up_since":1633721136,"num_in_osds":8,"osd_in_since":1633721139,"num_remapped_pgs":0} 2021-10-08T19:25:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:53 smithi142 ceph-mon[33432]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2021-10-08T19:25:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1666446452' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:53 smithi142 ceph-mon[33432]: from='osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:25:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:53 smithi142 ceph-mon[33432]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:25:53.524 INFO:journalctl@ceph.osd.7.smithi142.stdout:Oct 08 19:25:53 smithi142 conmon[52630]: 2021-10-08T19:25:53.026+0000 7fe065b900c0 -1 osd.7 0 log_to_monitors {default=true} 2021-10-08T19:25:53.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:53 smithi112 ceph-mon[31694]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2021-10-08T19:25:53.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1666446452' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:53.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:53 smithi112 ceph-mon[31694]: from='osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:25:53.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:53 smithi112 ceph-mon[31694]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:25:53.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:53 smithi112 ceph-mon[40655]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2021-10-08T19:25:53.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1666446452' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:53.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:53 smithi112 ceph-mon[40655]: from='osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:25:53.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:53 smithi112 ceph-mon[40655]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-10-08T19:25:54.261 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:25:53 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:25:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:54.417 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd stat -f json 2021-10-08T19:25:54.522 INFO:journalctl@ceph.osd.7.smithi142.stdout:Oct 08 19:25:54 smithi142 conmon[52630]: 2021-10-08T19:25:54.262+0000 7fe05c338700 -1 osd.7 0 waiting for initial osdmap 2021-10-08T19:25:54.523 INFO:journalctl@ceph.osd.7.smithi142.stdout:Oct 08 19:25:54 smithi142 conmon[52630]: 2021-10-08T19:25:54.269+0000 7fe056ccf700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-08T19:25:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:54 smithi142 ceph-mon[33432]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:25:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:54 smithi142 ceph-mon[33432]: osdmap e50: 8 total, 7 up, 8 in 2021-10-08T19:25:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:54 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:54 smithi142 ceph-mon[33432]: from='osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:54 smithi142 ceph-mon[33432]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:54 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[40655]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:25:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[40655]: osdmap e50: 8 total, 7 up, 8 in 2021-10-08T19:25:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[40655]: from='osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[40655]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[31694]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-10-08T19:25:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[31694]: osdmap e50: 8 total, 7 up, 8 in 2021-10-08T19:25:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[31694]: from='osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[31694]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2021-10-08T19:25:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:54 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:25:55.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:55 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:55 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:25:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:55 smithi142 ceph-mon[33432]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:55 smithi142 ceph-mon[33432]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:55 smithi142 ceph-mon[33432]: osdmap e51: 8 total, 7 up, 8 in 2021-10-08T19:25:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:55 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:55 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:55.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:55.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:25:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:55.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[40655]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[40655]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[40655]: osdmap e51: 8 total, 7 up, 8 in 2021-10-08T19:25:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:25:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:25:53] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:25:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[31694]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2021-10-08T19:25:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[31694]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2021-10-08T19:25:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[31694]: osdmap e51: 8 total, 7 up, 8 in 2021-10-08T19:25:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:55 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 -- 172.21.15.112:0/2914184488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f8ab0 msgr2=0x7f09e00f8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2914184488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f8ab0 0x7f09e00f8ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09d0004620 tx=0x7f09d0009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 -- 172.21.15.112:0/2914184488 shutdown_connections 2021-10-08T19:25:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2914184488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e00f7f40 0x7f09e00ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.150 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2914184488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f8ab0 0x7f09e00f8ec0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.151 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2914184488 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e00f9490 0x7f09e00f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.151 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 -- 172.21.15.112:0/2914184488 >> 172.21.15.112:0/2914184488 conn(0x7f09e00f2450 msgr2=0x7f09e00f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:56.151 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 -- 172.21.15.112:0/2914184488 shutdown_connections 2021-10-08T19:25:56.151 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 -- 172.21.15.112:0/2914184488 wait complete. 2021-10-08T19:25:56.151 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.146+0000 7f09e58f8700 1 Processor -- start 2021-10-08T19:25:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09e58f8700 1 -- start start 2021-10-08T19:25:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09e58f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f7f40 0x7f09e00f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09e58f8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e00f8ab0 0x7f09e010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09e58f8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e010db40 0x7f09e010ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09e58f8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0110690 con 0x7f09e00f7f40 2021-10-08T19:25:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09e58f8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0110800 con 0x7f09e00f8ab0 2021-10-08T19:25:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09e58f8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e01109c0 con 0x7f09e010db40 2021-10-08T19:25:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f7f40 0x7f09e00f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:56.153 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f7f40 0x7f09e00f7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33540/0 (socket says 172.21.15.112:33540) 2021-10-08T19:25:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09df7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e010db40 0x7f09e010ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 -- 172.21.15.112:0/2687862167 learned_addr learned my addr 172.21.15.112:0/2687862167 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:25:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09d67fc700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e00f8ab0 0x7f09e010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:56.154 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 -- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e010db40 msgr2=0x7f09e010ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:56.155 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e010db40 0x7f09e010ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.155 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 -- 172.21.15.112:0/2687862167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e00f8ab0 msgr2=0x7f09e010d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:56.155 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e00f8ab0 0x7f09e010d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.155 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 -- 172.21.15.112:0/2687862167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0005040 con 0x7f09e00f7f40 2021-10-08T19:25:56.155 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09df7fe700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e010db40 0x7f09e010ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:25:56.156 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09deffd700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f7f40 0x7f09e00f7210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f09d0005010 tx=0x7f09d0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:56.156 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.147+0000 7f09d7fff700 1 -- 172.21.15.112:0/2687862167 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000e070 con 0x7f09e00f7f40 2021-10-08T19:25:56.156 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.148+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e0110c40 con 0x7f09e00f7f40 2021-10-08T19:25:56.156 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.148+0000 7f09d7fff700 1 -- 172.21.15.112:0/2687862167 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f09d0007920 con 0x7f09e00f7f40 2021-10-08T19:25:56.157 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.148+0000 7f09d7fff700 1 -- 172.21.15.112:0/2687862167 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d001a070 con 0x7f09e00f7f40 2021-10-08T19:25:56.157 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.148+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e01110a0 con 0x7f09e00f7f40 2021-10-08T19:25:56.158 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.149+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e00289c0 con 0x7f09e00f7f40 2021-10-08T19:25:56.158 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.149+0000 7f09d7fff700 1 -- 172.21.15.112:0/2687862167 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7f09d0025020 con 0x7f09e00f7f40 2021-10-08T19:25:56.158 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.149+0000 7f09d7fff700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f09cc0634f0 0x7f09cc0659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:56.159 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.149+0000 7f09d7fff700 1 -- 172.21.15.112:0/2687862167 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5300+0+0 (secure 0 0 0) 0x7f09d00801a0 con 0x7f09e00f7f40 2021-10-08T19:25:56.159 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.149+0000 7f09d67fc700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f09cc0634f0 0x7f09cc0659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:56.159 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.150+0000 7f09d67fc700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f09cc0634f0 0x7f09cc0659a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009880 tx=0x7f09c800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:56.159 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.153+0000 7f09d7fff700 1 -- 172.21.15.112:0/2687862167 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f09d004f6f0 con 0x7f09e00f7f40 2021-10-08T19:25:56.323 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.320+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f09e00f9490 con 0x7f09e00f7f40 2021-10-08T19:25:56.378 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.320+0000 7f09d7fff700 1 -- 172.21.15.112:0/2687862167 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v53) v1 ==== 74+0+130 (secure 0 0 0) 0x7f09d0052d10 con 0x7f09e00f7f40 2021-10-08T19:25:56.379 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:25:56.380 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f09cc0634f0 msgr2=0x7f09cc0659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:56.380 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f09cc0634f0 0x7f09cc0659a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009880 tx=0x7f09c800b040 comp rx=0 tx=0).stop 2021-10-08T19:25:56.380 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f7f40 msgr2=0x7f09e00f7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:56.380 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f7f40 0x7f09e00f7210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f09d0005010 tx=0x7f09d0009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:56.380 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 shutdown_connections 2021-10-08T19:25:56.381 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f09cc0634f0 0x7f09cc0659a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.381 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e010db40 0x7f09e010ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.381 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e00f7f40 0x7f09e00f7210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.382 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 --2- 172.21.15.112:0/2687862167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e00f8ab0 0x7f09e010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:56.382 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 >> 172.21.15.112:0/2687862167 conn(0x7f09e00f2450 msgr2=0x7f09e00fba90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:56.382 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 shutdown_connections 2021-10-08T19:25:56.382 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:25:56.322+0000 7f09e58f8700 1 -- 172.21.15.112:0/2687862167 wait complete. 2021-10-08T19:25:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:56 smithi142 ceph-mon[33432]: purged_snaps scrub starts 2021-10-08T19:25:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:56 smithi142 ceph-mon[33432]: purged_snaps scrub ok 2021-10-08T19:25:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:56 smithi142 ceph-mon[33432]: osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] boot 2021-10-08T19:25:56.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:56 smithi142 ceph-mon[33432]: osdmap e52: 8 total, 8 up, 8 in 2021-10-08T19:25:56.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:56 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:56.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[31694]: purged_snaps scrub starts 2021-10-08T19:25:56.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[31694]: purged_snaps scrub ok 2021-10-08T19:25:56.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[31694]: osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] boot 2021-10-08T19:25:56.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[31694]: osdmap e52: 8 total, 8 up, 8 in 2021-10-08T19:25:56.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[40655]: purged_snaps scrub starts 2021-10-08T19:25:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[40655]: purged_snaps scrub ok 2021-10-08T19:25:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[40655]: osd.7 [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] boot 2021-10-08T19:25:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[40655]: osdmap e52: 8 total, 8 up, 8 in 2021-10-08T19:25:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:56 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:25:57.028 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1633721155,"num_in_osds":8,"osd_in_since":1633721139,"num_remapped_pgs":1} 2021-10-08T19:25:57.029 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi112 2021-10-08T19:25:57.030 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch apply rgw foo.a --placement '1;smithi112=foo.a' 2021-10-08T19:25:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:57 smithi142 ceph-mon[33432]: pgmap v166: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:57 smithi142 ceph-mon[33432]: osdmap e53: 8 total, 8 up, 8 in 2021-10-08T19:25:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2687862167' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:57 smithi142 ceph-mon[33432]: osdmap e54: 8 total, 8 up, 8 in 2021-10-08T19:25:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:57 smithi112 ceph-mon[31694]: pgmap v166: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:57 smithi112 ceph-mon[31694]: osdmap e53: 8 total, 8 up, 8 in 2021-10-08T19:25:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2687862167' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:57 smithi112 ceph-mon[31694]: osdmap e54: 8 total, 8 up, 8 in 2021-10-08T19:25:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:57 smithi112 ceph-mon[40655]: pgmap v166: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:57 smithi112 ceph-mon[40655]: osdmap e53: 8 total, 8 up, 8 in 2021-10-08T19:25:57.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2687862167' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2021-10-08T19:25:57.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:57 smithi112 ceph-mon[40655]: osdmap e54: 8 total, 8 up, 8 in 2021-10-08T19:25:59.424 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.420+0000 7f4c4be0b700 1 -- 172.21.15.142:0/2749517047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f7260 msgr2=0x7f4c440f99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:59.424 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.420+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/2749517047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f7260 0x7f4c440f99a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4c340046e0 tx=0x7f4c34009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:59.424 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.420+0000 7f4c4be0b700 1 -- 172.21.15.142:0/2749517047 shutdown_connections 2021-10-08T19:25:59.425 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.420+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/2749517047 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c440fa010 0x7f4c44100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.425 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.420+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/2749517047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c440f6880 0x7f4c440f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.426 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.420+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/2749517047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f7260 0x7f4c440f99a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.426 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.420+0000 7f4c4be0b700 1 -- 172.21.15.142:0/2749517047 >> 172.21.15.142:0/2749517047 conn(0x7f4c440f2450 msgr2=0x7f4c440f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:59.426 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 -- 172.21.15.142:0/2749517047 shutdown_connections 2021-10-08T19:25:59.426 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 -- 172.21.15.142:0/2749517047 wait complete. 2021-10-08T19:25:59.427 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 Processor -- start 2021-10-08T19:25:59.427 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 -- start start 2021-10-08T19:25:59.429 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f6880 0x7f4c440f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:59.429 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c440f7260 0x7f4c440f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:59.429 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c440fa010 0x7f4c440f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:59.429 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440f8500 con 0x7f4c440fa010 2021-10-08T19:25:59.430 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440f8670 con 0x7f4c440f6880 2021-10-08T19:25:59.430 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4be0b700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c441127c0 con 0x7f4c440f7260 2021-10-08T19:25:59.430 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c49ba7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f6880 0x7f4c440f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:59.430 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c49ba7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f6880 0x7f4c440f9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59522/0 (socket says 172.21.15.142:59522) 2021-10-08T19:25:59.430 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c49ba7700 1 -- 172.21.15.142:0/4058602503 learned_addr learned my addr 172.21.15.142:0/4058602503 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:25:59.431 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c4a3a8700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c440fa010 0x7f4c440f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:59.431 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.421+0000 7f4c493a6700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c440f7260 0x7f4c440f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:59.431 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c49ba7700 1 -- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c440f7260 msgr2=0x7f4c440f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:59.431 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c49ba7700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c440f7260 0x7f4c440f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.431 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c49ba7700 1 -- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c440fa010 msgr2=0x7f4c440f7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:59.432 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c49ba7700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c440fa010 0x7f4c440f7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.432 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c49ba7700 1 -- 172.21.15.142:0/4058602503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34005040 con 0x7f4c440f6880 2021-10-08T19:25:59.432 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c49ba7700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f6880 0x7f4c440f9250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c810 tx=0x7f4c40007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:59.432 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c3a7fc700 1 -- 172.21.15.142:0/4058602503 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000f540 con 0x7f4c440f6880 2021-10-08T19:25:59.433 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c441129c0 con 0x7f4c440f6880 2021-10-08T19:25:59.433 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c3a7fc700 1 -- 172.21.15.142:0/4058602503 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f4c40007e00 con 0x7f4c440f6880 2021-10-08T19:25:59.433 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c3a7fc700 1 -- 172.21.15.142:0/4058602503 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40012880 con 0x7f4c440f6880 2021-10-08T19:25:59.433 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.422+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c44112f30 con 0x7f4c440f6880 2021-10-08T19:25:59.434 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.424+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c440289c0 con 0x7f4c440f6880 2021-10-08T19:25:59.435 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.424+0000 7f4c3a7fc700 1 -- 172.21.15.142:0/4058602503 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7f4c40019030 con 0x7f4c440f6880 2021-10-08T19:25:59.435 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.424+0000 7f4c3a7fc700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f4c300634f0 0x7f4c300659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:25:59.435 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.424+0000 7f4c3a7fc700 1 -- 172.21.15.142:0/4058602503 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5267+0+0 (secure 0 0 0) 0x7f4c4007ece0 con 0x7f4c440f6880 2021-10-08T19:25:59.435 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.424+0000 7f4c493a6700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f4c300634f0 0x7f4c300659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:25:59.435 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.425+0000 7f4c493a6700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f4c300634f0 0x7f4c300659a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009da0 tx=0x7f4c34009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:25:59.436 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.429+0000 7f4c3a7fc700 1 -- 172.21.15.142:0/4058602503 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f4c4004e1b0 con 0x7f4c440f6880 2021-10-08T19:25:59.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:59 smithi142 ceph-mon[33432]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:25:59 smithi142 ceph-mon[33432]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:25:59.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:59 smithi112 ceph-mon[31694]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:59.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:25:59 smithi112 ceph-mon[31694]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:25:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:59 smithi112 ceph-mon[40655]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:25:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:25:59 smithi112 ceph-mon[40655]: osdmap e55: 8 total, 8 up, 8 in 2021-10-08T19:25:59.621 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.619+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi112=foo.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c44059800 con 0x7f4c300634f0 2021-10-08T19:25:59.627 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.626+0000 7f4c3a7fc700 1 -- 172.21.15.142:0/4058602503 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7f4c44059800 con 0x7f4c300634f0 2021-10-08T19:25:59.627 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled rgw.foo.a update... 2021-10-08T19:25:59.629 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f4c300634f0 msgr2=0x7f4c300659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:59.629 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f4c300634f0 0x7f4c300659a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009da0 tx=0x7f4c34009b30 comp rx=0 tx=0).stop 2021-10-08T19:25:59.630 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f6880 msgr2=0x7f4c440f9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:25:59.630 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f6880 0x7f4c440f9250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c810 tx=0x7f4c40007d90 comp rx=0 tx=0).stop 2021-10-08T19:25:59.630 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 shutdown_connections 2021-10-08T19:25:59.630 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f4c300634f0 0x7f4c300659a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.631 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c440fa010 0x7f4c440f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.631 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c440f6880 0x7f4c440f9250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.631 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 --2- 172.21.15.142:0/4058602503 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c440f7260 0x7f4c440f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:25:59.631 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 >> 172.21.15.142:0/4058602503 conn(0x7f4c440f2450 msgr2=0x7f4c440f46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:25:59.631 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 shutdown_connections 2021-10-08T19:25:59.632 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:25:59.628+0000 7f4c4be0b700 1 -- 172.21.15.142:0/4058602503 wait complete. 2021-10-08T19:26:00.481 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:26:00.481 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi112=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:00.481 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: Saving service rgw.foo.a spec with placement smithi112=foo.a;count:1 2021-10-08T19:26:00.482 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.482 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:00.482 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:00.482 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:00.483 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.483 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: Saving service rgw.foo.a spec with placement smithi112=foo.a;count:1 2021-10-08T19:26:00.483 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.483 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:26:00.483 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:26:00.484 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.484 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:00.484 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: Deploying daemon rgw.foo.a on smithi112 2021-10-08T19:26:00.484 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[40655]: poll took 9814.825 ms: 1 events 2021-10-08T19:26:00.485 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:26:00.485 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi112=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:00.485 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: Saving service rgw.foo.a spec with placement smithi112=foo.a;count:1 2021-10-08T19:26:00.485 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.486 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:00.486 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:00.487 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:00.487 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.487 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: Saving service rgw.foo.a spec with placement smithi112=foo.a;count:1 2021-10-08T19:26:00.488 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.488 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:26:00.488 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:26:00.488 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.489 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:00.489 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: Deploying daemon rgw.foo.a on smithi112 2021-10-08T19:26:00.489 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:00 smithi112 ceph-mon[31694]: poll took 9814.825 ms: 1 events 2021-10-08T19:26:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: osdmap e56: 8 total, 8 up, 8 in 2021-10-08T19:26:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi112=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: Saving service rgw.foo.a spec with placement smithi112=foo.a;count:1 2021-10-08T19:26:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: Saving service rgw.foo.a spec with placement smithi112=foo.a;count:1 2021-10-08T19:26:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-10-08T19:26:00.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-10-08T19:26:00.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:00.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:00.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: Deploying daemon rgw.foo.a on smithi112 2021-10-08T19:26:00.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:00 smithi142 ceph-mon[33432]: poll took 9814.825 ms: 1 events 2021-10-08T19:26:00.531 DEBUG:teuthology.orchestra.run.smithi112:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@rgw.foo.a.service 2021-10-08T19:26:00.534 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi142 2021-10-08T19:26:00.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd pool create iscsi 3 3 replicated 2021-10-08T19:26:00.560 INFO:journalctl@ceph.rgw.foo.a.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:26:01.571 INFO:journalctl@ceph.rgw.foo.a.smithi112.stdout:Oct 08 19:26:01 smithi112 systemd[1]: Starting Ceph rgw.foo.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:26:01.931 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:01 smithi112 ceph-mon[31694]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:01.932 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:01 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:26:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:01.932 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:01 smithi112 ceph-mon[40655]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:02.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:01 smithi142 ceph-mon[33432]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:02.310 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 -- 172.21.15.142:0/675383799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8650 msgr2=0x7fdd140f8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:02.311 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/675383799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8650 0x7fdd140f8aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdd040046e0 tx=0x7fdd04009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:02.311 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 -- 172.21.15.142:0/675383799 shutdown_connections 2021-10-08T19:26:02.311 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/675383799 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd140f8fe0 0x7fdd140ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.311 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/675383799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd140f73b0 0x7fdd140f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.312 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/675383799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8650 0x7fdd140f8aa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.312 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 -- 172.21.15.142:0/675383799 >> 172.21.15.142:0/675383799 conn(0x7fdd140f2b20 msgr2=0x7fdd140f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:02.312 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 -- 172.21.15.142:0/675383799 shutdown_connections 2021-10-08T19:26:02.312 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.307+0000 7fdd18ee8700 1 -- 172.21.15.142:0/675383799 wait complete. 2021-10-08T19:26:02.312 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd18ee8700 1 Processor -- start 2021-10-08T19:26:02.313 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd18ee8700 1 -- start start 2021-10-08T19:26:02.313 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd18ee8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd140f73b0 0x7fdd1410b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:02.313 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd18ee8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd140f8650 0x7fdd1410d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:02.313 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd18ee8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8fe0 0x7fdd1410ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:02.314 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd18ee8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14110460 con 0x7fdd140f8650 2021-10-08T19:26:02.314 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd18ee8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd141105a0 con 0x7fdd140f8fe0 2021-10-08T19:26:02.314 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd18ee8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14110710 con 0x7fdd140f73b0 2021-10-08T19:26:02.314 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd137fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd140f73b0 0x7fdd1410b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:02.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd13fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8fe0 0x7fdd1410ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:02.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd137fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd140f73b0 0x7fdd1410b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.142:48140/0 (socket says 172.21.15.142:48140) 2021-10-08T19:26:02.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd137fe700 1 -- 172.21.15.142:0/1009802760 learned_addr learned my addr 172.21.15.142:0/1009802760 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:26:02.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd12ffd700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd140f8650 0x7fdd1410d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:02.315 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.308+0000 7fdd13fff700 1 -- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd140f73b0 msgr2=0x7fdd1410b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:02.316 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdd13fff700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd140f73b0 0x7fdd1410b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.316 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdd13fff700 1 -- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd140f8650 msgr2=0x7fdd1410d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:02.316 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdd13fff700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd140f8650 0x7fdd1410d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.316 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdd13fff700 1 -- 172.21.15.142:0/1009802760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04005040 con 0x7fdd140f8fe0 2021-10-08T19:26:02.316 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdd137fe700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd140f73b0 0x7fdd1410b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:02.317 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdd13fff700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8fe0 0x7fdd1410ff20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e960 tx=0x7fdd0c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:02.317 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdcf7fff700 1 -- 172.21.15.142:0/1009802760 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0092e0 con 0x7fdd140f8fe0 2021-10-08T19:26:02.318 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdcf7fff700 1 -- 172.21.15.142:0/1009802760 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fdd0c00f040 con 0x7fdd140f8fe0 2021-10-08T19:26:02.318 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd141109f0 con 0x7fdd140f8fe0 2021-10-08T19:26:02.318 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdcf7fff700 1 -- 172.21.15.142:0/1009802760 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c007d70 con 0x7fdd140f8fe0 2021-10-08T19:26:02.318 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.309+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd14110f10 con 0x7fdd140f8fe0 2021-10-08T19:26:02.319 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.310+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd140472f0 con 0x7fdd140f8fe0 2021-10-08T19:26:02.320 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.311+0000 7fdcf7fff700 1 -- 172.21.15.142:0/1009802760 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7fdd0c01a020 con 0x7fdd140f8fe0 2021-10-08T19:26:02.320 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.311+0000 7fdcf7fff700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fdcfc063440 0x7fdcfc0658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:02.320 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.311+0000 7fdcf7fff700 1 -- 172.21.15.142:0/1009802760 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5267+0+0 (secure 0 0 0) 0x7fdd0c07f240 con 0x7fdd140f8fe0 2021-10-08T19:26:02.321 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.312+0000 7fdd137fe700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fdcfc063440 0x7fdcfc0658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:02.321 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.312+0000 7fdd137fe700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fdcfc063440 0x7fdcfc0658f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd14062250 tx=0x7fdd0800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:02.321 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.315+0000 7fdcf7fff700 1 -- 172.21.15.142:0/1009802760 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fdd0c048b00 con 0x7fdd140f8fe0 2021-10-08T19:26:02.322 INFO:journalctl@ceph.rgw.foo.a.smithi112.stdout:Oct 08 19:26:01 smithi112 bash[61900]: db839bb11d6e837434a9410bab70022d0205ecaaf22bd971e9e6196390047b31 2021-10-08T19:26:02.322 INFO:journalctl@ceph.rgw.foo.a.smithi112.stdout:Oct 08 19:26:01 smithi112 systemd[1]: Started Ceph rgw.foo.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:26:02.479 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.477+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7fdd140289c0 con 0x7fdd140f8fe0 2021-10-08T19:26:02.873 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.872+0000 7fdcf7fff700 1 -- 172.21.15.142:0/1009802760 <== mon.2 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'iscsi' created v57) v1 ==== 154+0+0 (secure 0 0 0) 0x7fdd0c052080 con 0x7fdd140f8fe0 2021-10-08T19:26:02.876 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fdcfc063440 msgr2=0x7fdcfc0658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:02.876 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fdcfc063440 0x7fdcfc0658f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd14062250 tx=0x7fdd0800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:02.876 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8fe0 msgr2=0x7fdd1410ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:02.877 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8fe0 0x7fdd1410ff20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e960 tx=0x7fdd0c00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:02.877 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 shutdown_connections 2021-10-08T19:26:02.877 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7fdcfc063440 0x7fdcfc0658f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.877 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd140f8fe0 0x7fdd1410ff20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.878 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd140f73b0 0x7fdd1410b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.878 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 --2- 172.21.15.142:0/1009802760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd140f8650 0x7fdd1410d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:02.878 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 >> 172.21.15.142:0/1009802760 conn(0x7fdd140f2b20 msgr2=0x7fdd140fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:02.878 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 shutdown_connections 2021-10-08T19:26:02.878 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:02.875+0000 7fdd18ee8700 1 -- 172.21.15.142:0/1009802760 wait complete. 2021-10-08T19:26:02.879 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'iscsi' created 2021-10-08T19:26:03.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:02 smithi142 ceph-mon[33432]: poll took 1037.304 ms: 1 events 2021-10-08T19:26:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:02 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:02 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:02 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:02 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:03.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:02 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:03.057 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[40655]: poll took 1037.304 ms: 1 events 2021-10-08T19:26:03.058 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:03.058 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:03.058 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:03.058 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:03.059 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:03.059 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[31694]: poll took 1037.304 ms: 1 events 2021-10-08T19:26:03.059 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:03.059 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:03.062 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:03.062 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:03.062 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:02 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:03.556 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd pool application enable iscsi rbd 2021-10-08T19:26:03.825 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: Detected new or changed devices on smithi142 2021-10-08T19:26:03.826 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:26:03.826 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:26:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:03.826 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:26:03.827 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: Sending message to agent on host smithi112 2021-10-08T19:26:03.827 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: Checking dashboard <-> RGW credentials 2021-10-08T19:26:03.827 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/1009802760' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:26:03.827 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:26:03.828 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:03.828 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:26:03.828 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:26:03.828 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1572381675' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:03.828 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:03.829 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: Detected new or changed devices on smithi142 2021-10-08T19:26:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:26:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:26:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:26:04.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: Sending message to agent on host smithi112 2021-10-08T19:26:04.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: Checking dashboard <-> RGW credentials 2021-10-08T19:26:04.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/1009802760' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:26:04.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:26:04.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:04.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:26:04.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:26:04.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1572381675' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:04.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:04.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:04.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: Detected new or changed devices on smithi142 2021-10-08T19:26:04.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:26:04.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:26:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:04.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s, 0 objects/s recovering 2021-10-08T19:26:04.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: Sending message to agent on host smithi112 2021-10-08T19:26:04.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: Checking dashboard <-> RGW credentials 2021-10-08T19:26:04.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/1009802760' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:26:04.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-10-08T19:26:04.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:04.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-10-08T19:26:04.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: osdmap e57: 8 total, 8 up, 8 in 2021-10-08T19:26:04.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1572381675' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:04.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:04.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-10-08T19:26:05.224 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1572381675' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:26:05.224 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:26:05.225 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:04 smithi142 ceph-mon[33432]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:26:05.225 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:04 smithi142 ceph-mon[33432]: pgmap v176: 36 pgs: 10 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:26:05.320 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1572381675' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:26:05.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:26:05.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:04 smithi112 ceph-mon[40655]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:26:05.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:04 smithi112 ceph-mon[40655]: pgmap v176: 36 pgs: 10 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:26:05.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1572381675' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:26:05.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-10-08T19:26:05.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:04 smithi112 ceph-mon[31694]: osdmap e58: 8 total, 8 up, 8 in 2021-10-08T19:26:05.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:04 smithi112 ceph-mon[31694]: pgmap v176: 36 pgs: 10 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2021-10-08T19:26:05.455 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 -- 172.21.15.142:0/1744258255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f8690 msgr2=0x7efe680f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:05.455 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/1744258255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f8690 0x7efe680f8ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0046e0 tx=0x7efe5c009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:05.456 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 -- 172.21.15.142:0/1744258255 shutdown_connections 2021-10-08T19:26:05.456 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/1744258255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe680f9020 0x7efe680ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.456 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/1744258255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe680f73f0 0x7efe680f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.456 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/1744258255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f8690 0x7efe680f8ae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.457 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 -- 172.21.15.142:0/1744258255 >> 172.21.15.142:0/1744258255 conn(0x7efe680f2b20 msgr2=0x7efe680f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:05.457 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 -- 172.21.15.142:0/1744258255 shutdown_connections 2021-10-08T19:26:05.457 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.454+0000 7efe6d6a1700 1 -- 172.21.15.142:0/1744258255 wait complete. 2021-10-08T19:26:05.460 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe6d6a1700 1 Processor -- start 2021-10-08T19:26:05.460 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe6d6a1700 1 -- start start 2021-10-08T19:26:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe6d6a1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f73f0 0x7efe6810d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe6d6a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe680f8690 0x7efe6810fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe6d6a1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe680f9020 0x7efe68112320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe6d6a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe68062290 con 0x7efe680f8690 2021-10-08T19:26:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe6d6a1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe68112860 con 0x7efe680f73f0 2021-10-08T19:26:05.462 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe6d6a1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe681129a0 con 0x7efe680f9020 2021-10-08T19:26:05.462 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe66ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f73f0 0x7efe6810d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:05.462 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe66ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f73f0 0x7efe6810d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59550/0 (socket says 172.21.15.142:59550) 2021-10-08T19:26:05.462 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe66ffd700 1 -- 172.21.15.142:0/2683089226 learned_addr learned my addr 172.21.15.142:0/2683089226 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:26:05.463 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe667fc700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe680f8690 0x7efe6810fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:05.463 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe677fe700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe680f9020 0x7efe68112320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:05.463 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe66ffd700 1 -- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe680f9020 msgr2=0x7efe68112320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:05.463 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe66ffd700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe680f9020 0x7efe68112320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.463 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe66ffd700 1 -- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe680f8690 msgr2=0x7efe6810fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:05.464 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe66ffd700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe680f8690 0x7efe6810fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.464 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe66ffd700 1 -- 172.21.15.142:0/2683089226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c005040 con 0x7efe680f73f0 2021-10-08T19:26:05.464 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.455+0000 7efe677fe700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe680f9020 0x7efe68112320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:26:05.464 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.456+0000 7efe66ffd700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f73f0 0x7efe6810d880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe5800c840 tx=0x7efe58007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.456+0000 7efe4b7fe700 1 -- 172.21.15.142:0/2683089226 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5800e570 con 0x7efe680f73f0 2021-10-08T19:26:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.456+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe68112c00 con 0x7efe680f73f0 2021-10-08T19:26:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.456+0000 7efe4b7fe700 1 -- 172.21.15.142:0/2683089226 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7efe5800eb20 con 0x7efe680f73f0 2021-10-08T19:26:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.456+0000 7efe4b7fe700 1 -- 172.21.15.142:0/2683089226 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580129a0 con 0x7efe680f73f0 2021-10-08T19:26:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.456+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe68113140 con 0x7efe680f73f0 2021-10-08T19:26:05.466 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.457+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe680472f0 con 0x7efe680f73f0 2021-10-08T19:26:05.466 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.457+0000 7efe4b7fe700 1 -- 172.21.15.142:0/2683089226 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7efe58019030 con 0x7efe680f73f0 2021-10-08T19:26:05.466 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.458+0000 7efe4b7fe700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7efe50063440 0x7efe500658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:05.466 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.458+0000 7efe4b7fe700 1 -- 172.21.15.142:0/2683089226 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efe5807f230 con 0x7efe680f73f0 2021-10-08T19:26:05.467 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.458+0000 7efe667fc700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7efe50063440 0x7efe500658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:05.467 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.458+0000 7efe667fc700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7efe50063440 0x7efe500658f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0041d0 tx=0x7efe5c009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:05.467 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.461+0000 7efe4b7fe700 1 -- 172.21.15.142:0/2683089226 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7efe58046b00 con 0x7efe680f73f0 2021-10-08T19:26:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.637+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"} v 0) v1 -- 0x7efe681020c0 con 0x7efe680f73f0 2021-10-08T19:26:05.881 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.880+0000 7efe4b7fe700 1 -- 172.21.15.142:0/2683089226 <== mon.2 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]=0 enabled application 'rbd' on pool 'iscsi' v60) v1 ==== 147+0+0 (secure 0 0 0) 0x7efe580170b0 con 0x7efe680f73f0 2021-10-08T19:26:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7efe50063440 msgr2=0x7efe500658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7efe50063440 0x7efe500658f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0041d0 tx=0x7efe5c009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:05.885 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f73f0 msgr2=0x7efe6810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:05.885 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f73f0 0x7efe6810d880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe5800c840 tx=0x7efe58007d90 comp rx=0 tx=0).stop 2021-10-08T19:26:05.885 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 shutdown_connections 2021-10-08T19:26:05.885 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7efe50063440 0x7efe500658f0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0041d0 tx=0x7efe5c009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:05.886 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efe680f9020 0x7efe68112320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.886 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe680f73f0 0x7efe6810d880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.886 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 --2- 172.21.15.142:0/2683089226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe680f8690 0x7efe6810fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:05.886 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 >> 172.21.15.142:0/2683089226 conn(0x7efe680f2b20 msgr2=0x7efe680fb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:05.887 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 shutdown_connections 2021-10-08T19:26:05.887 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:05.883+0000 7efe6d6a1700 1 -- 172.21.15.142:0/2683089226 wait complete. 2021-10-08T19:26:05.887 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rbd' on pool 'iscsi' 2021-10-08T19:26:06.229 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:05 smithi142 ceph-mon[33432]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:26:06.229 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.230 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2635033087' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.230 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.230 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:05 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.231 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/2683089226' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:26:06.231 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:26:06.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[31694]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:26:06.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2635033087' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/2683089226' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:26:06.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:26:06.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[40655]: osdmap e59: 8 total, 8 up, 8 in 2021-10-08T19:26:06.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2635033087' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2021-10-08T19:26:06.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/2683089226' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:26:06.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-10-08T19:26:06.584 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch apply iscsi iscsi user password --placement '1;smithi142=iscsi.a' 2021-10-08T19:26:07.156 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:26:07.156 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:26:07.157 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:26:07.157 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:26:07.157 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: pgmap v179: 68 pgs: 17 active+clean, 20 creating+peering, 31 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:26:07.158 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:07.158 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:26:07.158 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.159 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.159 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2635033087' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.159 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:06 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:26:07.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:26:07.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:26:07.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:26:07.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: pgmap v179: 68 pgs: 17 active+clean, 20 creating+peering, 31 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:26:07.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:07.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:26:07.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2635033087' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:26:07.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2021-10-08T19:26:07.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-10-08T19:26:07.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: osdmap e60: 8 total, 8 up, 8 in 2021-10-08T19:26:07.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: pgmap v179: 68 pgs: 17 active+clean, 20 creating+peering, 31 unknown; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:26:07.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:07.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: osdmap e61: 8 total, 8 up, 8 in 2021-10-08T19:26:07.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2659350041' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2635033087' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:06 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2021-10-08T19:26:07.820 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:07 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:26:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.345+0000 7f0753ca9700 1 -- 172.21.15.142:0/3191045792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 msgr2=0x7f074c0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.349 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.345+0000 7f0753ca9700 1 --2- 172.21.15.142:0/3191045792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 0x7f074c0ff9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0744009a60 tx=0x7f0744004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 -- 172.21.15.142:0/3191045792 shutdown_connections 2021-10-08T19:26:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 --2- 172.21.15.142:0/3191045792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 0x7f074c0ff9a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 --2- 172.21.15.142:0/3191045792 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f074c0f74b0 0x7f074c0f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.350 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 --2- 172.21.15.142:0/3191045792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074c0f8750 0x7f074c0f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.351 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 -- 172.21.15.142:0/3191045792 >> 172.21.15.142:0/3191045792 conn(0x7f074c0f2ca0 msgr2=0x7f074c0f50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:08.351 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 -- 172.21.15.142:0/3191045792 shutdown_connections 2021-10-08T19:26:08.351 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 -- 172.21.15.142:0/3191045792 wait complete. 2021-10-08T19:26:08.351 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 Processor -- start 2021-10-08T19:26:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 -- start start 2021-10-08T19:26:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074c0f74b0 0x7f074c061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f074c0f8750 0x7f074c10d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:08.352 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 0x7f074c10f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c10ffa0 con 0x7f074c0f74b0 2021-10-08T19:26:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c110110 con 0x7f074c0f90e0 2021-10-08T19:26:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0753ca9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c1102d0 con 0x7f074c0f8750 2021-10-08T19:26:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0752246700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 0x7f074c10f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:08.353 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0752246700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 0x7f074c10f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59568/0 (socket says 172.21.15.142:59568) 2021-10-08T19:26:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0752246700 1 -- 172.21.15.142:0/1149530315 learned_addr learned my addr 172.21.15.142:0/1149530315 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:26:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0751a45700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074c0f74b0 0x7f074c061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.346+0000 7f0751244700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f074c0f8750 0x7f074c10d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:08.354 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f0752246700 1 -- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f074c0f8750 msgr2=0x7f074c10d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.355 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f0752246700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f074c0f8750 0x7f074c10d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.355 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f0752246700 1 -- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074c0f74b0 msgr2=0x7f074c061f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.355 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f0752246700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074c0f74b0 0x7f074c061f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.355 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f0752246700 1 -- 172.21.15.142:0/1149530315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009640 con 0x7f074c0f90e0 2021-10-08T19:26:08.356 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f0752246700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 0x7f074c10f890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0744009fd0 tx=0x7f0744004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:08.356 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f07427fc700 1 -- 172.21.15.142:0/1149530315 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400e070 con 0x7f074c0f90e0 2021-10-08T19:26:08.356 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f07427fc700 1 -- 172.21.15.142:0/1149530315 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f0744009450 con 0x7f074c0f90e0 2021-10-08T19:26:08.356 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c110550 con 0x7f074c0f90e0 2021-10-08T19:26:08.356 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f07427fc700 1 -- 172.21.15.142:0/1149530315 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744012e70 con 0x7f074c0f90e0 2021-10-08T19:26:08.357 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.347+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c110a30 con 0x7f074c0f90e0 2021-10-08T19:26:08.357 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.348+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c0289c0 con 0x7f074c0f90e0 2021-10-08T19:26:08.357 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.348+0000 7f07427fc700 1 -- 172.21.15.142:0/1149530315 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7f0744012620 con 0x7f074c0f90e0 2021-10-08T19:26:08.358 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.349+0000 7f07427fc700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f07380634f0 0x7f07380659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:08.359 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.349+0000 7f07427fc700 1 -- 172.21.15.142:0/1149530315 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f0744081b90 con 0x7f074c0f90e0 2021-10-08T19:26:08.359 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.349+0000 7f0751a45700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f07380634f0 0x7f07380659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:08.359 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.349+0000 7f0751a45700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f07380634f0 0x7f07380659a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0748009fd0 tx=0x7f074800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:08.359 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.353+0000 7f07427fc700 1 -- 172.21.15.142:0/1149530315 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f0744050be0 con 0x7f074c0f90e0 2021-10-08T19:26:08.523 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.522+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi142=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f074c059800 con 0x7f07380634f0 2021-10-08T19:26:08.528 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.527+0000 7f07427fc700 1 -- 172.21.15.142:0/1149530315 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f074c059800 con 0x7f07380634f0 2021-10-08T19:26:08.529 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled iscsi.iscsi update... 2021-10-08T19:26:08.530 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f07380634f0 msgr2=0x7f07380659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.531 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f07380634f0 0x7f07380659a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0748009fd0 tx=0x7f074800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:08.531 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 msgr2=0x7f074c10f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:08.531 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 0x7f074c10f890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0744009fd0 tx=0x7f0744004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:08.531 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 shutdown_connections 2021-10-08T19:26:08.532 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f07380634f0 0x7f07380659a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.532 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f074c0f90e0 0x7f074c10f890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.532 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074c0f74b0 0x7f074c061f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.532 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 --2- 172.21.15.142:0/1149530315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f074c0f8750 0x7f074c10d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:08.532 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 >> 172.21.15.142:0/1149530315 conn(0x7f074c0f2ca0 msgr2=0x7f074c0f4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:08.533 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 shutdown_connections 2021-10-08T19:26:08.533 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:08.529+0000 7f0753ca9700 1 -- 172.21.15.142:0/1149530315 wait complete. 2021-10-08T19:26:08.718 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:08 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:08.718 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:08 smithi142 ceph-mon[33432]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:08.719 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:08 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:26:08.719 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:08 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:26:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:08.719 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:26:08.720 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:08 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:26:08.720 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:08 smithi142 ceph-mon[33432]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:26:08.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:08.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[40655]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:08.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:26:08.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:26:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:08.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:26:08.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:26:08.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[40655]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:26:08.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:08.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:08.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:26:08.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:26:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:08.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:26:08.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2021-10-08T19:26:08.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:08 smithi112 ceph-mon[31694]: osdmap e62: 8 total, 8 up, 8 in 2021-10-08T19:26:09.193 DEBUG:teuthology.orchestra.run.smithi142:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@iscsi.iscsi.a.service 2021-10-08T19:26:09.196 INFO:tasks.cephadm:Adding prometheus.a on smithi142 2021-10-08T19:26:09.197 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch apply prometheus '1;smithi142=a' 2021-10-08T19:26:09.224 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:26:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[40655]: pgmap v182: 100 pgs: 36 active+clean, 20 creating+peering, 44 unknown; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:26:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[40655]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi142=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:09.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[40655]: Saving service iscsi.iscsi spec with placement smithi142=iscsi.a;count:1 2021-10-08T19:26:09.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:09.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[40655]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:26:09.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:09.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:09.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:09.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[31694]: pgmap v182: 100 pgs: 36 active+clean, 20 creating+peering, 44 unknown; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:26:09.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[31694]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi142=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:09.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[31694]: Saving service iscsi.iscsi spec with placement smithi142=iscsi.a;count:1 2021-10-08T19:26:09.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:09.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[31694]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:26:09.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:09.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:09.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:09 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:09.857 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:09 smithi142 ceph-mon[33432]: pgmap v182: 100 pgs: 36 active+clean, 20 creating+peering, 44 unknown; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:26:09.858 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:09 smithi142 ceph-mon[33432]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi142=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:09.858 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:09 smithi142 ceph-mon[33432]: Saving service iscsi.iscsi spec with placement smithi142=iscsi.a;count:1 2021-10-08T19:26:09.858 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:09 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:09.858 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:09 smithi142 ceph-mon[33432]: osdmap e63: 8 total, 8 up, 8 in 2021-10-08T19:26:09.859 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:09.859 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:09.859 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:09 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2021-10-08T19:26:10.999 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 -- 172.21.15.142:0/482712735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f76b0 msgr2=0x7f40c00f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.000 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/482712735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f76b0 0x7f40c00f7ac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40b00046e0 tx=0x7f40b0009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:11.000 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 -- 172.21.15.142:0/482712735 shutdown_connections 2021-10-08T19:26:11.001 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/482712735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c00f92e0 0x7f40c00ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.001 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/482712735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f76b0 0x7f40c00f7ac0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.001 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/482712735 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40c00f8950 0x7f40c00f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.002 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 -- 172.21.15.142:0/482712735 >> 172.21.15.142:0/482712735 conn(0x7f40c00f2ea0 msgr2=0x7f40c00f52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:11.002 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 -- 172.21.15.142:0/482712735 shutdown_connections 2021-10-08T19:26:11.003 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 -- 172.21.15.142:0/482712735 wait complete. 2021-10-08T19:26:11.003 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 Processor -- start 2021-10-08T19:26:11.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.993+0000 7f40c5b9d700 1 -- start start 2021-10-08T19:26:11.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40c5b9d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40c00f76b0 0x7f40c00625c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40c5b9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f8950 0x7f40c010d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40c5b9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c00f92e0 0x7f40c010fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40c5b9d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0110590 con 0x7f40c00f92e0 2021-10-08T19:26:11.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40c5b9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0110700 con 0x7f40c00f8950 2021-10-08T19:26:11.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40c5b9d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c01108c0 con 0x7f40c00f76b0 2021-10-08T19:26:11.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f8950 0x7f40c010d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f8950 0x7f40c010d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59578/0 (socket says 172.21.15.142:59578) 2021-10-08T19:26:11.006 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 -- 172.21.15.142:0/3987603968 learned_addr learned my addr 172.21.15.142:0/3987603968 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:26:11.006 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40bffff700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c00f92e0 0x7f40c010fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.006 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40bf7fe700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40c00f76b0 0x7f40c00625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.006 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 -- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40c00f76b0 msgr2=0x7f40c00625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.007 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40c00f76b0 0x7f40c00625c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.007 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 -- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c00f92e0 msgr2=0x7f40c010fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.008 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c00f92e0 0x7f40c010fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.008 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 -- 172.21.15.142:0/3987603968 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0005040 con 0x7f40c00f8950 2021-10-08T19:26:11.008 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40beffd700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f8950 0x7f40c010d840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40b4002750 tx=0x7f40b4009de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:11.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40a7fff700 1 -- 172.21.15.142:0/3987603968 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b40092e0 con 0x7f40c00f8950 2021-10-08T19:26:11.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40a7fff700 1 -- 172.21.15.142:0/3987603968 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f40b400f040 con 0x7f40c00f8950 2021-10-08T19:26:11.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c0110b40 con 0x7f40c00f8950 2021-10-08T19:26:11.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40a7fff700 1 -- 172.21.15.142:0/3987603968 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4013660 con 0x7f40c00f8950 2021-10-08T19:26:11.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.994+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c0111060 con 0x7f40c00f8950 2021-10-08T19:26:11.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.995+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c00600e0 con 0x7f40c00f8950 2021-10-08T19:26:11.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.996+0000 7f40a7fff700 1 -- 172.21.15.142:0/3987603968 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 15) v1 ==== 80805+0+0 (secure 0 0 0) 0x7f40b401a030 con 0x7f40c00f8950 2021-10-08T19:26:11.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.996+0000 7f40a7fff700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f40a80634f0 0x7f40a80659a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:11.011 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.996+0000 7f40a7fff700 1 -- 172.21.15.142:0/3987603968 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7097+0+0 (secure 0 0 0) 0x7f40b407f4c0 con 0x7f40c00f8950 2021-10-08T19:26:11.011 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.996+0000 7f40bf7fe700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f40a80634f0 0x7f40a80659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:11.011 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:10.997+0000 7f40bf7fe700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f40a80634f0 0x7f40a80659a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f40b0004e00 tx=0x7f40b0009b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:11.012 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.000+0000 7f40a7fff700 1 -- 172.21.15.142:0/3987603968 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f40b404e220 con 0x7f40c00f8950 2021-10-08T19:26:11.168 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.167+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi142=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f40c0102400 con 0x7f40a80634f0 2021-10-08T19:26:11.175 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.174+0000 7f40a7fff700 1 -- 172.21.15.142:0/3987603968 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f40c0102400 con 0x7f40a80634f0 2021-10-08T19:26:11.175 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled prometheus update... 2021-10-08T19:26:11.177 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f40a80634f0 msgr2=0x7f40a80659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.177 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f40a80634f0 0x7f40a80659a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f40b0004e00 tx=0x7f40b0009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:11.178 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f8950 msgr2=0x7f40c010d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:11.178 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f8950 0x7f40c010d840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40b4002750 tx=0x7f40b4009de0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.178 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 shutdown_connections 2021-10-08T19:26:11.178 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f40a80634f0 0x7f40a80659a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.179 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40c00f92e0 0x7f40c010fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.179 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40c00f76b0 0x7f40c00625c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.179 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 --2- 172.21.15.142:0/3987603968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40c00f8950 0x7f40c010d840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:11.179 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 >> 172.21.15.142:0/3987603968 conn(0x7f40c00f2ea0 msgr2=0x7f40c00fbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:11.180 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 shutdown_connections 2021-10-08T19:26:11.180 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:11.176+0000 7f40c5b9d700 1 -- 172.21.15.142:0/3987603968 wait complete. 2021-10-08T19:26:11.202 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:26:11.202 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:10 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:26:11.202 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:10 smithi142 ceph-mon[33432]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:26:11.203 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.203 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.203 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:10 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.203 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:10 smithi142 ceph-mon[33432]: pgmap v185: 132 pgs: 72 active+clean, 10 creating+peering, 50 unknown; 578 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:26:11.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:26:11.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:26:11.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[31694]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:26:11.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[31694]: pgmap v185: 132 pgs: 72 active+clean, 10 creating+peering, 50 unknown; 578 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:26:11.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:26:11.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2021-10-08T19:26:11.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[40655]: osdmap e64: 8 total, 8 up, 8 in 2021-10-08T19:26:11.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-10-08T19:26:11.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:10 smithi112 ceph-mon[40655]: pgmap v185: 132 pgs: 72 active+clean, 10 creating+peering, 50 unknown; 578 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:26:11.932 DEBUG:teuthology.orchestra.run.smithi142:prometheus.a> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@prometheus.a.service 2021-10-08T19:26:11.935 INFO:tasks.cephadm:Adding node-exporter.a on smithi112 2021-10-08T19:26:11.935 INFO:tasks.cephadm:Adding node-exporter.b on smithi142 2021-10-08T19:26:11.936 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch apply node-exporter '2;smithi112=a;smithi142=b' 2021-10-08T19:26:11.967 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:26:12.153 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:26:12.153 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:26:12.153 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:26:12.154 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.154 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.154 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.154 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi142=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:12.155 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: Saving service prometheus spec with placement smithi142=a;count:1 2021-10-08T19:26:12.155 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:11 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:12.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:26:12.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:26:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:26:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi142=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:12.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: Saving service prometheus spec with placement smithi142=a;count:1 2021-10-08T19:26:12.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:12.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:26:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-10-08T19:26:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: osdmap e65: 8 total, 8 up, 8 in 2021-10-08T19:26:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2190945609' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-10-08T19:26:12.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi142=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:12.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: Saving service prometheus spec with placement smithi142=a;count:1 2021-10-08T19:26:12.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:11 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:26:13.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:26:13.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:26:13.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: pgmap v188: 132 pgs: 121 active+clean, 11 unknown; 578 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2021-10-08T19:26:13.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:26:13.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:26:13.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:26:13.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:13.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: Deploying daemon iscsi.iscsi.a on smithi142 2021-10-08T19:26:13.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:12 smithi142 ceph-mon[33432]: poll took 10061.711 ms: 1 events 2021-10-08T19:26:13.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:26:13.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:26:13.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:26:13.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: pgmap v188: 132 pgs: 121 active+clean, 11 unknown; 578 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2021-10-08T19:26:13.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:26:13.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:26:13.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:26:13.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:13.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: Deploying daemon iscsi.iscsi.a on smithi142 2021-10-08T19:26:13.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[40655]: poll took 10061.711 ms: 1 events 2021-10-08T19:26:13.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2874557160' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:26:13.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-10-08T19:26:13.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: osdmap e66: 8 total, 8 up, 8 in 2021-10-08T19:26:13.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: pgmap v188: 132 pgs: 121 active+clean, 11 unknown; 578 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2021-10-08T19:26:13.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:13.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: Checking pool "iscsi" exists for service iscsi.iscsi 2021-10-08T19:26:13.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2021-10-08T19:26:13.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2021-10-08T19:26:13.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:13.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: Deploying daemon iscsi.iscsi.a on smithi142 2021-10-08T19:26:13.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:12 smithi112 ceph-mon[31694]: poll took 10061.711 ms: 1 events 2021-10-08T19:26:14.562 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 -- 172.21.15.142:0/20303842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f7790 msgr2=0x7f74b40f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.562 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 --2- 172.21.15.142:0/20303842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f7790 0x7f74b40f7c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74a80046e0 tx=0x7f74a8009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:14.562 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 -- 172.21.15.142:0/20303842 shutdown_connections 2021-10-08T19:26:14.562 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 --2- 172.21.15.142:0/20303842 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74b40f8140 0x7f74b40ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 --2- 172.21.15.142:0/20303842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b40f8a90 0x7f74b40f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 --2- 172.21.15.142:0/20303842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f7790 0x7f74b40f7c00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 -- 172.21.15.142:0/20303842 >> 172.21.15.142:0/20303842 conn(0x7f74b40f2450 msgr2=0x7f74b40f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:14.563 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 -- 172.21.15.142:0/20303842 shutdown_connections 2021-10-08T19:26:14.564 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.560+0000 7f74b99e7700 1 -- 172.21.15.142:0/20303842 wait complete. 2021-10-08T19:26:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.561+0000 7f74b99e7700 1 Processor -- start 2021-10-08T19:26:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.561+0000 7f74b99e7700 1 -- start start 2021-10-08T19:26:14.566 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.561+0000 7f74b99e7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74b40f7790 0x7f74b40f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.561+0000 7f74b99e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b40f8140 0x7f74b410d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.561+0000 7f74b99e7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f8a90 0x7f74b410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.567 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.561+0000 7f74b99e7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4110330 con 0x7f74b40f8140 2021-10-08T19:26:14.568 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.561+0000 7f74b99e7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41104a0 con 0x7f74b40f8a90 2021-10-08T19:26:14.568 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.561+0000 7f74b99e7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4110660 con 0x7f74b40f7790 2021-10-08T19:26:14.568 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f8a90 0x7f74b410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.568 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f8a90 0x7f74b410fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59594/0 (socket says 172.21.15.142:59594) 2021-10-08T19:26:14.569 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 -- 172.21.15.142:0/544038916 learned_addr learned my addr 172.21.15.142:0/544038916 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:26:14.569 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b27fc700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b40f8140 0x7f74b410d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.569 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b2ffd700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74b40f7790 0x7f74b40f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.569 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 -- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74b40f7790 msgr2=0x7f74b40f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.569 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74b40f7790 0x7f74b40f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.570 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 -- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b40f8140 msgr2=0x7f74b410d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.570 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b40f8140 0x7f74b410d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.570 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 -- 172.21.15.142:0/544038916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8005040 con 0x7f74b40f8a90 2021-10-08T19:26:14.570 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b37fe700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f8a90 0x7f74b410fb90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b810 tx=0x7f74ac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:14.571 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f749b7fe700 1 -- 172.21.15.142:0/544038916 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0105b0 con 0x7f74b40f8a90 2021-10-08T19:26:14.571 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b4110940 con 0x7f74b40f8a90 2021-10-08T19:26:14.571 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b4110eb0 con 0x7f74b40f8a90 2021-10-08T19:26:14.571 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f749b7fe700 1 -- 172.21.15.142:0/544038916 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f74ac010d70 con 0x7f74b40f8a90 2021-10-08T19:26:14.572 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.562+0000 7f749b7fe700 1 -- 172.21.15.142:0/544038916 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac01baa0 con 0x7f74b40f8a90 2021-10-08T19:26:14.572 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.563+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b41021f0 con 0x7f74b40f8a90 2021-10-08T19:26:14.572 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.564+0000 7f749b7fe700 1 -- 172.21.15.142:0/544038916 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 80845+0+0 (secure 0 0 0) 0x7f74ac00f070 con 0x7f74b40f8a90 2021-10-08T19:26:14.572 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.564+0000 7f749b7fe700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f749c0634c0 0x7f749c065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:14.572 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.564+0000 7f749b7fe700 1 -- 172.21.15.142:0/544038916 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f74ac07faa0 con 0x7f74b40f8a90 2021-10-08T19:26:14.573 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.564+0000 7f74b2ffd700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f749c0634c0 0x7f749c065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:14.573 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.565+0000 7f74b2ffd700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f749c0634c0 0x7f749c065970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f74b4060660 tx=0x7f74a4009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:14.573 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.569+0000 7f749b7fe700 1 -- 172.21.15.142:0/544038916 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f74ac04e750 con 0x7f74b40f8a90 2021-10-08T19:26:14.761 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.760+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi112=a;smithi142=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f74b4059800 con 0x7f749c0634c0 2021-10-08T19:26:14.768 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.767+0000 7f749b7fe700 1 -- 172.21.15.142:0/544038916 <== mgr.14150 v2:172.21.15.112:6800/3200748374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f74b4059800 con 0x7f749c0634c0 2021-10-08T19:26:14.768 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled node-exporter update... 2021-10-08T19:26:14.770 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f749c0634c0 msgr2=0x7f749c065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.770 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f749c0634c0 0x7f749c065970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f74b4060660 tx=0x7f74a4009040 comp rx=0 tx=0).stop 2021-10-08T19:26:14.771 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f8a90 msgr2=0x7f74b410fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:14.771 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f8a90 0x7f74b410fb90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b810 tx=0x7f74ac009250 comp rx=0 tx=0).stop 2021-10-08T19:26:14.771 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 shutdown_connections 2021-10-08T19:26:14.771 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f749c0634c0 0x7f749c065970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.772 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b40f8a90 0x7f74b410fb90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.772 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f74b40f7790 0x7f74b40f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.772 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 --2- 172.21.15.142:0/544038916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74b40f8140 0x7f74b410d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:14.772 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 >> 172.21.15.142:0/544038916 conn(0x7f74b40f2450 msgr2=0x7f74b40f4790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:14.773 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 shutdown_connections 2021-10-08T19:26:14.773 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:14.769+0000 7f74b99e7700 1 -- 172.21.15.142:0/544038916 wait complete. 2021-10-08T19:26:14.774 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:14 smithi142 systemd[1]: Starting Ceph iscsi.iscsi.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:26:15.188 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:14 smithi142 ceph-mon[33432]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:26:15.188 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:14 smithi142 ceph-mon[33432]: pgmap v189: 132 pgs: 132 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2.8 KiB/s wr, 81 op/s 2021-10-08T19:26:15.189 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:14 smithi142 ceph-mon[33432]: poll took 1501.585 ms: 1 events 2021-10-08T19:26:15.189 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:14 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:15.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:14 smithi112 ceph-mon[31694]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:26:15.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:14 smithi112 ceph-mon[31694]: pgmap v189: 132 pgs: 132 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2.8 KiB/s wr, 81 op/s 2021-10-08T19:26:15.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:14 smithi112 ceph-mon[31694]: poll took 1501.585 ms: 1 events 2021-10-08T19:26:15.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:14 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:15.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:14 smithi112 ceph-mon[40655]: mgrmap e16: y(active, since 4m), standbys: x 2021-10-08T19:26:15.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:14 smithi112 ceph-mon[40655]: pgmap v189: 132 pgs: 132 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2.8 KiB/s wr, 81 op/s 2021-10-08T19:26:15.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:14 smithi112 ceph-mon[40655]: poll took 1501.585 ms: 1 events 2021-10-08T19:26:15.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:14 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:15.539 DEBUG:teuthology.orchestra.run.smithi112:node-exporter.a> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@node-exporter.a.service 2021-10-08T19:26:15.543 DEBUG:teuthology.orchestra.run.smithi142:node-exporter.b> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@node-exporter.b.service 2021-10-08T19:26:15.547 INFO:tasks.cephadm:Adding alertmanager.a on smithi112 2021-10-08T19:26:15.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch apply alertmanager '1;smithi112=a' 2021-10-08T19:26:15.575 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:26:15.579 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:26:15.741 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:15 smithi142 bash[56110]: log file path now is '/var/log/tcmu-runner.log' 2021-10-08T19:26:15.911 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:15 smithi112 ceph-mon[31694]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi112=a;smithi142=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:15.912 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:15 smithi112 ceph-mon[31694]: Saving service node-exporter spec with placement smithi112=a;smithi142=b;count:2 2021-10-08T19:26:16.201 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:15 smithi142 ceph-mon[33432]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi112=a;smithi142=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:16.201 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:15 smithi142 ceph-mon[33432]: Saving service node-exporter spec with placement smithi112=a;smithi142=b;count:2 2021-10-08T19:26:16.201 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:15 smithi142 bash[56110]: 4232b29a4a69db2766b33f18ae235060c8804b496f13f8a3643c53acd7bc41af 2021-10-08T19:26:16.202 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:16 smithi142 systemd[1]: Started Ceph iscsi.iscsi.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:26:16.202 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:16 smithi142 conmon[56624]: debug Started the configuration object watcher 2021-10-08T19:26:16.202 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:16 smithi142 conmon[56624]: debug Checking for config object changes every 1s 2021-10-08T19:26:16.202 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:16 smithi142 conmon[56624]: debug Processing osd blocklist entries for this node 2021-10-08T19:26:16.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:15 smithi112 ceph-mon[40655]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi112=a;smithi142=b", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:16.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:15 smithi112 ceph-mon[40655]: Saving service node-exporter spec with placement smithi112=a;smithi142=b;count:2 2021-10-08T19:26:16.522 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:16 smithi142 conmon[56624]: debug Reading the configuration object to update local LIO configuration 2021-10-08T19:26:16.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:16 smithi142 conmon[56624]: debug Configuration does not have an entry for this host(smithi142) - nothing to define to LIO 2021-10-08T19:26:16.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:16 smithi142 conmon[56624]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2021-10-08T19:26:17.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:17 smithi142 conmon[35373]: ignoring --setuser ceph since I am not root 2021-10-08T19:26:17.274 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:17 smithi142 conmon[35373]: ignoring --setgroup ceph since I am not root 2021-10-08T19:26:17.274 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mgr[35397]: -- 172.21.15.142:0/2509616080 <== mon.0 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55daf27f6340 con 0x55daf27cc800 2021-10-08T19:26:17.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mon[33432]: pgmap v190: 132 pgs: 132 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.6 KiB/s wr, 131 op/s 2021-10-08T19:26:17.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mon[33432]: poll took 1952.009 ms: 1 events 2021-10-08T19:26:17.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:17.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mon[33432]: Sending message to agent on host smithi142 2021-10-08T19:26:17.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:26:17.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:17.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:17.281 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/3852433354' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:26:17.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:17 smithi112 conmon[32108]: ignoring --setuser ceph since I am not root 2021-10-08T19:26:17.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:17 smithi112 conmon[32108]: ignoring --setgroup ceph since I am not root 2021-10-08T19:26:17.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mgr[32132]: -- 172.21.15.112:0/2471235278 <== mon.1 v2:172.21.15.112:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560efda60340 con 0x560efda37000 2021-10-08T19:26:17.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[40655]: pgmap v190: 132 pgs: 132 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.6 KiB/s wr, 131 op/s 2021-10-08T19:26:17.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[40655]: poll took 1952.009 ms: 1 events 2021-10-08T19:26:17.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:17.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[40655]: Sending message to agent on host smithi142 2021-10-08T19:26:17.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:26:17.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:17.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:17.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/3852433354' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:26:17.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[31694]: pgmap v190: 132 pgs: 132 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 4.6 KiB/s wr, 131 op/s 2021-10-08T19:26:17.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[31694]: poll took 1952.009 ms: 1 events 2021-10-08T19:26:17.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:17.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[31694]: Sending message to agent on host smithi142 2021-10-08T19:26:17.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2021-10-08T19:26:17.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:17.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' 2021-10-08T19:26:17.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/3852433354' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-10-08T19:26:18.002 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 -- 172.21.15.142:0/2246877825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 msgr2=0x7f31d80f77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:18.003 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 --2- 172.21.15.142:0/2246877825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 0x7f31d80f77f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f31c80046e0 tx=0x7f31c8009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:18.003 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 -- 172.21.15.142:0/2246877825 shutdown_connections 2021-10-08T19:26:18.003 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 --2- 172.21.15.142:0/2246877825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d80f9010 0x7f31d80ff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:18.003 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 --2- 172.21.15.142:0/2246877825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 0x7f31d80f77f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:18.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 --2- 172.21.15.142:0/2246877825 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31d80f8680 0x7f31d80f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:18.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 -- 172.21.15.142:0/2246877825 >> 172.21.15.142:0/2246877825 conn(0x7f31d80f2b50 msgr2=0x7f31d80f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:18.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 -- 172.21.15.142:0/2246877825 shutdown_connections 2021-10-08T19:26:18.004 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:17.999+0000 7f31dd4d6700 1 -- 172.21.15.142:0/2246877825 wait complete. 2021-10-08T19:26:18.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31dd4d6700 1 Processor -- start 2021-10-08T19:26:18.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31dd4d6700 1 -- start start 2021-10-08T19:26:18.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31dd4d6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 0x7f31d810b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:18.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31dd4d6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d80f8680 0x7f31d810daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:18.005 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31dd4d6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31d80f9010 0x7f31d8110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:18.006 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31dd4d6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8110580 con 0x7f31d80f8680 2021-10-08T19:26:18.006 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31dd4d6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d81106c0 con 0x7f31d80f73e0 2021-10-08T19:26:18.006 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31dd4d6700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8110880 con 0x7f31d80f9010 2021-10-08T19:26:18.007 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.000+0000 7f31d7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 0x7f31d810b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:18.007 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 0x7f31d810b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59748/0 (socket says 172.21.15.142:59748) 2021-10-08T19:26:18.007 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d7fff700 1 -- 172.21.15.142:0/3441907833 learned_addr learned my addr 172.21.15.142:0/3441907833 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:26:18.007 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31dccd5700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31d80f9010 0x7f31d8110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:18.008 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d80f8680 0x7f31d810daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:18.008 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d7fff700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31d80f9010 msgr2=0x7f31d8110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:18.008 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d7fff700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31d80f9010 0x7f31d8110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:18.008 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d7fff700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d80f8680 msgr2=0x7f31d810daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:18.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d7fff700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d80f8680 0x7f31d810daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:18.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d7fff700 1 -- 172.21.15.142:0/3441907833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8005040 con 0x7f31d80f73e0 2021-10-08T19:26:18.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31d80f8680 0x7f31d810daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:18.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d7fff700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 0x7f31d810b5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009f50 tx=0x7f31c8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:18.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c801a070 con 0x7f31d80f73e0 2021-10-08T19:26:18.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d8110b00 con 0x7f31d80f73e0 2021-10-08T19:26:18.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f31c8015e90 con 0x7f31d80f73e0 2021-10-08T19:26:18.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c801f690 con 0x7f31d80f73e0 2021-10-08T19:26:18.010 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.001+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d8110f90 con 0x7f31d80f73e0 2021-10-08T19:26:18.012 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.002+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d80472f0 con 0x7f31d80f73e0 2021-10-08T19:26:18.012 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.003+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 80859+0+0 (secure 0 0 0) 0x7f31c8025020 con 0x7f31d80f73e0 2021-10-08T19:26:18.012 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.003+0000 7f31d4ff9700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 0x7f31c0065900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:18.012 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.003+0000 7f31d77fe700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 msgr2=0x7f31c0065900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/3200748374 2021-10-08T19:26:18.013 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.003+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f31c8080970 con 0x7f31d80f73e0 2021-10-08T19:26:18.013 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.003+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 0x7f31c0065900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2021-10-08T19:26:18.013 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.007+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f31c804f770 con 0x7f31d80f73e0 2021-10-08T19:26:18.189 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.188+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 --> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi112=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f31d8102180 con 0x7f31c0063450 2021-10-08T19:26:18.205 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.204+0000 7f31d77fe700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 msgr2=0x7f31c0065900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/3200748374 2021-10-08T19:26:18.205 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.204+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 0x7f31c0065900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2021-10-08T19:26:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:18 smithi142 ceph-mon[33432]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:26:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:18 smithi142 ceph-mon[33432]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:26:18.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:18 smithi112 ceph-mon[31694]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:26:18.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:18 smithi112 ceph-mon[31694]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:26:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:18 smithi112 ceph-mon[40655]: from='mgr.14150 172.21.15.112:0/1438957323' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2021-10-08T19:26:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:18 smithi112 ceph-mon[40655]: mgrmap e17: y(active, since 4m), standbys: x 2021-10-08T19:26:18.608 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.605+0000 7f31d77fe700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 msgr2=0x7f31c0065900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/3200748374 2021-10-08T19:26:18.608 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:18.605+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 0x7f31c0065900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2021-10-08T19:26:19.407 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:19.406+0000 7f31d77fe700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 msgr2=0x7f31c0065900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/3200748374 2021-10-08T19:26:19.407 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:19.406+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 0x7f31c0065900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2021-10-08T19:26:21.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:21.007+0000 7f31d77fe700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 msgr2=0x7f31c0065900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:6800/3200748374 2021-10-08T19:26:21.009 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:21.008+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 0x7f31c0065900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2021-10-08T19:26:22.614 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:22.613+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mon.2 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 18) v1 ==== 80503+0+0 (secure 0 0 0) 0x7f31c807e3c0 con 0x7f31d80f73e0 2021-10-08T19:26:22.615 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:22.613+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 msgr2=0x7f31c0065900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-08T19:26:22.615 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:22.613+0000 7f31d4ff9700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/3200748374,v1:172.21.15.112:6801/3200748374] conn(0x7f31c0063450 0x7f31c0065900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:22.900 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:22 smithi112 ceph-mon[40655]: Active manager daemon y restarted 2021-10-08T19:26:22.901 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:22 smithi112 ceph-mon[40655]: Activating manager daemon y 2021-10-08T19:26:22.901 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:22 smithi112 ceph-mon[40655]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:26:22.901 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:22 smithi112 ceph-mon[31694]: Active manager daemon y restarted 2021-10-08T19:26:22.902 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:22 smithi112 ceph-mon[31694]: Activating manager daemon y 2021-10-08T19:26:22.902 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:22 smithi112 ceph-mon[31694]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:26:22.902 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:22 smithi112 conmon[32108]: [08/Oct/2021:19:26:22] ENGINE Bus STARTING 2021-10-08T19:26:22.903 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:22 smithi112 conmon[32108]: CherryPy Checker: 2021-10-08T19:26:22.903 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:22 smithi112 conmon[32108]: The Application mounted at '' has an empty config. 2021-10-08T19:26:22.903 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:22 smithi112 conmon[32108]: 2021-10-08T19:26:22.903 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:22 smithi112 conmon[32108]: [08/Oct/2021:19:26:22] ENGINE Serving on http://:::9283 2021-10-08T19:26:22.904 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:22 smithi112 conmon[32108]: [08/Oct/2021:19:26:22] ENGINE Bus STARTED 2021-10-08T19:26:22.915 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:22 smithi142 ceph-mon[33432]: Active manager daemon y restarted 2021-10-08T19:26:22.916 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:22 smithi142 ceph-mon[33432]: Activating manager daemon y 2021-10-08T19:26:22.916 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:22 smithi142 ceph-mon[33432]: osdmap e67: 8 total, 8 up, 8 in 2021-10-08T19:26:23.185 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:22 smithi142 conmon[35373]: [08/Oct/2021:19:26:22] ENGINE Bus STARTING 2021-10-08T19:26:23.186 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:23 smithi142 conmon[35373]: CherryPy Checker: 2021-10-08T19:26:23.186 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:23 smithi142 conmon[35373]: The Application mounted at '' has an empty config. 2021-10-08T19:26:23.186 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:23 smithi142 conmon[35373]: 2021-10-08T19:26:23.187 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:23 smithi142 conmon[35373]: [08/Oct/2021:19:26:23] ENGINE Serving on http://:::9283 2021-10-08T19:26:23.187 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:26:23 smithi142 conmon[35373]: [08/Oct/2021:19:26:23] ENGINE Bus STARTED 2021-10-08T19:26:23.631 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.628+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mon.2 v2:172.21.15.142:3300/0 8 ==== mgrmap(e 19) v1 ==== 80613+0+0 (secure 0 0 0) 0x7f31c807e740 con 0x7f31d80f73e0 2021-10-08T19:26:23.632 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.628+0000 7f31d4ff9700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f31c006cea0 0x7f31c006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:23.632 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.628+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 --> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi112=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f31d8102180 con 0x7f31c006cea0 2021-10-08T19:26:23.632 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.629+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f31c006cea0 0x7f31c006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:23.633 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.630+0000 7f31d77fe700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f31c006cea0 0x7f31c006f280 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009fd0 tx=0x7f31cc00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:23.639 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.638+0000 7f31d4ff9700 1 -- 172.21.15.142:0/3441907833 <== mgr.14532 v2:172.21.15.112:6800/471677461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f31d8102180 con 0x7f31c006cea0 2021-10-08T19:26:23.639 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled alertmanager update... 2021-10-08T19:26:23.641 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f31c006cea0 msgr2=0x7f31c006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:23.642 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dd4d6700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f31c006cea0 0x7f31c006f280 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009fd0 tx=0x7f31cc00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:23.642 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 msgr2=0x7f31d810b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:23.642 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dd4d6700 1 --2- 172.21.15.142:0/3441907833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80f73e0 0x7f31d810b5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009f50 tx=0x7f31c8009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:23.642 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dccd5700 1 -- 172.21.15.142:0/3441907833 reap_dead start 2021-10-08T19:26:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 shutdown_connections 2021-10-08T19:26:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 >> 172.21.15.142:0/3441907833 conn(0x7f31d80f2b50 msgr2=0x7f31d80fb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:23.644 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 shutdown_connections 2021-10-08T19:26:23.644 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:23.640+0000 7f31dd4d6700 1 -- 172.21.15.142:0/3441907833 wait complete. 2021-10-08T19:26:24.002 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:23 smithi112 conmon[32108]: [08/Oct/2021:19:26:23] ENGINE Bus STARTING 2021-10-08T19:26:24.003 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:23 smithi112 conmon[32108]: [08/Oct/2021:19:26:23] ENGINE Serving on https://172.21.15.112:8499 2021-10-08T19:26:24.003 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:23 smithi112 conmon[32108]: [08/Oct/2021:19:26:23] ENGINE Bus STARTED 2021-10-08T19:26:24.003 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: mgrmap e18: y(active, starting, since 0.0566406s), standbys: x 2021-10-08T19:26:24.004 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:26:24.004 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:26:24.004 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:26:24.005 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:26:24.005 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:26:24.005 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:26:24.006 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:26:24.006 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:26:24.006 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:26:24.006 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:26:24.007 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:26:24.007 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:26:24.007 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:26:24.007 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:26:24.008 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:26:24.008 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:26:24.008 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: Manager daemon y is now available 2021-10-08T19:26:24.008 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.009 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:24.009 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:24.009 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:24.010 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:24.010 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.010 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.010 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.011 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: mgrmap e18: y(active, starting, since 0.0566406s), standbys: x 2021-10-08T19:26:24.011 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:26:24.011 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:26:24.012 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:26:24.012 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:26:24.012 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:26:24.012 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:26:24.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:26:24.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:26:24.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:26:24.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:26:24.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:26:24.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:26:24.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:26:24.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:26:24.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:26:24.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:26:24.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: Manager daemon y is now available 2021-10-08T19:26:24.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:24.016 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:24.016 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:24.016 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:24.016 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.017 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.017 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.018 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.018 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]': finished 2021-10-08T19:26:24.018 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]': finished 2021-10-08T19:26:24.018 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: Updating smithi112:/etc/ceph/ceph.conf 2021-10-08T19:26:24.019 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:26:24.019 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:24.019 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:24.020 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:24.020 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:24.020 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: Standby manager daemon x restarted 2021-10-08T19:26:24.020 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: Standby manager daemon x started 2021-10-08T19:26:24.021 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:26:24.021 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:26:24.021 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:26:24.021 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:26:24.022 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]: dispatch 2021-10-08T19:26:24.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]: dispatch 2021-10-08T19:26:24.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]': finished 2021-10-08T19:26:24.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]': finished 2021-10-08T19:26:24.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: Updating smithi112:/etc/ceph/ceph.conf 2021-10-08T19:26:24.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:26:24.026 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:24.026 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:24.026 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:24.027 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:24.027 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: Standby manager daemon x restarted 2021-10-08T19:26:24.027 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: Standby manager daemon x started 2021-10-08T19:26:24.027 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:26:24.028 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:26:24.028 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:26:24.028 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:26:24.029 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.029 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.029 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.030 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]: dispatch 2021-10-08T19:26:24.030 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]: dispatch 2021-10-08T19:26:24.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: mgrmap e18: y(active, starting, since 0.0566406s), standbys: x 2021-10-08T19:26:24.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-10-08T19:26:24.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-10-08T19:26:24.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-10-08T19:26:24.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-10-08T19:26:24.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-10-08T19:26:24.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-10-08T19:26:24.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-10-08T19:26:24.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-10-08T19:26:24.033 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-10-08T19:26:24.033 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-10-08T19:26:24.033 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-10-08T19:26:24.033 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-10-08T19:26:24.034 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-10-08T19:26:24.034 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-10-08T19:26:24.034 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-10-08T19:26:24.034 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-10-08T19:26:24.035 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: Manager daemon y is now available 2021-10-08T19:26:24.035 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.035 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:24.035 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:24.035 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:24.036 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:24.036 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.037 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.037 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.037 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:26:24.037 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]': finished 2021-10-08T19:26:24.038 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]': finished 2021-10-08T19:26:24.038 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: Updating smithi112:/etc/ceph/ceph.conf 2021-10-08T19:26:24.038 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: Updating smithi142:/etc/ceph/ceph.conf 2021-10-08T19:26:24.039 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:24.039 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:26:24.039 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:24.040 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:26:24.040 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: Standby manager daemon x restarted 2021-10-08T19:26:24.040 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: Standby manager daemon x started 2021-10-08T19:26:24.041 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-10-08T19:26:24.041 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-10-08T19:26:24.042 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-10-08T19:26:24.042 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.? 172.21.15.142:0/1243575773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-10-08T19:26:24.042 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.043 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.043 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.043 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]: dispatch 2021-10-08T19:26:24.044 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi112", "caps": []}]: dispatch 2021-10-08T19:26:24.355 DEBUG:teuthology.orchestra.run.smithi112:alertmanager.a> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@alertmanager.a.service 2021-10-08T19:26:24.359 INFO:tasks.cephadm:Adding grafana.a on smithi142 2021-10-08T19:26:24.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph orch apply grafana '1;smithi142=a' 2021-10-08T19:26:24.441 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:-- Logs begin at Fri 2021-10-08 19:00:30 UTC. -- 2021-10-08T19:26:24.847 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:26:24.847 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:26:24.848 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:24.848 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: Reconfiguring agent.smithi112 (dependencies changed)... 2021-10-08T19:26:24.848 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: Starting cherrypy engine... 2021-10-08T19:26:24.848 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: [08/Oct/2021:19:26:23] ENGINE Bus STARTING 2021-10-08T19:26:24.849 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: mgrmap e19: y(active, since 1.07237s), standbys: x 2021-10-08T19:26:24.849 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi112=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:24.849 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: Saving service alertmanager spec with placement smithi112=a;count:1 2021-10-08T19:26:24.849 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:24.849 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.850 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: [08/Oct/2021:19:26:23] ENGINE Serving on https://172.21.15.112:8499 2021-10-08T19:26:24.850 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: [08/Oct/2021:19:26:23] ENGINE Bus STARTED 2021-10-08T19:26:24.850 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: Cherrypy engine started. 2021-10-08T19:26:24.850 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: Reconfiguring daemon agent.smithi112 on smithi112 2021-10-08T19:26:24.851 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.851 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:26:24.851 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:26:24.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:26:24.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:26:24.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:24.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: Reconfiguring agent.smithi112 (dependencies changed)... 2021-10-08T19:26:24.852 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: Starting cherrypy engine... 2021-10-08T19:26:24.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: [08/Oct/2021:19:26:23] ENGINE Bus STARTING 2021-10-08T19:26:24.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: mgrmap e19: y(active, since 1.07237s), standbys: x 2021-10-08T19:26:24.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi112=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:24.853 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: Saving service alertmanager spec with placement smithi112=a;count:1 2021-10-08T19:26:24.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:24.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: [08/Oct/2021:19:26:23] ENGINE Serving on https://172.21.15.112:8499 2021-10-08T19:26:24.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: [08/Oct/2021:19:26:23] ENGINE Bus STARTED 2021-10-08T19:26:24.854 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: Cherrypy engine started. 2021-10-08T19:26:24.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: Reconfiguring daemon agent.smithi112 on smithi112 2021-10-08T19:26:24.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:26:24.855 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:26:24.890 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:26:24.891 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2021-10-08T19:26:24.891 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:24.892 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: Reconfiguring agent.smithi112 (dependencies changed)... 2021-10-08T19:26:24.892 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: Starting cherrypy engine... 2021-10-08T19:26:24.892 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: [08/Oct/2021:19:26:23] ENGINE Bus STARTING 2021-10-08T19:26:24.892 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: mgrmap e19: y(active, since 1.07237s), standbys: x 2021-10-08T19:26:24.893 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi112=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:24.893 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: Saving service alertmanager spec with placement smithi112=a;count:1 2021-10-08T19:26:24.893 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:24.894 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.894 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: [08/Oct/2021:19:26:23] ENGINE Serving on https://172.21.15.112:8499 2021-10-08T19:26:24.894 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: [08/Oct/2021:19:26:23] ENGINE Bus STARTED 2021-10-08T19:26:24.894 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: Cherrypy engine started. 2021-10-08T19:26:24.895 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: Reconfiguring daemon agent.smithi112 on smithi112 2021-10-08T19:26:24.895 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:24.895 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:26:24.895 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi142", "caps": []}]: dispatch 2021-10-08T19:26:25.816 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:25 smithi142 ceph-mon[33432]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.172 seconds 2021-10-08T19:26:25.817 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:25 smithi142 ceph-mon[33432]: Reconfiguring agent.smithi142 (dependencies changed)... 2021-10-08T19:26:25.817 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:25 smithi142 ceph-mon[33432]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:25.817 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:25 smithi142 ceph-mon[33432]: mgrmap e20: y(active, since 2s), standbys: x 2021-10-08T19:26:25.817 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:25 smithi142 ceph-mon[33432]: Reconfiguring daemon agent.smithi142 on smithi142 2021-10-08T19:26:26.053 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 -- 172.21.15.142:0/1834587803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fcc30 msgr2=0x7fcbe80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.054 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 --2- 172.21.15.142:0/1834587803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fcc30 0x7fcbe80fd000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4004820 tx=0x7fcbe400ac40 comp rx=0 tx=0).stop 2021-10-08T19:26:26.055 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 -- 172.21.15.142:0/1834587803 shutdown_connections 2021-10-08T19:26:26.055 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 --2- 172.21.15.142:0/1834587803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe80f7400 0x7fcbe8103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.056 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 --2- 172.21.15.142:0/1834587803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fcc30 0x7fcbe80fd000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.056 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 --2- 172.21.15.142:0/1834587803 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbe80fd5d0 0x7fcbe80f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.056 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 -- 172.21.15.142:0/1834587803 >> 172.21.15.142:0/1834587803 conn(0x7fcbe806d8b0 msgr2=0x7fcbe80f4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:26.057 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 -- 172.21.15.142:0/1834587803 shutdown_connections 2021-10-08T19:26:26.057 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.048+0000 7fcbef14a700 1 -- 172.21.15.142:0/1834587803 wait complete. 2021-10-08T19:26:26.058 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbef14a700 1 Processor -- start 2021-10-08T19:26:26.059 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbef14a700 1 -- start start 2021-10-08T19:26:26.059 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbef14a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe80f7400 0x7fcbe810e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.059 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbef14a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbe80fcc30 0x7fcbe810eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.059 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbef14a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fd5d0 0x7fcbe81086d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.060 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbef14a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8108d20 con 0x7fcbe80f7400 2021-10-08T19:26:26.060 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbef14a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8108e90 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.060 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbef14a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8109050 con 0x7fcbe80fcc30 2021-10-08T19:26:26.060 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbed6e7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fd5d0 0x7fcbe81086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.061 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbed6e7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fd5d0 0x7fcbe81086d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59864/0 (socket says 172.21.15.142:59864) 2021-10-08T19:26:26.061 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbed6e7700 1 -- 172.21.15.142:0/2720214454 learned_addr learned my addr 172.21.15.142:0/2720214454 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:26:26.061 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbecee6700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe80f7400 0x7fcbe810e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.062 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbdffff700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbe80fcc30 0x7fcbe810eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.062 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbed6e7700 1 -- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbe80fcc30 msgr2=0x7fcbe810eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.063 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbed6e7700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbe80fcc30 0x7fcbe810eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.063 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbed6e7700 1 -- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe80f7400 msgr2=0x7fcbe810e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.064 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbed6e7700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe80f7400 0x7fcbe810e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.065 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbed6e7700 1 -- 172.21.15.142:0/2720214454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe4005040 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.065 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.049+0000 7fcbdffff700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbe80fcc30 0x7fcbe810eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:26:26.065 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.050+0000 7fcbed6e7700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fd5d0 0x7fcbe81086d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000d920 tx=0x7fcbe0004f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:26.066 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.050+0000 7fcbdd7fa700 1 -- 172.21.15.142:0/2720214454 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000de60 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.067 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.050+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe8109330 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.068 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.050+0000 7fcbdd7fa700 1 -- 172.21.15.142:0/2720214454 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fcbe000f040 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.068 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.050+0000 7fcbdd7fa700 1 -- 172.21.15.142:0/2720214454 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00139f0 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.069 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.050+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe81155c0 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.069 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.051+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe8047b50 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.069 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.051+0000 7fcbdd7fa700 1 -- 172.21.15.142:0/2720214454 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fcbe000b750 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.070 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.051+0000 7fcbdd7fa700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fcbd00635e0 0x7fcbd0065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:26.070 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.052+0000 7fcbdd7fa700 1 -- 172.21.15.142:0/2720214454 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7fcbe0080760 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.071 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.052+0000 7fcbecee6700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fcbd00635e0 0x7fcbd0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:26.071 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.052+0000 7fcbecee6700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fcbd00635e0 0x7fcbd0065a90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400a940 tx=0x7fcbe400ac40 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:26.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[40655]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.172 seconds 2021-10-08T19:26:26.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[40655]: Reconfiguring agent.smithi142 (dependencies changed)... 2021-10-08T19:26:26.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[40655]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:26.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[40655]: mgrmap e20: y(active, since 2s), standbys: x 2021-10-08T19:26:26.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[40655]: Reconfiguring daemon agent.smithi142 on smithi142 2021-10-08T19:26:26.075 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.056+0000 7fcbdd7fa700 1 -- 172.21.15.142:0/2720214454 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fcbe0052db0 con 0x7fcbe80fd5d0 2021-10-08T19:26:26.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[31694]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.172 seconds 2021-10-08T19:26:26.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[31694]: Reconfiguring agent.smithi142 (dependencies changed)... 2021-10-08T19:26:26.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[31694]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:26.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[31694]: mgrmap e20: y(active, since 2s), standbys: x 2021-10-08T19:26:26.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:25 smithi112 ceph-mon[31694]: Reconfiguring daemon agent.smithi142 on smithi142 2021-10-08T19:26:26.238 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.237+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 --> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi142=a", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbe8109cf0 con 0x7fcbd00635e0 2021-10-08T19:26:26.243 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.242+0000 7fcbdd7fa700 1 -- 172.21.15.142:0/2720214454 <== mgr.14532 v2:172.21.15.112:6800/471677461 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fcbe8109cf0 con 0x7fcbd00635e0 2021-10-08T19:26:26.244 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled grafana update... 2021-10-08T19:26:26.246 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fcbd00635e0 msgr2=0x7fcbd0065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.246 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fcbd00635e0 0x7fcbd0065a90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400a940 tx=0x7fcbe400ac40 comp rx=0 tx=0).stop 2021-10-08T19:26:26.246 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fd5d0 msgr2=0x7fcbe81086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:26.246 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fd5d0 0x7fcbe81086d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000d920 tx=0x7fcbe0004f00 comp rx=0 tx=0).stop 2021-10-08T19:26:26.247 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 shutdown_connections 2021-10-08T19:26:26.247 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fcbd00635e0 0x7fcbd0065a90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.247 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbe80fd5d0 0x7fcbe81086d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.247 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe80f7400 0x7fcbe810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.244+0000 7fcbef14a700 1 --2- 172.21.15.142:0/2720214454 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcbe80fcc30 0x7fcbe810eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:26.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.245+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 >> 172.21.15.142:0/2720214454 conn(0x7fcbe806d8b0 msgr2=0x7fcbe806e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:26.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.245+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 shutdown_connections 2021-10-08T19:26:26.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:26.245+0000 7fcbef14a700 1 -- 172.21.15.142:0/2720214454 wait complete. 2021-10-08T19:26:26.490 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:26:26.766 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.178 seconds 2021-10-08T19:26:26.767 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:26.767 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:26.767 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:26.768 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:26.768 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:26.769 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:26.770 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:26.771 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:26.771 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:26.771 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:26.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:26 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:26.982 DEBUG:teuthology.orchestra.run.smithi142:grafana.a> sudo journalctl -f -n 0 -u ceph-c1559bde-286c-11ec-8c25-001a4aab830c@grafana.a.service 2021-10-08T19:26:26.986 INFO:tasks.cephadm:Setting up client nodes... 2021-10-08T19:26:26.986 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-10-08T19:26:27.012 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.178 seconds 2021-10-08T19:26:27.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:27.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:27.013 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:27.014 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:27.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:27.015 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:27.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:27.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:27.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:27.020 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:27.020 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:27.021 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: Executing () created at /lib/python3.6/site-packages/asyncssh/channel.py:596> took 0.178 seconds 2021-10-08T19:26:27.021 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:27.021 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:27.022 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:27.022 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:27.022 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:27.022 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:27.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:27.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:27.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:27.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:27.024 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:26 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:27.024 INFO:journalctl@ceph.grafana.a.smithi142.stdout:-- Logs begin at Fri 2021-10-08 19:00:11 UTC. -- 2021-10-08T19:26:27.748 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:27.748 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[31694]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi142=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:27.749 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[31694]: Saving service grafana spec with placement smithi142=a;count:1 2021-10-08T19:26:27.750 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:27.750 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[31694]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:27.751 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:27.752 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[40655]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi142=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:27.752 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[40655]: Saving service grafana spec with placement smithi142=a;count:1 2021-10-08T19:26:27.753 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:27.753 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:27 smithi112 ceph-mon[40655]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:28.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:27 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:28.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:27 smithi142 ceph-mon[33432]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi142=a", "target": ["mon-mgr", ""]}]: dispatch 2021-10-08T19:26:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:27 smithi142 ceph-mon[33432]: Saving service grafana spec with placement smithi142=a;count:1 2021-10-08T19:26:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:27 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:26:28.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:27 smithi142 ceph-mon[33432]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:29.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 -- 172.21.15.112:0/2995545706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380f8d90 msgr2=0x7f1d381053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 --2- 172.21.15.112:0/2995545706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380f8d90 0x7f1d381053e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009a60 tx=0x7f1d30004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:29.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 -- 172.21.15.112:0/2995545706 shutdown_connections 2021-10-08T19:26:29.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 --2- 172.21.15.112:0/2995545706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380f8d90 0x7f1d381053e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 --2- 172.21.15.112:0/2995545706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d380fe620 0x7f1d380fe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 --2- 172.21.15.112:0/2995545706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380fef30 0x7f1d380f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 -- 172.21.15.112:0/2995545706 >> 172.21.15.112:0/2995545706 conn(0x7f1d3806f350 msgr2=0x7f1d380f6700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:29.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 -- 172.21.15.112:0/2995545706 shutdown_connections 2021-10-08T19:26:29.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.274+0000 7f1d407e3700 1 -- 172.21.15.112:0/2995545706 wait complete. 2021-10-08T19:26:29.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d407e3700 1 Processor -- start 2021-10-08T19:26:29.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d407e3700 1 -- start start 2021-10-08T19:26:29.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d407e3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380f8d90 0x7f1d3810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d407e3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d380fe620 0x7f1d3810ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d407e3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380fef30 0x7f1d38108600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d407e3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38108bd0 con 0x7f1d380fe620 2021-10-08T19:26:29.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d407e3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38108d40 con 0x7f1d380f8d90 2021-10-08T19:26:29.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d407e3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38108f00 con 0x7f1d380fef30 2021-10-08T19:26:29.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d380fe620 0x7f1d3810ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d380fe620 0x7f1d3810ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34060/0 (socket says 172.21.15.112:34060) 2021-10-08T19:26:29.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 -- 172.21.15.112:0/3813984768 learned_addr learned my addr 172.21.15.112:0/3813984768 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:29.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3ed80700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380fef30 0x7f1d38108600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3e57f700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380f8d90 0x7f1d3810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 -- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380fef30 msgr2=0x7f1d38108600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380fef30 0x7f1d38108600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 -- 172.21.15.112:0/3813984768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380f8d90 msgr2=0x7f1d3810e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380f8d90 0x7f1d3810e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 -- 172.21.15.112:0/3813984768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28005040 con 0x7f1d380fe620 2021-10-08T19:26:29.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3ed80700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380fef30 0x7f1d38108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:29.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3e57f700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380f8d90 0x7f1d3810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:29.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.275+0000 7f1d3dd7e700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d380fe620 0x7f1d3810ea70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e840 tx=0x7f1d3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:29.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.276+0000 7f1d2effd700 1 -- 172.21.15.112:0/3813984768 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340092e0 con 0x7f1d380fe620 2021-10-08T19:26:29.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.276+0000 7f1d2effd700 1 -- 172.21.15.112:0/3813984768 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1d3400f040 con 0x7f1d380fe620 2021-10-08T19:26:29.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.276+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d30009640 con 0x7f1d380fe620 2021-10-08T19:26:29.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.276+0000 7f1d2effd700 1 -- 172.21.15.112:0/3813984768 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340146f0 con 0x7f1d380fe620 2021-10-08T19:26:29.286 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.276+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d38115330 con 0x7f1d380fe620 2021-10-08T19:26:29.287 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.277+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d38047b50 con 0x7f1d380fe620 2021-10-08T19:26:29.288 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.277+0000 7f1d2effd700 1 -- 172.21.15.112:0/3813984768 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f1d3401b030 con 0x7f1d380fe620 2021-10-08T19:26:29.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.277+0000 7f1d2effd700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1d240635e0 0x7f1d24065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:29.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.277+0000 7f1d2effd700 1 -- 172.21.15.112:0/3813984768 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f1d3407f9f0 con 0x7f1d380fe620 2021-10-08T19:26:29.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.277+0000 7f1d3e57f700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1d240635e0 0x7f1d24065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:29.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.278+0000 7f1d3e57f700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1d240635e0 0x7f1d24065a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007fd0 tx=0x7f1d2800b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:29.290 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.282+0000 7f1d2effd700 1 -- 172.21.15.112:0/3813984768 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1d34081e60 con 0x7f1d380fe620 2021-10-08T19:26:29.517 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.515+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f1d38109b10 con 0x7f1d380fe620 2021-10-08T19:26:29.521 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.519+0000 7f1d2effd700 1 -- 172.21.15.112:0/3813984768 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1d340520f0 con 0x7f1d380fe620 2021-10-08T19:26:29.522 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2021-10-08T19:26:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBlm2BheavTHhAAOb7AjhnJI+h/4aOLDJqvIQ== 2021-10-08T19:26:29.524 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1d240635e0 msgr2=0x7f1d24065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.524 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1d240635e0 0x7f1d24065a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007fd0 tx=0x7f1d2800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:29.525 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d380fe620 msgr2=0x7f1d3810ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:29.525 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d380fe620 0x7f1d3810ea70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e840 tx=0x7f1d3400b040 comp rx=0 tx=0).stop 2021-10-08T19:26:29.525 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 shutdown_connections 2021-10-08T19:26:29.526 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1d240635e0 0x7f1d24065a90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1d380fef30 0x7f1d38108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.527 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d380f8d90 0x7f1d3810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.528 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 --2- 172.21.15.112:0/3813984768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d380fe620 0x7f1d3810ea70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:29.529 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 >> 172.21.15.112:0/3813984768 conn(0x7f1d3806f350 msgr2=0x7f1d380ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:29.529 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 shutdown_connections 2021-10-08T19:26:29.529 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:29.521+0000 7f1d407e3700 1 -- 172.21.15.112:0/3813984768 wait complete. 2021-10-08T19:26:29.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:29 smithi142 ceph-mon[33432]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:29.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:29 smithi112 ceph-mon[40655]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:29.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:29 smithi112 ceph-mon[31694]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:26:30.310 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:26:30.311 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-10-08T19:26:30.311 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-10-08T19:26:30.392 DEBUG:teuthology.orchestra.run.smithi142:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-10-08T19:26:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3813984768' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3813984768' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:26:30.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3813984768' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:30.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3813984768' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:26:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3813984768' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3813984768' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:26:31.720 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:31 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:26:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:31.720 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:31 smithi112 ceph-mon[40655]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2021-10-08T19:26:31.721 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:31 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:31.721 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:31 smithi112 ceph-mon[31694]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2021-10-08T19:26:31.721 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:31 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:31 smithi142 ceph-mon[33432]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2021-10-08T19:26:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:31 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:32.070 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:31 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:26:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:32.246 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 -- 172.21.15.142:0/983566976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0fc3a0 msgr2=0x7f4dfc0fc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:32.246 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 --2- 172.21.15.142:0/983566976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0fc3a0 0x7f4dfc0fc770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0046e0 tx=0x7f4dec009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:32.247 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 -- 172.21.15.142:0/983566976 shutdown_connections 2021-10-08T19:26:32.247 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 --2- 172.21.15.142:0/983566976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc0f7ee0 0x7f4dfc104290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.247 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 --2- 172.21.15.142:0/983566976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0fc3a0 0x7f4dfc0fc770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.247 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 --2- 172.21.15.142:0/983566976 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4dfc0f7530 0x7f4dfc0f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 -- 172.21.15.142:0/983566976 >> 172.21.15.142:0/983566976 conn(0x7f4dfc06e3e0 msgr2=0x7f4dfc06e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:32.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 -- 172.21.15.142:0/983566976 shutdown_connections 2021-10-08T19:26:32.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.241+0000 7f4e00803700 1 -- 172.21.15.142:0/983566976 wait complete. 2021-10-08T19:26:32.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4e00803700 1 Processor -- start 2021-10-08T19:26:32.248 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4e00803700 1 -- start start 2021-10-08T19:26:32.249 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4e00803700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0f7530 0x7f4dfc1099f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:32.249 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4e00803700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc0f7ee0 0x7f4dfc109f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:32.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4e00803700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4dfc0fc3a0 0x7f4dfc1148b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:32.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4e00803700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc114df0 con 0x7f4dfc0f7ee0 2021-10-08T19:26:32.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4e00803700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc114f30 con 0x7f4dfc0f7530 2021-10-08T19:26:32.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4e00803700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc1150a0 con 0x7f4dfc0fc3a0 2021-10-08T19:26:32.250 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0f7530 0x7f4dfc1099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:32.251 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0f7530 0x7f4dfc1099f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59874/0 (socket says 172.21.15.142:59874) 2021-10-08T19:26:32.251 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfad9d700 1 -- 172.21.15.142:0/525749721 learned_addr learned my addr 172.21.15.142:0/525749721 (peer_addr_for_me v2:172.21.15.142:0/0) 2021-10-08T19:26:32.251 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfa59c700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc0f7ee0 0x7f4dfc109f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:32.252 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfb59e700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4dfc0fc3a0 0x7f4dfc1148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:32.252 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfad9d700 1 -- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4dfc0fc3a0 msgr2=0x7f4dfc1148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:32.252 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfad9d700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4dfc0fc3a0 0x7f4dfc1148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.252 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfad9d700 1 -- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc0f7ee0 msgr2=0x7f4dfc109f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfad9d700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc0f7ee0 0x7f4dfc109f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.242+0000 7f4dfad9d700 1 -- 172.21.15.142:0/525749721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec005040 con 0x7f4dfc0f7530 2021-10-08T19:26:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.243+0000 7f4dfad9d700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0f7530 0x7f4dfc1099f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4dec005010 tx=0x7f4dec009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.243+0000 7f4de37fe700 1 -- 172.21.15.142:0/525749721 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec01a070 con 0x7f4dfc0f7530 2021-10-08T19:26:32.253 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.243+0000 7f4de37fe700 1 -- 172.21.15.142:0/525749721 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f4dec015e10 con 0x7f4dfc0f7530 2021-10-08T19:26:32.254 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.243+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc115320 con 0x7f4dfc0f7530 2021-10-08T19:26:32.254 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.243+0000 7f4de37fe700 1 -- 172.21.15.142:0/525749721 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec01e640 con 0x7f4dfc0f7530 2021-10-08T19:26:32.254 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.243+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc1157a0 con 0x7f4dfc0f7530 2021-10-08T19:26:32.254 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.244+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc06ff00 con 0x7f4dfc0f7530 2021-10-08T19:26:32.254 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.244+0000 7f4de37fe700 1 -- 172.21.15.142:0/525749721 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f4dec009320 con 0x7f4dfc0f7530 2021-10-08T19:26:32.255 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.244+0000 7f4de37fe700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4de4063530 0x7f4de40659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:32.255 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.244+0000 7f4de37fe700 1 -- 172.21.15.142:0/525749721 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f4dec0807e0 con 0x7f4dfc0f7530 2021-10-08T19:26:32.256 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.244+0000 7f4dfa59c700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4de4063530 0x7f4de40659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:32.256 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.245+0000 7f4dfa59c700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4de4063530 0x7f4de40659e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc062340 tx=0x7f4df000b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:32.258 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.248+0000 7f4de37fe700 1 -- 172.21.15.142:0/525749721 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f4dec052f20 con 0x7f4dfc0f7530 2021-10-08T19:26:32.466 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.465+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f4dfc062080 con 0x7f4dfc0f7530 2021-10-08T19:26:32.471 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.470+0000 7f4de37fe700 1 -- 172.21.15.142:0/525749721 <== mon.2 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) v1 ==== 170+0+59 (secure 0 0 0) 0x7f4dec0230f0 con 0x7f4dfc0f7530 2021-10-08T19:26:32.471 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2021-10-08T19:26:32.472 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBom2Bhlp/gGxAA0hgBI5dZ08IGJSvzYxArFg== 2021-10-08T19:26:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4de4063530 msgr2=0x7f4de40659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4de4063530 0x7f4de40659e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc062340 tx=0x7f4df000b040 comp rx=0 tx=0).stop 2021-10-08T19:26:32.473 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0f7530 msgr2=0x7f4dfc1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:32.474 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0f7530 0x7f4dfc1099f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4dec005010 tx=0x7f4dec009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:32.474 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 shutdown_connections 2021-10-08T19:26:32.474 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4de4063530 0x7f4de40659e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4dfc0fc3a0 0x7f4dfc1148b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dfc0f7530 0x7f4dfc1099f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.475 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 --2- 172.21.15.142:0/525749721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc0f7ee0 0x7f4dfc109f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:32.476 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 >> 172.21.15.142:0/525749721 conn(0x7f4dfc06e3e0 msgr2=0x7f4dfc0f5620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:32.476 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 shutdown_connections 2021-10-08T19:26:32.476 INFO:teuthology.orchestra.run.smithi142.stderr:2021-10-08T19:26:32.472+0000 7f4e00803700 1 -- 172.21.15.142:0/525749721 wait complete. 2021-10-08T19:26:33.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: Sending message to agent on host smithi112 2021-10-08T19:26:33.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: Received old metadata from agent on host smithi112. Requested up-to-date metadata. 2021-10-08T19:26:33.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:26:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:33.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:33.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: Sending message to agent on host smithi142 2021-10-08T19:26:33.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:26:33.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:33.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:26:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:33.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: from='client.? 172.21.15.142:0/525749721' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:33.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:33.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:26:33.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: Sending message to agent on host smithi112 2021-10-08T19:26:33.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: Received old metadata from agent on host smithi112. Requested up-to-date metadata. 2021-10-08T19:26:33.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:26:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:33.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:33.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: Sending message to agent on host smithi142 2021-10-08T19:26:33.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:26:33.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:33.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:26:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:33.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: from='client.? 172.21.15.142:0/525749721' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:33.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:33.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:26:33.214 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: Sending message to agent on host smithi112 2021-10-08T19:26:33.215 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: Received old metadata from agent on host smithi112. Requested up-to-date metadata. 2021-10-08T19:26:33.215 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:26:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:33.215 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:33.216 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: Sending message to agent on host smithi142 2021-10-08T19:26:33.216 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:26:33.216 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:33.216 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:26:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:33.217 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: from='client.? 172.21.15.142:0/525749721' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:33.217 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-10-08T19:26:33.217 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-10-08T19:26:33.219 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2021-10-08T19:26:33.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-10-08T19:26:33.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-10-08T19:26:33.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:26:34.207 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:34.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:33 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:34.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:33 smithi142 ceph-mon[33432]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2021-10-08T19:26:34.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:33 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:34.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:33 smithi112 ceph-mon[40655]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2021-10-08T19:26:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:33 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:33 smithi112 ceph-mon[31694]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2021-10-08T19:26:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4061849749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0f7c80 msgr2=0x7f1cec104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.796 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4061849749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0f7c80 0x7f1cec104280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009a60 tx=0x7f1ce4004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:35.797 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4061849749 shutdown_connections 2021-10-08T19:26:35.797 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4061849749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0f7c80 0x7f1cec104280 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4061849749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1cec0fd480 0x7f1cec0fd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4061849749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cec0fde20 0x7f1cec0f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4061849749 >> 172.21.15.112:0/4061849749 conn(0x7f1cec06e2e0 msgr2=0x7f1cec06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:35.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4061849749 shutdown_connections 2021-10-08T19:26:35.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.793+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4061849749 wait complete. 2021-10-08T19:26:35.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ceb59e700 1 Processor -- start 2021-10-08T19:26:35.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ceb59e700 1 -- start start 2021-10-08T19:26:35.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ceb59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cec0f7c80 0x7f1cec0f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:35.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ceb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0fd480 0x7f1cec0f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:35.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ceb59e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1cec0fde20 0x7f1cec116880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:35.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ceb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0f6520 con 0x7f1cec0fd480 2021-10-08T19:26:35.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ceb59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec116df0 con 0x7f1cec0f7c80 2021-10-08T19:26:35.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ceb59e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec116fb0 con 0x7f1cec0fde20 2021-10-08T19:26:35.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0fd480 0x7f1cec0f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:35.801 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0fd480 0x7f1cec0f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34078/0 (socket says 172.21.15.112:34078) 2021-10-08T19:26:35.801 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 -- 172.21.15.112:0/4223842672 learned_addr learned my addr 172.21.15.112:0/4223842672 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:35.801 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1cead9d700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1cec0fde20 0x7f1cec116880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:35.801 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1cea59c700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cec0f7c80 0x7f1cec0f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:35.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 -- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1cec0fde20 msgr2=0x7f1cec116880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1cec0fde20 0x7f1cec116880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 -- 172.21.15.112:0/4223842672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cec0f7c80 msgr2=0x7f1cec0f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cec0f7c80 0x7f1cec0f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 -- 172.21.15.112:0/4223842672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc005040 con 0x7f1cec0fd480 2021-10-08T19:26:35.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1cead9d700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1cec0fde20 0x7f1cec116880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:35.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.794+0000 7f1ce9d9b700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0fd480 0x7f1cec0f5ba0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009470 tx=0x7f1ce0006ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:35.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.795+0000 7f1cdaffd700 1 -- 172.21.15.112:0/4223842672 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0010360 con 0x7f1cec0fd480 2021-10-08T19:26:35.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.795+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce4009640 con 0x7f1cec0fd480 2021-10-08T19:26:35.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.795+0000 7f1cdaffd700 1 -- 172.21.15.112:0/4223842672 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1ce0010910 con 0x7f1cec0fd480 2021-10-08T19:26:35.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.795+0000 7f1cdaffd700 1 -- 172.21.15.112:0/4223842672 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000f6c0 con 0x7f1cec0fd480 2021-10-08T19:26:35.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.795+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec1175f0 con 0x7f1cec0fd480 2021-10-08T19:26:35.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.796+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec06fe00 con 0x7f1cec0fd480 2021-10-08T19:26:35.805 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.796+0000 7f1cdaffd700 1 -- 172.21.15.112:0/4223842672 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f1ce0019030 con 0x7f1cec0fd480 2021-10-08T19:26:35.806 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.796+0000 7f1cdaffd700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1cd40635e0 0x7f1cd4065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:35.806 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.797+0000 7f1cdaffd700 1 -- 172.21.15.112:0/4223842672 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f1ce007f610 con 0x7f1cec0fd480 2021-10-08T19:26:35.806 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.797+0000 7f1cea59c700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1cd40635e0 0x7f1cd4065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:35.806 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.797+0000 7f1cea59c700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1cd40635e0 0x7f1cd4065a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009050 tx=0x7f1cdc00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:35.807 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.801+0000 7f1cdaffd700 1 -- 172.21.15.112:0/4223842672 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1ce0051d10 con 0x7f1cec0fd480 2021-10-08T19:26:35.986 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.984+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cec106690 con 0x7f1cec0fd480 2021-10-08T19:26:35.987 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.985+0000 7f1cdaffd700 1 -- 172.21.15.112:0/4223842672 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+21385 (secure 0 0 0) 0x7f1ce0017070 con 0x7f1cec0fd480 2021-10-08T19:26:35.988 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:26:35.988 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":67,"fsid":"c1559bde-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:21:03.408199+0000","modified":"2021-10-08T19:26:22.557603+0000","last_up_change":"2021-10-08T19:25:55.256730+0000","last_in_change":"2021-10-08T19:25:39.771821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:24:24.578260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:26:02.182312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:26:02.734650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:26:04.175169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:26:06.145211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:26:08.191838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6803","nonce":3277557561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6805","nonce":3277557561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6809","nonce":3277557561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6807","nonce":3277557561}]},"public_addr":"172.21.15.112:6803/3277557561","cluster_addr":"172.21.15.112:6805/3277557561","heartbeat_back_addr":"172.21.15.112:6809/3277557561","heartbeat_front_addr":"172.21.15.112:6807/3277557561","state":["exists","up"]},{"osd":1,"uuid":"eb484e98-9c69-4c55-84d6-096b231a6135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6811","nonce":3434501439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6813","nonce":3434501439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6817","nonce":3434501439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6815","nonce":3434501439}]},"public_addr":"172.21.15.112:6811/3434501439","cluster_addr":"172.21.15.112:6813/3434501439","heartbeat_back_addr":"172.21.15.112:6817/3434501439","heartbeat_front_addr":"172.21.15.112:6815/3434501439","state":["exists","up"]},{"osd":2,"uuid":"a751de5f-e823-4e5e-9843-a18b220be8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6819","nonce":799583119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6821","nonce":799583119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6825","nonce":799583119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6823","nonce":799583119}]},"public_addr":"172.21.15.112:6819/799583119","cluster_addr":"172.21.15.112:6821/799583119","heartbeat_back_addr":"172.21.15.112:6825/799583119","heartbeat_front_addr":"172.21.15.112:6823/799583119","state":["exists","up"]},{"osd":3,"uuid":"09598391-54ae-4362-9b9b-d61d813c967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6827","nonce":3674507612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6829","nonce":3674507612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6833","nonce":3674507612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6831","nonce":3674507612}]},"public_addr":"172.21.15.112:6827/3674507612","cluster_addr":"172.21.15.112:6829/3674507612","heartbeat_back_addr":"172.21.15.112:6833/3674507612","heartbeat_front_addr":"172.21.15.112:6831/3674507612","state":["exists","up"]},{"osd":4,"uuid":"f7a8fbce-2e6e-4ae0-8b21-53e294747dbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6801","nonce":3103692399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6803","nonce":3103692399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6807","nonce":3103692399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6805","nonce":3103692399}]},"public_addr":"172.21.15.142:6801/3103692399","cluster_addr":"172.21.15.142:6803/3103692399","heartbeat_back_addr":"172.21.15.142:6807/3103692399","heartbeat_front_addr":"172.21.15.142:6805/3103692399","state":["exists","up"]},{"osd":5,"uuid":"2bc6f6dd-7196-4779-86cb-679b6fc75a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6809","nonce":2168767914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6811","nonce":2168767914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6815","nonce":2168767914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6813","nonce":2168767914}]},"public_addr":"172.21.15.142:6809/2168767914","cluster_addr":"172.21.15.142:6811/2168767914","heartbeat_back_addr":"172.21.15.142:6815/2168767914","heartbeat_front_addr":"172.21.15.142:6813/2168767914","state":["exists","up"]},{"osd":6,"uuid":"a299c900-e42a-4a11-b6d9-ee294f904be5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6817","nonce":2191075949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6819","nonce":2191075949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6823","nonce":2191075949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6821","nonce":2191075949}]},"public_addr":"172.21.15.142:6817/2191075949","cluster_addr":"172.21.15.142:6819/2191075949","heartbeat_back_addr":"172.21.15.142:6823/2191075949","heartbeat_front_addr":"172.21.15.142:6821/2191075949","state":["exists","up"]},{"osd":7,"uuid":"12f6d2e1-a644-45cb-9df7-7b34880592a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6825","nonce":1647586049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6827","nonce":1647586049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6831","nonce":1647586049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6829","nonce":1647586049}]},"public_addr":"172.21.15.142:6825/1647586049","cluster_addr":"172.21.15.142:6827/1647586049","heartbeat_back_addr":"172.21.15.142:6831/1647586049","heartbeat_front_addr":"172.21.15.142:6829/1647586049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:43.252870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:02.184618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:20.587330+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:39.108894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:57.686832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:16.949114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:35.403363+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:54.052230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:0/2076151530":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3045630175":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3094970789":"2021-10-09T19:26:22.557570+0000","172.21.15.112:6800/3200748374":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/1685103696":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/1957878248":"2021-10-09T19:21:25.236574+0000","172.21.15.112:6801/3200748374":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3971619149":"2021-10-09T19:21:25.236574+0000","172.21.15.112:6801/1703752479":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/3398210384":"2021-10-09T19:26:22.557570+0000","172.21.15.112:6800/1703752479":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/3551391045":"2021-10-09T19:21:46.213537+0000","172.21.15.112:6800/1294788170":"2021-10-09T19:21:46.213537+0000","172.21.15.112:6801/1294788170":"2021-10-09T19:21:46.213537+0000","172.21.15.112:0/1446606652":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/158418565":"2021-10-09T19:21:46.213537+0000","172.21.15.112:0/3111657923":"2021-10-09T19:21:46.213537+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:26:35.989 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1cd40635e0 msgr2=0x7f1cd4065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.989 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1cd40635e0 0x7f1cd4065a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009050 tx=0x7f1cdc00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:35.989 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0fd480 msgr2=0x7f1cec0f5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0fd480 0x7f1cec0f5ba0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009470 tx=0x7f1ce0006ec0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.990 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 shutdown_connections 2021-10-08T19:26:35.991 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1cd40635e0 0x7f1cd4065a90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.991 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1cec0fde20 0x7f1cec116880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.992 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cec0f7c80 0x7f1cec0f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.992 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 --2- 172.21.15.112:0/4223842672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cec0fd480 0x7f1cec0f5ba0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:35.993 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 >> 172.21.15.112:0/4223842672 conn(0x7f1cec06e2e0 msgr2=0x7f1cec061960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:35.993 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 shutdown_connections 2021-10-08T19:26:35.994 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:35.988+0000 7f1ceb59e700 1 -- 172.21.15.112:0/4223842672 wait complete. 2021-10-08T19:26:36.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:26:36.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:35 smithi142 ceph-mon[33432]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2021-10-08T19:26:36.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4223842672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:35 smithi112 ceph-mon[40655]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2021-10-08T19:26:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4223842672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:36.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:35 smithi112 ceph-mon[31694]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2021-10-08T19:26:36.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4223842672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:26:36.765 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2021-10-08T19:24:24.578260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-10-08T19:26:02.182312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-10-08T19:26:02.734650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2021-10-08T19:26:04.175169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2021-10-08T19:26:06.145211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2021-10-08T19:26:08.191838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2021-10-08T19:26:36.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd pool get .mgr pg_num 2021-10-08T19:26:37.219 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:37.602 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:37 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:26:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:38.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:37 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:38.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:37 smithi142 ceph-mon[33432]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:38.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:37 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:38.320 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:26:38 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:26:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:38.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:37 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:38.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:37 smithi112 ceph-mon[31694]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:38.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:37 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:37 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:37 smithi112 ceph-mon[40655]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:37 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:38.642 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 -- 172.21.15.112:0/1115118637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00fdf40 msgr2=0x7fb3f00f7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.642 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1115118637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00fdf40 0x7fb3f00f7cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4004620 tx=0x7fb3e4009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:38.642 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 -- 172.21.15.112:0/1115118637 shutdown_connections 2021-10-08T19:26:38.642 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1115118637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3f00f8420 0x7fb3f0104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1115118637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3f00fd5a0 0x7fb3f00fd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1115118637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00fdf40 0x7fb3f00f7cf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 -- 172.21.15.112:0/1115118637 >> 172.21.15.112:0/1115118637 conn(0x7fb3f0070b90 msgr2=0x7fb3f00f4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 -- 172.21.15.112:0/1115118637 shutdown_connections 2021-10-08T19:26:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.638+0000 7fb3f6045700 1 -- 172.21.15.112:0/1115118637 wait complete. 2021-10-08T19:26:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3f6045700 1 Processor -- start 2021-10-08T19:26:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3f6045700 1 -- start start 2021-10-08T19:26:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3f6045700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00f8420 0x7fb3f0110a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3f6045700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3f00fd5a0 0x7fb3f0110fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3f6045700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3f00fdf40 0x7fb3f010ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3f6045700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f010b0d0 con 0x7fb3f00fd5a0 2021-10-08T19:26:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3f6045700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f010b210 con 0x7fb3f00fdf40 2021-10-08T19:26:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3f6045700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f010b3d0 con 0x7fb3f00f8420 2021-10-08T19:26:38.645 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3ef7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00f8420 0x7fb3f0110a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:38.646 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3ef7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00f8420 0x7fb3f0110a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56052/0 (socket says 172.21.15.112:56052) 2021-10-08T19:26:38.646 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3f00fd5a0 0x7fb3f0110fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:38.646 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.639+0000 7fb3ef7fe700 1 -- 172.21.15.112:0/1193526486 learned_addr learned my addr 172.21.15.112:0/1193526486 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:38.646 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3effff700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3f00fdf40 0x7fb3f010ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:38.646 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3ef7fe700 1 -- 172.21.15.112:0/1193526486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3f00fdf40 msgr2=0x7fb3f010ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.647 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3ef7fe700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3f00fdf40 0x7fb3f010ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.647 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3ef7fe700 1 -- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3f00fd5a0 msgr2=0x7fb3f0110fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.647 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3ef7fe700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3f00fd5a0 0x7fb3f0110fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.647 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3ef7fe700 1 -- 172.21.15.112:0/1193526486 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8009640 con 0x7fb3f00f8420 2021-10-08T19:26:38.648 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3eeffd700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3f00fd5a0 0x7fb3f0110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:38.648 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3ef7fe700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00f8420 0x7fb3f0110a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e870 tx=0x7fb3e000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:38.648 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3d7fff700 1 -- 172.21.15.112:0/1193526486 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00092e0 con 0x7fb3f00f8420 2021-10-08T19:26:38.648 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e4005040 con 0x7fb3f00f8420 2021-10-08T19:26:38.648 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3d7fff700 1 -- 172.21.15.112:0/1193526486 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb3e000f040 con 0x7fb3f00f8420 2021-10-08T19:26:38.649 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3d7fff700 1 -- 172.21.15.112:0/1193526486 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00146f0 con 0x7fb3f00f8420 2021-10-08T19:26:38.649 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.640+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f01178c0 con 0x7fb3f00f8420 2021-10-08T19:26:38.649 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.641+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f0047b50 con 0x7fb3f00f8420 2021-10-08T19:26:38.650 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.641+0000 7fb3d7fff700 1 -- 172.21.15.112:0/1193526486 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fb3e001b030 con 0x7fb3f00f8420 2021-10-08T19:26:38.650 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.642+0000 7fb3d7fff700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3d80635e0 0x7fb3d8065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:38.651 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.642+0000 7fb3d7fff700 1 -- 172.21.15.112:0/1193526486 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7fb3e007fa20 con 0x7fb3f00f8420 2021-10-08T19:26:38.651 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.642+0000 7fb3eeffd700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3d80635e0 0x7fb3d8065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:38.651 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.642+0000 7fb3eeffd700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3d80635e0 0x7fb3d8065a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009da0 tx=0x7fb3e4017040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:38.651 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.649+0000 7fb3d7fff700 1 -- 172.21.15.112:0/1193526486 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb3e0052120 con 0x7fb3f00f8420 2021-10-08T19:26:38.839 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.836+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3f010c070 con 0x7fb3f00f8420 2021-10-08T19:26:38.839 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.836+0000 7fb3d7fff700 1 -- 172.21.15.112:0/1193526486 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3e00190a0 con 0x7fb3f00f8420 2021-10-08T19:26:38.840 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2021-10-08T19:26:38.840 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.838+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3d80635e0 msgr2=0x7fb3d8065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.841 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.838+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3d80635e0 0x7fb3d8065a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009da0 tx=0x7fb3e4017040 comp rx=0 tx=0).stop 2021-10-08T19:26:38.841 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.838+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00f8420 msgr2=0x7fb3f0110a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:38.841 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.838+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00f8420 0x7fb3f0110a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e870 tx=0x7fb3e000b040 comp rx=0 tx=0).stop 2021-10-08T19:26:38.841 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.839+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 shutdown_connections 2021-10-08T19:26:38.842 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.839+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3d80635e0 0x7fb3d8065a90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.842 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.839+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3f00fdf40 0x7fb3f010ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.842 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.839+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3f00f8420 0x7fb3f0110a90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.842 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.839+0000 7fb3f6045700 1 --2- 172.21.15.112:0/1193526486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3f00fd5a0 0x7fb3f0110fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:38.842 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.839+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 >> 172.21.15.112:0/1193526486 conn(0x7fb3f0070b90 msgr2=0x7fb3f006dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:38.843 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.839+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 shutdown_connections 2021-10-08T19:26:38.843 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:38.839+0000 7fb3f6045700 1 -- 172.21.15.112:0/1193526486 wait complete. 2021-10-08T19:26:39.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:26:39.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:26:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:39.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:39.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:39.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:26:39.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:39.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:26:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:39.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:39.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: Deploying daemon node-exporter.a on smithi112 2021-10-08T19:26:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: poll took 12395.529 ms: 1 events 2021-10-08T19:26:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1193526486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:26:39.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:26:39.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:26:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:39.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:39.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:39.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:26:39.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:39.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:26:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:39.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:39.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:39.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:39.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: Deploying daemon node-exporter.a on smithi112 2021-10-08T19:26:39.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: poll took 12395.529 ms: 1 events 2021-10-08T19:26:39.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1193526486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:26:39.328 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:38 smithi112 systemd[1]: Starting Ceph node-exporter.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:26:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:26:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:26:37] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:26:39.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:26:39.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:26:39.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:26:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:26:39.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:26:39.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:26:39.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:39.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: Deploying daemon node-exporter.a on smithi112 2021-10-08T19:26:39.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: poll took 12395.529 ms: 1 events 2021-10-08T19:26:39.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1193526486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2021-10-08T19:26:39.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2021-10-08T19:26:39.821 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:39 smithi112 bash[67340]: Trying to pull quay.io/prometheus/node-exporter:v0.18.1... 2021-10-08T19:26:39.975 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:40.368 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:40 smithi112 ceph-mon[40655]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:40.368 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:40 smithi112 ceph-mon[31694]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:40.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:40 smithi142 ceph-mon[33432]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:41.070 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:40 smithi112 bash[67340]: Getting image source signatures 2021-10-08T19:26:41.432 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 -- 172.21.15.112:0/68057156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200f76b0 msgr2=0x7f4b200f7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 --2- 172.21.15.112:0/68057156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200f76b0 0x7f4b200f7b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b100046e0 tx=0x7f4b10009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 -- 172.21.15.112:0/68057156 shutdown_connections 2021-10-08T19:26:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 --2- 172.21.15.112:0/68057156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b200f8060 0x7f4b201043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 --2- 172.21.15.112:0/68057156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200fd610 0x7f4b200fd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 --2- 172.21.15.112:0/68057156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200f76b0 0x7f4b200f7b20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 -- 172.21.15.112:0/68057156 >> 172.21.15.112:0/68057156 conn(0x7f4b2006f370 msgr2=0x7f4b2006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 -- 172.21.15.112:0/68057156 shutdown_connections 2021-10-08T19:26:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.428+0000 7f4b277d7700 1 -- 172.21.15.112:0/68057156 wait complete. 2021-10-08T19:26:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b277d7700 1 Processor -- start 2021-10-08T19:26:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b277d7700 1 -- start start 2021-10-08T19:26:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b277d7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b200f76b0 0x7f4b20109930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b277d7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200f8060 0x7f4b20109e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b277d7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200fd610 0x7f4b201149b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b277d7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2010a6d0 con 0x7f4b200fd610 2021-10-08T19:26:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b277d7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20114ef0 con 0x7f4b200f8060 2021-10-08T19:26:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b277d7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20115030 con 0x7f4b200f76b0 2021-10-08T19:26:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25573700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b200f76b0 0x7f4b20109930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25d74700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200fd610 0x7f4b201149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25573700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b200f76b0 0x7f4b20109930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56092/0 (socket says 172.21.15.112:56092) 2021-10-08T19:26:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25573700 1 -- 172.21.15.112:0/3669154342 learned_addr learned my addr 172.21.15.112:0/3669154342 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b24d72700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200f8060 0x7f4b20109e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25573700 1 -- 172.21.15.112:0/3669154342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200f8060 msgr2=0x7f4b20109e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25573700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200f8060 0x7f4b20109e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25573700 1 -- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200fd610 msgr2=0x7f4b201149b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25573700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200fd610 0x7f4b201149b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25573700 1 -- 172.21.15.112:0/3669154342 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10005040 con 0x7f4b200f76b0 2021-10-08T19:26:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b24d72700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200f8060 0x7f4b20109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:26:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.429+0000 7f4b25d74700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200fd610 0x7f4b201149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.430+0000 7f4b25573700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b200f76b0 0x7f4b20109930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c002750 tx=0x7f4b1c009de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.430+0000 7f4b15ffb700 1 -- 172.21.15.112:0/3669154342 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0092e0 con 0x7f4b200f76b0 2021-10-08T19:26:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.430+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b20115290 con 0x7f4b200f76b0 2021-10-08T19:26:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.430+0000 7f4b15ffb700 1 -- 172.21.15.112:0/3669154342 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f4b1c00f040 con 0x7f4b200f76b0 2021-10-08T19:26:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.430+0000 7f4b15ffb700 1 -- 172.21.15.112:0/3669154342 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c013700 con 0x7f4b200f76b0 2021-10-08T19:26:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.430+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b20115780 con 0x7f4b200f76b0 2021-10-08T19:26:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.431+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b20047b50 con 0x7f4b200f76b0 2021-10-08T19:26:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.431+0000 7f4b15ffb700 1 -- 172.21.15.112:0/3669154342 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f4b1c0077b0 con 0x7f4b200f76b0 2021-10-08T19:26:41.441 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.431+0000 7f4b15ffb700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b0c0635e0 0x7f4b0c065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:41.441 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.432+0000 7f4b15ffb700 1 -- 172.21.15.112:0/3669154342 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f4b1c07ff40 con 0x7f4b200f76b0 2021-10-08T19:26:41.441 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.432+0000 7f4b24d72700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b0c0635e0 0x7f4b0c065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:41.442 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.432+0000 7f4b24d72700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b0c0635e0 0x7f4b0c065a90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4b20062380 tx=0x7f4b10009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:41.442 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.435+0000 7f4b15ffb700 1 -- 172.21.15.112:0/3669154342 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f4b1c052590 con 0x7f4b200f76b0 2021-10-08T19:26:41.595 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.594+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"} v 0) v1 -- 0x7f4b20062120 con 0x7f4b200f76b0 2021-10-08T19:26:41.596 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.595+0000 7f4b15ffb700 1 -- 172.21.15.112:0/3669154342 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]=0 v67) v1 ==== 98+0+11 (secure 0 0 0) 0x7f4b1c052180 con 0x7f4b200f76b0 2021-10-08T19:26:41.596 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2021-10-08T19:26:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b0c0635e0 msgr2=0x7f4b0c065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:41.597 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b0c0635e0 0x7f4b0c065a90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4b20062380 tx=0x7f4b10009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b200f76b0 msgr2=0x7f4b20109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b200f76b0 0x7f4b20109930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c002750 tx=0x7f4b1c009de0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 shutdown_connections 2021-10-08T19:26:41.598 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b0c0635e0 0x7f4b0c065a90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b200fd610 0x7f4b201149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b200f76b0 0x7f4b20109930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 --2- 172.21.15.112:0/3669154342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200f8060 0x7f4b20109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:41.599 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.596+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 >> 172.21.15.112:0/3669154342 conn(0x7f4b2006f370 msgr2=0x7f4b200f6240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.597+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 shutdown_connections 2021-10-08T19:26:41.600 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:41.597+0000 7f4b277d7700 1 -- 172.21.15.112:0/3669154342 wait complete. 2021-10-08T19:26:41.895 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:41 smithi112 bash[67340]: Copying blob sha256:49a2d53aa1af115e87f7e23a7fe4b7a3e12304d37982fb6528b035d0f68a3b56 2021-10-08T19:26:41.895 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:41 smithi112 bash[67340]: Copying blob sha256:3589a6efd9ce96b2f2218a80bacb84f60d5e584d024023617b0f56b87fe798c3 2021-10-08T19:26:42.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:42 smithi112 ceph-mon[40655]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:42.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3669154342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:26:42.322 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:41 smithi112 bash[67340]: Copying blob sha256:190160031744b0810999dd6f293478be0b41524654c70782cf09437095430f2f 2021-10-08T19:26:42.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:42 smithi112 ceph-mon[31694]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:42.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3669154342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:26:42.379 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd pool get iscsi pg_num 2021-10-08T19:26:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:42 smithi142 ceph-mon[33432]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3669154342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-10-08T19:26:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:44.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:44 smithi112 ceph-mon[40655]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:44.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:44 smithi112 ceph-mon[31694]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:44.323 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:44 smithi112 bash[67340]: Copying config sha256:e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87 2021-10-08T19:26:44.324 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:44 smithi112 bash[67340]: Writing manifest to image destination 2021-10-08T19:26:44.324 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:44 smithi112 bash[67340]: Storing signatures 2021-10-08T19:26:44.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:44 smithi142 ceph-mon[33432]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:44.879 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 -- 172.21.15.112:0/186044263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000f7880 msgr2=0x7fed00105550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:44.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 --2- 172.21.15.112:0/186044263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000f7880 0x7fed00105550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009a60 tx=0x7fecf8004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:44.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 -- 172.21.15.112:0/186044263 shutdown_connections 2021-10-08T19:26:44.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 --2- 172.21.15.112:0/186044263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000f7880 0x7fed00105550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:44.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 --2- 172.21.15.112:0/186044263 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed000fe7f0 0x7fed000febc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:44.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 --2- 172.21.15.112:0/186044263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed000f6ed0 0x7fed000f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 -- 172.21.15.112:0/186044263 >> 172.21.15.112:0/186044263 conn(0x7fed0006cf40 msgr2=0x7fed0006d340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 -- 172.21.15.112:0/186044263 shutdown_connections 2021-10-08T19:26:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 -- 172.21.15.112:0/186044263 wait complete. 2021-10-08T19:26:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.876+0000 7fed061d3700 1 Processor -- start 2021-10-08T19:26:44.882 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fed061d3700 1 -- start start 2021-10-08T19:26:44.882 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fed061d3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed000f6ed0 0x7fed000f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:44.882 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fed061d3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed000f7880 0x7fed000f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:44.882 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fed061d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000fe7f0 0x7fed000f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:44.882 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fed061d3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed00116c50 con 0x7fed000fe7f0 2021-10-08T19:26:44.883 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fed061d3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed00116dc0 con 0x7fed000f6ed0 2021-10-08T19:26:44.883 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fed061d3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed00116f80 con 0x7fed000f7880 2021-10-08T19:26:44.883 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed000f7880 0x7fed000f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:44.883 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000fe7f0 0x7fed000f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:44.884 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed000f7880 0x7fed000f85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56106/0 (socket says 172.21.15.112:56106) 2021-10-08T19:26:44.884 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 -- 172.21.15.112:0/1078306981 learned_addr learned my addr 172.21.15.112:0/1078306981 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:44.884 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecff7fe700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed000f6ed0 0x7fed000f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:44.885 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 -- 172.21.15.112:0/1078306981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed000f6ed0 msgr2=0x7fed000f80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:44.885 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed000f6ed0 0x7fed000f80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:44.885 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 -- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000fe7f0 msgr2=0x7fed000f8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:44.885 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000fe7f0 0x7fed000f8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:44.885 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 -- 172.21.15.112:0/1078306981 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8009640 con 0x7fed000f7880 2021-10-08T19:26:44.886 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecff7fe700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed000f6ed0 0x7fed000f80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:26:44.886 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfffff700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000fe7f0 0x7fed000f8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:44.886 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fecfeffd700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed000f7880 0x7fed000f85f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fecf400c5b0 tx=0x7fecf4007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:44.886 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fece3fff700 1 -- 172.21.15.112:0/1078306981 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4016070 con 0x7fed000f7880 2021-10-08T19:26:44.887 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fece3fff700 1 -- 172.21.15.112:0/1078306981 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fecf4007e90 con 0x7fed000f7880 2021-10-08T19:26:44.887 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.877+0000 7fece3fff700 1 -- 172.21.15.112:0/1078306981 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4012850 con 0x7fed000f7880 2021-10-08T19:26:44.887 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.878+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed00117260 con 0x7fed000f7880 2021-10-08T19:26:44.887 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.878+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed00117700 con 0x7fed000f7880 2021-10-08T19:26:44.887 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.879+0000 7fece3fff700 1 -- 172.21.15.112:0/1078306981 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fecf4010050 con 0x7fed000f7880 2021-10-08T19:26:44.888 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.879+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed00047b50 con 0x7fed000f7880 2021-10-08T19:26:44.889 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.879+0000 7fece3fff700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fece80635e0 0x7fece8065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:44.889 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.879+0000 7fece3fff700 1 -- 172.21.15.112:0/1078306981 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7fecf407fc20 con 0x7fed000f7880 2021-10-08T19:26:44.889 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.879+0000 7fecff7fe700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fece80635e0 0x7fece8065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:44.889 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.880+0000 7fecff7fe700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fece80635e0 0x7fece8065a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fecf0007fc0 tx=0x7fecf000b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:44.890 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:44.883+0000 7fece3fff700 1 -- 172.21.15.112:0/1078306981 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fecf4052270 con 0x7fed000f7880 2021-10-08T19:26:45.046 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.045+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"} v 0) v1 -- 0x7fed000f9610 con 0x7fed000f7880 2021-10-08T19:26:45.046 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.045+0000 7fece3fff700 1 -- 172.21.15.112:0/1078306981 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]=0 v67) v1 ==== 94+0+10 (secure 0 0 0) 0x7fecf4051e60 con 0x7fed000f7880 2021-10-08T19:26:45.047 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 3 2021-10-08T19:26:45.048 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fece80635e0 msgr2=0x7fece8065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:45.048 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fece80635e0 0x7fece8065a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fecf0007fc0 tx=0x7fecf000b040 comp rx=0 tx=0).stop 2021-10-08T19:26:45.048 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed000f7880 msgr2=0x7fed000f85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:45.049 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed000f7880 0x7fed000f85f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fecf400c5b0 tx=0x7fecf4007e20 comp rx=0 tx=0).stop 2021-10-08T19:26:45.049 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 shutdown_connections 2021-10-08T19:26:45.049 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fece80635e0 0x7fece8065a90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:45.049 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed000fe7f0 0x7fed000f8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:45.050 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed000f6ed0 0x7fed000f80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:45.050 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 --2- 172.21.15.112:0/1078306981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed000f7880 0x7fed000f85f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:45.051 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 >> 172.21.15.112:0/1078306981 conn(0x7fed0006cf40 msgr2=0x7fed000fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:45.051 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 shutdown_connections 2021-10-08T19:26:45.052 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:45.047+0000 7fed061d3700 1 -- 172.21.15.112:0/1078306981 wait complete. 2021-10-08T19:26:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1078306981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:26:45.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1078306981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:26:45.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1078306981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-10-08T19:26:46.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.log pg_num 2021-10-08T19:26:46.272 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:46 smithi112 ceph-mon[40655]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:46.273 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:46 smithi112 ceph-mon[31694]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:46.274 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-10-08T19:26:46.274 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-10-08T19:26:46.274 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-10-08T19:26:46.274 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-10-08T19:26:46.275 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-10-08T19:26:46.275 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-10-08T19:26:46.275 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-10-08T19:26:46.275 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-10-08T19:26:46.276 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-10-08T19:26:46.276 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-10-08T19:26:46.276 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-10-08T19:26:46.276 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-10-08T19:26:46.276 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-10-08T19:26:46.277 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-10-08T19:26:46.277 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-10-08T19:26:46.278 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-10-08T19:26:46.278 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-10-08T19:26:46.278 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-10-08T19:26:46.278 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-10-08T19:26:46.279 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-10-08T19:26:46.279 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-10-08T19:26:46.279 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-10-08T19:26:46.280 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-10-08T19:26:46.280 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-10-08T19:26:46.280 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-10-08T19:26:46.281 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-10-08T19:26:46.281 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-10-08T19:26:46.281 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-10-08T19:26:46.281 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-10-08T19:26:46.281 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - time" source="node_exporter.go:104" 2021-10-08T19:26:46.282 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-10-08T19:26:46.282 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-10-08T19:26:46.283 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-10-08T19:26:46.283 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-10-08T19:26:46.284 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 conmon[68297]: time="2021-10-08T19:26:46Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-10-08T19:26:46.284 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 bash[67340]: b17dc960b33f10cea6208b1024191b3e79636e6a17693efa52b9bfbdcea14dfe 2021-10-08T19:26:46.375 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:26:46.375 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:46 smithi142 ceph-mon[33432]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:46.570 INFO:journalctl@ceph.node-exporter.a.smithi112.stdout:Oct 08 19:26:46 smithi112 systemd[1]: Started Ceph node-exporter.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:26:46.576 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:47.273 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:47 smithi142 systemd[1]: Starting Ceph node-exporter.b for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:26:47.774 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:47 smithi142 bash[60952]: Trying to pull quay.io/prometheus/node-exporter:v0.18.1... 2021-10-08T19:26:47.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:47 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:47.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:47 smithi142 ceph-mon[33432]: poll took 7697.208 ms: 1 events 2021-10-08T19:26:47.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:47 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:47.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:47 smithi142 ceph-mon[33432]: Deploying daemon node-exporter.b on smithi142 2021-10-08T19:26:47.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:47 smithi142 ceph-mon[33432]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:47.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:47.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[40655]: poll took 7697.208 ms: 1 events 2021-10-08T19:26:47.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:47.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[40655]: Deploying daemon node-exporter.b on smithi142 2021-10-08T19:26:47.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[40655]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:47.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:47.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[31694]: poll took 7697.208 ms: 1 events 2021-10-08T19:26:47.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:47.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[31694]: Deploying daemon node-exporter.b on smithi142 2021-10-08T19:26:47.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:47 smithi112 ceph-mon[31694]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:48.078 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 -- 172.21.15.112:0/704779352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480f8f10 msgr2=0x7fdf481055b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:48.079 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 --2- 172.21.15.112:0/704779352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480f8f10 0x7fdf481055b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdf40004710 tx=0x7fdf40009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:48.079 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 -- 172.21.15.112:0/704779352 shutdown_connections 2021-10-08T19:26:48.079 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 --2- 172.21.15.112:0/704779352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480f8f10 0x7fdf481055b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.079 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 --2- 172.21.15.112:0/704779352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf480fe790 0x7fdf480feb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.080 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 --2- 172.21.15.112:0/704779352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf480ff130 0x7fdf480f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.080 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 -- 172.21.15.112:0/704779352 >> 172.21.15.112:0/704779352 conn(0x7fdf4806e3a0 msgr2=0x7fdf480f6830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:48.080 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 -- 172.21.15.112:0/704779352 shutdown_connections 2021-10-08T19:26:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.076+0000 7fdf4da14700 1 -- 172.21.15.112:0/704779352 wait complete. 2021-10-08T19:26:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf4da14700 1 Processor -- start 2021-10-08T19:26:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf4da14700 1 -- start start 2021-10-08T19:26:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf4da14700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf480f8f10 0x7fdf4810e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:48.082 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf4da14700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf480fe790 0x7fdf4810eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:48.082 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf4da14700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480ff130 0x7fdf481086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:48.082 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf4da14700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48108c70 con 0x7fdf480ff130 2021-10-08T19:26:48.082 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf4da14700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48108de0 con 0x7fdf480f8f10 2021-10-08T19:26:48.083 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf4da14700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48108fa0 con 0x7fdf480fe790 2021-10-08T19:26:48.083 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480ff130 0x7fdf481086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:48.083 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf467fc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf480fe790 0x7fdf4810eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:48.084 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480ff130 0x7fdf481086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34160/0 (socket says 172.21.15.112:34160) 2021-10-08T19:26:48.084 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 -- 172.21.15.112:0/1264355516 learned_addr learned my addr 172.21.15.112:0/1264355516 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:48.085 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf46ffd700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf480f8f10 0x7fdf4810e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:48.085 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 -- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf480fe790 msgr2=0x7fdf4810eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:48.085 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf480fe790 0x7fdf4810eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.085 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 -- 172.21.15.112:0/1264355516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf480f8f10 msgr2=0x7fdf4810e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:48.086 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf480f8f10 0x7fdf4810e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.086 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 -- 172.21.15.112:0/1264355516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf38009640 con 0x7fdf480ff130 2021-10-08T19:26:48.086 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf467fc700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf480fe790 0x7fdf4810eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:48.087 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.077+0000 7fdf477fe700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480ff130 0x7fdf481086a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdf40004df0 tx=0x7fdf40009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:48.087 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.078+0000 7fdf3f7fe700 1 -- 172.21.15.112:0/1264355516 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4001a070 con 0x7fdf480ff130 2021-10-08T19:26:48.087 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.078+0000 7fdf3f7fe700 1 -- 172.21.15.112:0/1264355516 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fdf40004180 con 0x7fdf480ff130 2021-10-08T19:26:48.087 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.078+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf40005040 con 0x7fdf480ff130 2021-10-08T19:26:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.078+0000 7fdf3f7fe700 1 -- 172.21.15.112:0/1264355516 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4001e720 con 0x7fdf480ff130 2021-10-08T19:26:48.088 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.078+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf481153d0 con 0x7fdf480ff130 2021-10-08T19:26:48.089 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.079+0000 7fdf3f7fe700 1 -- 172.21.15.112:0/1264355516 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fdf40007920 con 0x7fdf480ff130 2021-10-08T19:26:48.089 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.079+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf48047b50 con 0x7fdf480ff130 2021-10-08T19:26:48.089 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.079+0000 7fdf3f7fe700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf340635e0 0x7fdf34065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:48.090 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.079+0000 7fdf3f7fe700 1 -- 172.21.15.112:0/1264355516 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7fdf400808b0 con 0x7fdf480ff130 2021-10-08T19:26:48.090 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.079+0000 7fdf46ffd700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf340635e0 0x7fdf34065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:48.090 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.080+0000 7fdf46ffd700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf340635e0 0x7fdf34065a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf38001450 tx=0x7fdf38004c50 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:48.090 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.083+0000 7fdf3f7fe700 1 -- 172.21.15.112:0/1264355516 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fdf40052ff0 con 0x7fdf480ff130 2021-10-08T19:26:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.242+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"} v 0) v1 -- 0x7fdf48109bb0 con 0x7fdf480ff130 2021-10-08T19:26:48.243 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.242+0000 7fdf3f7fe700 1 -- 172.21.15.112:0/1264355516 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf40023020 con 0x7fdf480ff130 2021-10-08T19:26:48.244 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2021-10-08T19:26:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf340635e0 msgr2=0x7fdf34065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf340635e0 0x7fdf34065a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf38001450 tx=0x7fdf38004c50 comp rx=0 tx=0).stop 2021-10-08T19:26:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480ff130 msgr2=0x7fdf481086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:48.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480ff130 0x7fdf481086a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdf40004df0 tx=0x7fdf40009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:48.246 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 shutdown_connections 2021-10-08T19:26:48.246 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf340635e0 0x7fdf34065a90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.246 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf480ff130 0x7fdf481086a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf480f8f10 0x7fdf4810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 --2- 172.21.15.112:0/1264355516 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf480fe790 0x7fdf4810eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:48.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 >> 172.21.15.112:0/1264355516 conn(0x7fdf4806e3a0 msgr2=0x7fdf4806f600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:48.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 shutdown_connections 2021-10-08T19:26:48.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:48.244+0000 7fdf4da14700 1 -- 172.21.15.112:0/1264355516 wait complete. 2021-10-08T19:26:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1264355516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:26:48.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1264355516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:26:48.773 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:48 smithi142 bash[60952]: Getting image source signatures 2021-10-08T19:26:48.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1264355516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2021-10-08T19:26:48.979 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.control pg_num 2021-10-08T19:26:49.415 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:49.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:49 smithi142 ceph-mon[33432]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:49.774 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:49 smithi142 bash[60952]: Copying blob sha256:190160031744b0810999dd6f293478be0b41524654c70782cf09437095430f2f 2021-10-08T19:26:49.774 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:49 smithi142 bash[60952]: Copying blob sha256:49a2d53aa1af115e87f7e23a7fe4b7a3e12304d37982fb6528b035d0f68a3b56 2021-10-08T19:26:49.775 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:49 smithi142 bash[60952]: Copying blob sha256:3589a6efd9ce96b2f2218a80bacb84f60d5e584d024023617b0f56b87fe798c3 2021-10-08T19:26:49.785 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:49 smithi112 ceph-mon[40655]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:49.786 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:49 smithi112 ceph-mon[31694]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:50.864 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 -- 172.21.15.112:0/4288458687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0102cc0 msgr2=0x7f1ed01050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:50.865 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 --2- 172.21.15.112:0/4288458687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0102cc0 0x7f1ed01050a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009a60 tx=0x7f1ec8004d10 comp rx=0 tx=0).stop 2021-10-08T19:26:50.865 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 -- 172.21.15.112:0/4288458687 shutdown_connections 2021-10-08T19:26:50.865 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 --2- 172.21.15.112:0/4288458687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0102cc0 0x7f1ed01050a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.866 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 --2- 172.21.15.112:0/4288458687 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed00f9710 0x7f1ed00f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.866 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 --2- 172.21.15.112:0/4288458687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed00fa0b0 0x7f1ed0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.866 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 -- 172.21.15.112:0/4288458687 >> 172.21.15.112:0/4288458687 conn(0x7f1ed006e2d0 msgr2=0x7f1ed00f5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:50.867 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 -- 172.21.15.112:0/4288458687 shutdown_connections 2021-10-08T19:26:50.867 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.859+0000 7f1ed7447700 1 -- 172.21.15.112:0/4288458687 wait complete. 2021-10-08T19:26:50.867 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed7447700 1 Processor -- start 2021-10-08T19:26:50.867 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed7447700 1 -- start start 2021-10-08T19:26:50.867 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed7447700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed00f9710 0x7f1ed010e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:50.868 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed7447700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed00fa0b0 0x7f1ed010ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:50.868 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed7447700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed0102cc0 0x7f1ed0108790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:50.868 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed7447700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0108d10 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.869 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed7447700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0108e80 con 0x7f1ed00f9710 2021-10-08T19:26:50.869 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed7447700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0109040 con 0x7f1ed0102cc0 2021-10-08T19:26:50.869 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed49e2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed00fa0b0 0x7f1ed010ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:50.870 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed59e4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed0102cc0 0x7f1ed0108790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:50.870 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed49e2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed00fa0b0 0x7f1ed010ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34170/0 (socket says 172.21.15.112:34170) 2021-10-08T19:26:50.871 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed49e2700 1 -- 172.21.15.112:0/3385817902 learned_addr learned my addr 172.21.15.112:0/3385817902 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:50.871 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed59e4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed0102cc0 0x7f1ed0108790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56132/0 (socket says 172.21.15.112:56132) 2021-10-08T19:26:50.871 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed51e3700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed00f9710 0x7f1ed010e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:50.871 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed49e2700 1 -- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed0102cc0 msgr2=0x7f1ed0108790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:50.872 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed49e2700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed0102cc0 0x7f1ed0108790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.872 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed49e2700 1 -- 172.21.15.112:0/3385817902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed00f9710 msgr2=0x7f1ed010e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:50.872 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed49e2700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed00f9710 0x7f1ed010e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:50.872 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed49e2700 1 -- 172.21.15.112:0/3385817902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009640 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.872 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.860+0000 7f1ed59e4700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed0102cc0 0x7f1ed0108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:50.873 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.861+0000 7f1ed49e2700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed00fa0b0 0x7f1ed010ebe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0002780 tx=0x7f1ec0009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:50.873 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.861+0000 7f1ec5ffb700 1 -- 172.21.15.112:0/3385817902 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00092e0 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.873 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.861+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed0109320 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.873 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.861+0000 7f1ec5ffb700 1 -- 172.21.15.112:0/3385817902 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1ec000f040 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.874 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.861+0000 7f1ec5ffb700 1 -- 172.21.15.112:0/3385817902 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0013700 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.874 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.861+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed01156d0 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.874 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.862+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed0047b50 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.874 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.863+0000 7f1ec5ffb700 1 -- 172.21.15.112:0/3385817902 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f1ec001a030 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.875 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.863+0000 7f1ec5ffb700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ebc0635e0 0x7f1ebc065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:50.875 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.863+0000 7f1ec5ffb700 1 -- 172.21.15.112:0/3385817902 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f1ec007f570 con 0x7f1ed00fa0b0 2021-10-08T19:26:50.875 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.863+0000 7f1ed51e3700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ebc0635e0 0x7f1ebc065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:50.875 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.863+0000 7f1ed51e3700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ebc0635e0 0x7f1ebc065a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009fd0 tx=0x7f1ecc00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:50.876 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:50.867+0000 7f1ec5ffb700 1 -- 172.21.15.112:0/3385817902 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1ec0047b00 con 0x7f1ed00fa0b0 2021-10-08T19:26:51.026 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.025+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"} v 0) v1 -- 0x7f1ed0109d90 con 0x7f1ed00fa0b0 2021-10-08T19:26:51.026 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.025+0000 7f1ec5ffb700 1 -- 172.21.15.112:0/3385817902 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]=0 v67) v1 ==== 108+0+11 (secure 0 0 0) 0x7f1ec00180b0 con 0x7f1ed00fa0b0 2021-10-08T19:26:51.027 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2021-10-08T19:26:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ebc0635e0 msgr2=0x7f1ebc065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ebc0635e0 0x7f1ebc065a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009fd0 tx=0x7f1ecc00b040 comp rx=0 tx=0).stop 2021-10-08T19:26:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed00fa0b0 msgr2=0x7f1ed010ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed00fa0b0 0x7f1ed010ebe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0002780 tx=0x7f1ec0009e00 comp rx=0 tx=0).stop 2021-10-08T19:26:51.029 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 shutdown_connections 2021-10-08T19:26:51.029 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ebc0635e0 0x7f1ebc065a90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:51.029 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed0102cc0 0x7f1ed0108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:51.029 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed00f9710 0x7f1ed010e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:51.029 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 --2- 172.21.15.112:0/3385817902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed00fa0b0 0x7f1ed010ebe0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:51.030 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 >> 172.21.15.112:0/3385817902 conn(0x7f1ed006e2d0 msgr2=0x7f1ed00fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 shutdown_connections 2021-10-08T19:26:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:51.027+0000 7f1ed7447700 1 -- 172.21.15.112:0/3385817902 wait complete. 2021-10-08T19:26:51.719 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd pool get default.rgw.meta pg_num 2021-10-08T19:26:51.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:51 smithi142 ceph-mon[33432]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3385817902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:26:51.773 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:51 smithi142 bash[60952]: Copying config sha256:e5a616e4b9cf68dfcad7782b78e118be4310022e874d52da85c55923fb615f87 2021-10-08T19:26:51.774 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:51 smithi142 bash[60952]: Writing manifest to image destination 2021-10-08T19:26:51.774 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:51 smithi142 bash[60952]: Storing signatures 2021-10-08T19:26:52.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:51 smithi112 ceph-mon[40655]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:52.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3385817902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:26:52.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:51 smithi112 ceph-mon[31694]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:52.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3385817902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2021-10-08T19:26:52.151 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:52.949 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-10-08T19:26:52.950 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-10-08T19:26:52.950 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-10-08T19:26:52.950 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-10-08T19:26:52.950 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-10-08T19:26:52.951 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-10-08T19:26:52.951 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-10-08T19:26:52.951 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-10-08T19:26:52.951 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-10-08T19:26:52.951 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-10-08T19:26:52.952 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-10-08T19:26:52.952 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-10-08T19:26:52.952 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-10-08T19:26:52.952 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-10-08T19:26:52.952 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-10-08T19:26:52.953 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-10-08T19:26:52.953 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-10-08T19:26:52.953 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-10-08T19:26:52.953 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-10-08T19:26:52.954 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-10-08T19:26:52.954 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-10-08T19:26:52.954 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-10-08T19:26:52.954 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-10-08T19:26:52.955 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-10-08T19:26:52.955 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-10-08T19:26:52.955 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-10-08T19:26:52.955 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-10-08T19:26:52.956 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-10-08T19:26:52.956 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-10-08T19:26:52.956 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - time" source="node_exporter.go:104" 2021-10-08T19:26:52.956 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-10-08T19:26:52.956 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-10-08T19:26:52.957 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-10-08T19:26:52.957 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-10-08T19:26:52.957 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 conmon[61175]: time="2021-10-08T19:26:52Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-10-08T19:26:52.957 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 bash[60952]: c34e74facd849c64be4e8b402883138c6f4a2a1a42eff7e6f9b6486779329e4f 2021-10-08T19:26:53.273 INFO:journalctl@ceph.node-exporter.b.smithi142.stdout:Oct 08 19:26:52 smithi142 systemd[1]: Started Ceph node-exporter.b for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:26:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 -- 172.21.15.112:0/2180156553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40fdf70 msgr2=0x7fefa40f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.595 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2180156553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40fdf70 0x7fefa40f7680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef90004760 tx=0x7fef90009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:53.601 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 -- 172.21.15.112:0/2180156553 shutdown_connections 2021-10-08T19:26:53.601 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2180156553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa40f7d60 0x7fefa41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.602 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2180156553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefa40fd5d0 0x7fefa40fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.602 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2180156553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40fdf70 0x7fefa40f7680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.602 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 -- 172.21.15.112:0/2180156553 >> 172.21.15.112:0/2180156553 conn(0x7fefa406f330 msgr2=0x7fefa406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:53.602 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 -- 172.21.15.112:0/2180156553 shutdown_connections 2021-10-08T19:26:53.603 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.593+0000 7fefab0f3700 1 -- 172.21.15.112:0/2180156553 wait complete. 2021-10-08T19:26:53.603 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefab0f3700 1 Processor -- start 2021-10-08T19:26:53.603 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefab0f3700 1 -- start start 2021-10-08T19:26:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefab0f3700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40f7d60 0x7fefa410c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefab0f3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa40fd5d0 0x7fefa410cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefab0f3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefa40fdf70 0x7fefa4106720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefab0f3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa4106d70 con 0x7fefa40fd5d0 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefab0f3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa4106ee0 con 0x7fefa40fdf70 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefab0f3700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa41070a0 con 0x7fefa40f7d60 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefa8e8f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40f7d60 0x7fefa410c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:53.607 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefa3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa40fd5d0 0x7fefa410cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefa8e8f700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40f7d60 0x7fefa410c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56142/0 (socket says 172.21.15.112:56142) 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefa3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa40fd5d0 0x7fefa410cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34184/0 (socket says 172.21.15.112:34184) 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefa8e8f700 1 -- 172.21.15.112:0/2906660974 learned_addr learned my addr 172.21.15.112:0/2906660974 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.594+0000 7fefa9690700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefa40fdf70 0x7fefa4106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa8e8f700 1 -- 172.21.15.112:0/2906660974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefa40fdf70 msgr2=0x7fefa4106720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa8e8f700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefa40fdf70 0x7fefa4106720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa8e8f700 1 -- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa40fd5d0 msgr2=0x7fefa410cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa8e8f700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa40fd5d0 0x7fefa410cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.609 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa8e8f700 1 -- 172.21.15.112:0/2906660974 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c009640 con 0x7fefa40f7d60 2021-10-08T19:26:53.610 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa8e8f700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40f7d60 0x7fefa410c650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef9800e870 tx=0x7fef9800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:53.610 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa17fa700 1 -- 172.21.15.112:0/2906660974 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980092e0 con 0x7fefa40f7d60 2021-10-08T19:26:53.610 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa17fa700 1 -- 172.21.15.112:0/2906660974 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fef9800f040 con 0x7fefa40f7d60 2021-10-08T19:26:53.610 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90005040 con 0x7fefa40f7d60 2021-10-08T19:26:53.612 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefa17fa700 1 -- 172.21.15.112:0/2906660974 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980146f0 con 0x7fefa40f7d60 2021-10-08T19:26:53.619 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.595+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa4113450 con 0x7fefa40f7d60 2021-10-08T19:26:53.619 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.596+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa4047b50 con 0x7fefa40f7d60 2021-10-08T19:26:53.619 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.596+0000 7fefa17fa700 1 -- 172.21.15.112:0/2906660974 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fef9801b030 con 0x7fefa40f7d60 2021-10-08T19:26:53.620 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.596+0000 7fefa17fa700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fef940635e0 0x7fef94065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:53.620 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.597+0000 7fefa17fa700 1 -- 172.21.15.112:0/2906660974 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7fef9807f990 con 0x7fefa40f7d60 2021-10-08T19:26:53.621 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.597+0000 7fefa3fff700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fef940635e0 0x7fef94065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:53.622 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.597+0000 7fefa3fff700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fef940635e0 0x7fef94065a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef90004dd0 tx=0x7fef90009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:53.630 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.601+0000 7fefa17fa700 1 -- 172.21.15.112:0/2906660974 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fef98052090 con 0x7fefa40f7d60 2021-10-08T19:26:53.761 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.760+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"} v 0) v1 -- 0x7fefa4107c30 con 0x7fefa40f7d60 2021-10-08T19:26:53.761 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.760+0000 7fefa17fa700 1 -- 172.21.15.112:0/2906660974 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]=0 v67) v1 ==== 105+0+11 (secure 0 0 0) 0x7fef98051c80 con 0x7fefa40f7d60 2021-10-08T19:26:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2021-10-08T19:26:53.763 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fef940635e0 msgr2=0x7fef94065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.763 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fef940635e0 0x7fef94065a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef90004dd0 tx=0x7fef90009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:53.763 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40f7d60 msgr2=0x7fefa410c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40f7d60 0x7fefa410c650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef9800e870 tx=0x7fef9800b040 comp rx=0 tx=0).stop 2021-10-08T19:26:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 shutdown_connections 2021-10-08T19:26:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fef940635e0 0x7fef94065a90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefa40fdf70 0x7fefa4106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fefa40f7d60 0x7fefa410c650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 --2- 172.21.15.112:0/2906660974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa40fd5d0 0x7fefa410cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 >> 172.21.15.112:0/2906660974 conn(0x7fefa406f330 msgr2=0x7fefa40f6740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 shutdown_connections 2021-10-08T19:26:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:53.762+0000 7fefab0f3700 1 -- 172.21.15.112:0/2906660974 wait complete. 2021-10-08T19:26:54.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[40655]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:54.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[40655]: poll took 6206.608 ms: 1 events 2021-10-08T19:26:54.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:54.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[40655]: Sending message to agent on host smithi112 2021-10-08T19:26:54.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[40655]: Sending message to agent on host smithi142 2021-10-08T19:26:54.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[40655]: Deploying daemon prometheus.a on smithi142 2021-10-08T19:26:54.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2906660974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:26:54.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[31694]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:54.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[31694]: poll took 6206.608 ms: 1 events 2021-10-08T19:26:54.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:54.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[31694]: Sending message to agent on host smithi112 2021-10-08T19:26:54.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[31694]: Sending message to agent on host smithi142 2021-10-08T19:26:54.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[31694]: Deploying daemon prometheus.a on smithi142 2021-10-08T19:26:54.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2906660974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:26:54.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:54 smithi142 ceph-mon[33432]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:54.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:54 smithi142 ceph-mon[33432]: poll took 6206.608 ms: 1 events 2021-10-08T19:26:54.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:54 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:54.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:54 smithi142 ceph-mon[33432]: Sending message to agent on host smithi112 2021-10-08T19:26:54.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:54 smithi142 ceph-mon[33432]: Sending message to agent on host smithi142 2021-10-08T19:26:54.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:54 smithi142 ceph-mon[33432]: Deploying daemon prometheus.a on smithi142 2021-10-08T19:26:54.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2906660974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2021-10-08T19:26:54.460 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-10-08T19:26:54.462 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-10-08T19:26:54.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph mgr dump --format=json 2021-10-08T19:26:54.897 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:55.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:55 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:55.298 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:55 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:55.299 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:55 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi142 2021-10-08T19:26:56.225 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:56 smithi112 ceph-mon[40655]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:56.225 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:56 smithi112 ceph-mon[31694]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:56.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:56 smithi142 ceph-mon[33432]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:26:56.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:26:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:26:57.029 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:57 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:57.030 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:57 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:57.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.032+0000 7f045e869700 1 -- 172.21.15.112:0/2029313312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580f7570 msgr2=0x7f04580fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:57.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.032+0000 7f045e869700 1 --2- 172.21.15.112:0/2029313312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580f7570 0x7f04580fc1b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04480046e0 tx=0x7f0448009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:57.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.033+0000 7f045e869700 1 -- 172.21.15.112:0/2029313312 shutdown_connections 2021-10-08T19:26:57.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.033+0000 7f045e869700 1 --2- 172.21.15.112:0/2029313312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04580fc8e0 0x7f04580fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.033+0000 7f045e869700 1 --2- 172.21.15.112:0/2029313312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04580f6bd0 0x7f04580f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.033+0000 7f045e869700 1 --2- 172.21.15.112:0/2029313312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580f7570 0x7f04580fc1b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.033+0000 7f045e869700 1 -- 172.21.15.112:0/2029313312 >> 172.21.15.112:0/2029313312 conn(0x7f045806d880 msgr2=0x7f04580f4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:57.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.033+0000 7f045e869700 1 -- 172.21.15.112:0/2029313312 shutdown_connections 2021-10-08T19:26:57.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.033+0000 7f045e869700 1 -- 172.21.15.112:0/2029313312 wait complete. 2021-10-08T19:26:57.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.034+0000 7f045e869700 1 Processor -- start 2021-10-08T19:26:57.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.034+0000 7f045e869700 1 -- start start 2021-10-08T19:26:57.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.034+0000 7f045e869700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04580f6bd0 0x7f0458114ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:57.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.034+0000 7f045e869700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04580f7570 0x7f0458115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:57.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.034+0000 7f045e869700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580fc8e0 0x7f045810edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:57.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.034+0000 7f045e869700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045810f360 con 0x7f04580fc8e0 2021-10-08T19:26:57.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.034+0000 7f045e869700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045810f4d0 con 0x7f04580f6bd0 2021-10-08T19:26:57.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.034+0000 7f045e869700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045810f690 con 0x7f04580f7570 2021-10-08T19:26:57.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d867700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04580f6bd0 0x7f0458114ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:57.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045e068700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580fc8e0 0x7f045810edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:57.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d867700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04580f6bd0 0x7f0458114ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.112:53372/0 (socket says 172.21.15.112:53372) 2021-10-08T19:26:57.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d066700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04580f7570 0x7f0458115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:57.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d867700 1 -- 172.21.15.112:0/1319306925 learned_addr learned my addr 172.21.15.112:0/1319306925 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:26:57.045 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d867700 1 -- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04580f7570 msgr2=0x7f0458115410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:57.045 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d867700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04580f7570 0x7f0458115410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.045 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d867700 1 -- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580fc8e0 msgr2=0x7f045810edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:57.045 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d867700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580fc8e0 0x7f045810edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.046 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045d867700 1 -- 172.21.15.112:0/1319306925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0450009640 con 0x7f04580f6bd0 2021-10-08T19:26:57.046 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.035+0000 7f045e068700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580fc8e0 0x7f045810edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:26:57.046 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.036+0000 7f045d867700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04580f6bd0 0x7f0458114ed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0450001d00 tx=0x7f0450004c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:57.046 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.036+0000 7f044e7fc700 1 -- 172.21.15.112:0/1319306925 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450001e00 con 0x7f04580f6bd0 2021-10-08T19:26:57.047 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.036+0000 7f044e7fc700 1 -- 172.21.15.112:0/1319306925 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f045000fd70 con 0x7f04580f6bd0 2021-10-08T19:26:57.047 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.036+0000 7f044e7fc700 1 -- 172.21.15.112:0/1319306925 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450007af0 con 0x7f04580f6bd0 2021-10-08T19:26:57.047 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.036+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0448005040 con 0x7f04580f6bd0 2021-10-08T19:26:57.047 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.036+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045811bd40 con 0x7f04580f6bd0 2021-10-08T19:26:57.047 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.038+0000 7f044e7fc700 1 -- 172.21.15.112:0/1319306925 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f045001c030 con 0x7f04580f6bd0 2021-10-08T19:26:57.048 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.038+0000 7f044e7fc700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f04440635e0 0x7f0444065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:26:57.048 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.038+0000 7f044e7fc700 1 -- 172.21.15.112:0/1319306925 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f0450080db0 con 0x7f04580f6bd0 2021-10-08T19:26:57.049 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.038+0000 7f045d066700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f04440635e0 0x7f0444065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:26:57.050 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.041+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04580f6420 con 0x7f04580f6bd0 2021-10-08T19:26:57.050 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.041+0000 7f045d066700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f04440635e0 0x7f0444065a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0448004e00 tx=0x7f0448009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:26:57.050 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.046+0000 7f044e7fc700 1 -- 172.21.15.112:0/1319306925 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f0450049b00 con 0x7f04580f6bd0 2021-10-08T19:26:57.268 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.266+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f04580472f0 con 0x7f04580f6bd0 2021-10-08T19:26:57.270 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.270+0000 7f044e7fc700 1 -- 172.21.15.112:0/1319306925 <== mon.2 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v20) v1 ==== 74+0+156954 (secure 0 0 0) 0x7f045004a530 con 0x7f04580f6bd0 2021-10-08T19:26:57.276 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:26:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f04440635e0 msgr2=0x7f0444065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:57.277 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f04440635e0 0x7f0444065a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0448004e00 tx=0x7f0448009b30 comp rx=0 tx=0).stop 2021-10-08T19:26:57.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04580f6bd0 msgr2=0x7f0458114ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:26:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04580f6bd0 0x7f0458114ed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0450001d00 tx=0x7f0450004c50 comp rx=0 tx=0).stop 2021-10-08T19:26:57.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 shutdown_connections 2021-10-08T19:26:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f04440635e0 0x7f0444065a90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04580fc8e0 0x7f045810edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04580f6bd0 0x7f0458114ed0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 --2- 172.21.15.112:0/1319306925 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04580f7570 0x7f0458115410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:26:57.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 >> 172.21.15.112:0/1319306925 conn(0x7f045806d880 msgr2=0x7f04580fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:26:57.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 shutdown_connections 2021-10-08T19:26:57.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:26:57.272+0000 7f045e869700 1 -- 172.21.15.112:0/1319306925 wait complete. 2021-10-08T19:26:57.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:57 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi112 2021-10-08T19:26:58.104 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"active_gid":14532,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":471677461},{"type":"v1","addr":"172.21.15.112:6801","nonce":471677461}]},"active_addr":"172.21.15.112:6801/471677461","active_change":"2021-10-08T19:26:22.557953+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":24455,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"endpoint_port":{"name":"endpoint_port","type":"int","level":"advanced","flags":0,"default_value":"8499","min":"","max":"","enum_allowed":[],"desc":"Which port cephadm http endpoint will listen on","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-up","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm `scale-up` means that it starts out with minmum pgs and scales up when there is pressure, `scale-down` means starts out with full pgs and scales down when there is pressure ","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"endpoint_port":{"name":"endpoint_port","type":"int","level":"advanced","flags":0,"default_value":"8499","min":"","max":"","enum_allowed":[],"desc":"Which port cephadm http endpoint will listen on","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-up","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm `scale-up` means that it starts out with minmum pgs and scales up when there is pressure, `scale-down` means starts out with full pgs and scales down when there is pressure ","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"cephadm":"https://172.21.15.112:8499/","dashboard":"https://172.21.15.112:8443/","prometheus":"http://172.21.15.112:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":67,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":4063879608}]},{"addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":9515416}]},{"addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2806793180}]},{"addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1757940053}]}]}} 2021-10-08T19:26:58.109 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-10-08T19:26:58.110 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-10-08T19:26:58.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:26:58.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:58 smithi112 ceph-mon[31694]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1319306925' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:26:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:58 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:58.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:58 smithi112 ceph-mon[40655]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:58.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1319306925' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:26:58.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:58 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:58.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:26:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:58 smithi142 ceph-mon[33432]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1319306925' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-10-08T19:26:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:58 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:26:58.708 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:26:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:26:59 smithi112 ceph-mon[40655]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:26:59 smithi112 ceph-mon[31694]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:26:59.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:26:59 smithi142 ceph-mon[33432]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:00.412 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 -- 172.21.15.112:0/665074259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0f7d60 msgr2=0x7fb37c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:00.413 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 --2- 172.21.15.112:0/665074259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0f7d60 0x7fb37c1043d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb374009ae0 tx=0x7fb374004c50 comp rx=0 tx=0).stop 2021-10-08T19:27:00.413 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 -- 172.21.15.112:0/665074259 shutdown_connections 2021-10-08T19:27:00.413 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 --2- 172.21.15.112:0/665074259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0f7d60 0x7fb37c1043d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.413 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 --2- 172.21.15.112:0/665074259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37c0fd5d0 0x7fb37c0fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.414 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 --2- 172.21.15.112:0/665074259 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0fdf70 0x7fb37c0f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.414 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 -- 172.21.15.112:0/665074259 >> 172.21.15.112:0/665074259 conn(0x7fb37c06f330 msgr2=0x7fb37c06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:00.414 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 -- 172.21.15.112:0/665074259 shutdown_connections 2021-10-08T19:27:00.414 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.409+0000 7fb382512700 1 -- 172.21.15.112:0/665074259 wait complete. 2021-10-08T19:27:00.415 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb382512700 1 Processor -- start 2021-10-08T19:27:00.416 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb382512700 1 -- start start 2021-10-08T19:27:00.416 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb382512700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0f7d60 0x7fb37c0f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:00.416 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb382512700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0fd5d0 0x7fb37c0f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:00.417 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb382512700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37c0fdf70 0x7fb37c0f9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:00.417 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb382512700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c116b50 con 0x7fb37c0fd5d0 2021-10-08T19:27:00.417 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb382512700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c116cc0 con 0x7fb37c0fdf70 2021-10-08T19:27:00.417 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb382512700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c116e80 con 0x7fb37c0f7d60 2021-10-08T19:27:00.418 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37bfff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0f7d60 0x7fb37c0f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:00.418 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37bfff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0f7d60 0x7fb37c0f9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56170/0 (socket says 172.21.15.112:56170) 2021-10-08T19:27:00.418 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37bfff700 1 -- 172.21.15.112:0/476067168 learned_addr learned my addr 172.21.15.112:0/476067168 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:00.418 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0fd5d0 0x7fb37c0f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:00.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb380aaf700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37c0fdf70 0x7fb37c0f9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:00.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37bfff700 1 -- 172.21.15.112:0/476067168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37c0fdf70 msgr2=0x7fb37c0f9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:00.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37bfff700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37c0fdf70 0x7fb37c0f9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37bfff700 1 -- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0fd5d0 msgr2=0x7fb37c0f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:00.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37bfff700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0fd5d0 0x7fb37c0f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.410+0000 7fb37bfff700 1 -- 172.21.15.112:0/476067168 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c005040 con 0x7fb37c0f7d60 2021-10-08T19:27:00.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.411+0000 7fb37bfff700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0f7d60 0x7fb37c0f9230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c810 tx=0x7fb370007d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:00.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.411+0000 7fb378ff9700 1 -- 172.21.15.112:0/476067168 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000f470 con 0x7fb37c0f7d60 2021-10-08T19:27:00.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.411+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb374009640 con 0x7fb37c0f7d60 2021-10-08T19:27:00.421 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.411+0000 7fb378ff9700 1 -- 172.21.15.112:0/476067168 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb37000fa20 con 0x7fb37c0f7d60 2021-10-08T19:27:00.421 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.411+0000 7fb378ff9700 1 -- 172.21.15.112:0/476067168 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3700127c0 con 0x7fb37c0f7d60 2021-10-08T19:27:00.421 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.411+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c1174e0 con 0x7fb37c0f7d60 2021-10-08T19:27:00.422 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.412+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c047b50 con 0x7fb37c0f7d60 2021-10-08T19:27:00.423 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.413+0000 7fb378ff9700 1 -- 172.21.15.112:0/476067168 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fb370019030 con 0x7fb37c0f7d60 2021-10-08T19:27:00.423 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.413+0000 7fb378ff9700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3640635e0 0x7fb364065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:00.423 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.413+0000 7fb378ff9700 1 -- 172.21.15.112:0/476067168 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7fb37007fbd0 con 0x7fb37c0f7d60 2021-10-08T19:27:00.424 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.413+0000 7fb37b7fe700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3640635e0 0x7fb364065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:00.424 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.413+0000 7fb37b7fe700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3640635e0 0x7fb364065a90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0faa20 tx=0x7fb36c00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:00.424 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.416+0000 7fb378ff9700 1 -- 172.21.15.112:0/476067168 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fb3700522d0 con 0x7fb37c0f7d60 2021-10-08T19:27:00.599 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.598+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb37c106830 con 0x7fb37c0f7d60 2021-10-08T19:27:00.600 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.599+0000 7fb378ff9700 1 -- 172.21.15.112:0/476067168 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+21385 (secure 0 0 0) 0x7fb370017020 con 0x7fb37c0f7d60 2021-10-08T19:27:00.600 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:27:00.601 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":67,"fsid":"c1559bde-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:21:03.408199+0000","modified":"2021-10-08T19:26:22.557603+0000","last_up_change":"2021-10-08T19:25:55.256730+0000","last_in_change":"2021-10-08T19:25:39.771821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:24:24.578260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:26:02.182312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:26:02.734650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:26:04.175169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:26:06.145211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:26:08.191838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6803","nonce":3277557561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6805","nonce":3277557561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6809","nonce":3277557561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6807","nonce":3277557561}]},"public_addr":"172.21.15.112:6803/3277557561","cluster_addr":"172.21.15.112:6805/3277557561","heartbeat_back_addr":"172.21.15.112:6809/3277557561","heartbeat_front_addr":"172.21.15.112:6807/3277557561","state":["exists","up"]},{"osd":1,"uuid":"eb484e98-9c69-4c55-84d6-096b231a6135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6811","nonce":3434501439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6813","nonce":3434501439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6817","nonce":3434501439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6815","nonce":3434501439}]},"public_addr":"172.21.15.112:6811/3434501439","cluster_addr":"172.21.15.112:6813/3434501439","heartbeat_back_addr":"172.21.15.112:6817/3434501439","heartbeat_front_addr":"172.21.15.112:6815/3434501439","state":["exists","up"]},{"osd":2,"uuid":"a751de5f-e823-4e5e-9843-a18b220be8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6819","nonce":799583119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6821","nonce":799583119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6825","nonce":799583119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6823","nonce":799583119}]},"public_addr":"172.21.15.112:6819/799583119","cluster_addr":"172.21.15.112:6821/799583119","heartbeat_back_addr":"172.21.15.112:6825/799583119","heartbeat_front_addr":"172.21.15.112:6823/799583119","state":["exists","up"]},{"osd":3,"uuid":"09598391-54ae-4362-9b9b-d61d813c967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6827","nonce":3674507612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6829","nonce":3674507612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6833","nonce":3674507612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6831","nonce":3674507612}]},"public_addr":"172.21.15.112:6827/3674507612","cluster_addr":"172.21.15.112:6829/3674507612","heartbeat_back_addr":"172.21.15.112:6833/3674507612","heartbeat_front_addr":"172.21.15.112:6831/3674507612","state":["exists","up"]},{"osd":4,"uuid":"f7a8fbce-2e6e-4ae0-8b21-53e294747dbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6801","nonce":3103692399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6803","nonce":3103692399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6807","nonce":3103692399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6805","nonce":3103692399}]},"public_addr":"172.21.15.142:6801/3103692399","cluster_addr":"172.21.15.142:6803/3103692399","heartbeat_back_addr":"172.21.15.142:6807/3103692399","heartbeat_front_addr":"172.21.15.142:6805/3103692399","state":["exists","up"]},{"osd":5,"uuid":"2bc6f6dd-7196-4779-86cb-679b6fc75a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6809","nonce":2168767914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6811","nonce":2168767914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6815","nonce":2168767914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6813","nonce":2168767914}]},"public_addr":"172.21.15.142:6809/2168767914","cluster_addr":"172.21.15.142:6811/2168767914","heartbeat_back_addr":"172.21.15.142:6815/2168767914","heartbeat_front_addr":"172.21.15.142:6813/2168767914","state":["exists","up"]},{"osd":6,"uuid":"a299c900-e42a-4a11-b6d9-ee294f904be5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6817","nonce":2191075949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6819","nonce":2191075949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6823","nonce":2191075949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6821","nonce":2191075949}]},"public_addr":"172.21.15.142:6817/2191075949","cluster_addr":"172.21.15.142:6819/2191075949","heartbeat_back_addr":"172.21.15.142:6823/2191075949","heartbeat_front_addr":"172.21.15.142:6821/2191075949","state":["exists","up"]},{"osd":7,"uuid":"12f6d2e1-a644-45cb-9df7-7b34880592a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6825","nonce":1647586049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6827","nonce":1647586049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6831","nonce":1647586049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6829","nonce":1647586049}]},"public_addr":"172.21.15.142:6825/1647586049","cluster_addr":"172.21.15.142:6827/1647586049","heartbeat_back_addr":"172.21.15.142:6831/1647586049","heartbeat_front_addr":"172.21.15.142:6829/1647586049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:43.252870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:02.184618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:20.587330+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:39.108894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:57.686832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:16.949114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:35.403363+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:54.052230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:0/2076151530":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3045630175":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3094970789":"2021-10-09T19:26:22.557570+0000","172.21.15.112:6800/3200748374":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/1685103696":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/1957878248":"2021-10-09T19:21:25.236574+0000","172.21.15.112:6801/3200748374":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3971619149":"2021-10-09T19:21:25.236574+0000","172.21.15.112:6801/1703752479":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/3398210384":"2021-10-09T19:26:22.557570+0000","172.21.15.112:6800/1703752479":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/3551391045":"2021-10-09T19:21:46.213537+0000","172.21.15.112:6800/1294788170":"2021-10-09T19:21:46.213537+0000","172.21.15.112:6801/1294788170":"2021-10-09T19:21:46.213537+0000","172.21.15.112:0/1446606652":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/158418565":"2021-10-09T19:21:46.213537+0000","172.21.15.112:0/3111657923":"2021-10-09T19:21:46.213537+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:27:00.602 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3640635e0 msgr2=0x7fb364065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:00.602 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3640635e0 0x7fb364065a90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0faa20 tx=0x7fb36c00b040 comp rx=0 tx=0).stop 2021-10-08T19:27:00.603 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0f7d60 msgr2=0x7fb37c0f9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:00.603 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0f7d60 0x7fb37c0f9230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c810 tx=0x7fb370007d70 comp rx=0 tx=0).stop 2021-10-08T19:27:00.603 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 shutdown_connections 2021-10-08T19:27:00.604 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fb3640635e0 0x7fb364065a90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.604 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37c0fdf70 0x7fb37c0f9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.604 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0f7d60 0x7fb37c0f9230 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.604 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 --2- 172.21.15.112:0/476067168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0fd5d0 0x7fb37c0f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:00.605 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 >> 172.21.15.112:0/476067168 conn(0x7fb37c06f330 msgr2=0x7fb37c0f6940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:00.605 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 shutdown_connections 2021-10-08T19:27:00.605 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:00.601+0000 7fb382512700 1 -- 172.21.15.112:0/476067168 wait complete. 2021-10-08T19:27:01.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/476067168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:27:01.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/476067168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:27:01.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/476067168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:27:01.316 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-10-08T19:27:01.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd dump --format=json 2021-10-08T19:27:01.768 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:01.949 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:01 smithi112 ceph-mon[40655]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:01.950 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:01 smithi112 ceph-mon[31694]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:02.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:01 smithi142 ceph-mon[33432]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:03.493 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 -- 172.21.15.112:0/4010478961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0f8dd0 msgr2=0x7fe10c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:03.494 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 --2- 172.21.15.112:0/4010478961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0f8dd0 0x7fe10c1053e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe104009a60 tx=0x7fe104004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:03.494 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 -- 172.21.15.112:0/4010478961 shutdown_connections 2021-10-08T19:27:03.495 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 --2- 172.21.15.112:0/4010478961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0f8dd0 0x7fe10c1053e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.495 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 --2- 172.21.15.112:0/4010478961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c0fe570 0x7fe10c0fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.495 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 --2- 172.21.15.112:0/4010478961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe10c0fef10 0x7fe10c0f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 -- 172.21.15.112:0/4010478961 >> 172.21.15.112:0/4010478961 conn(0x7fe10c070580 msgr2=0x7fe10c070980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 -- 172.21.15.112:0/4010478961 shutdown_connections 2021-10-08T19:27:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.490+0000 7fe111758700 1 -- 172.21.15.112:0/4010478961 wait complete. 2021-10-08T19:27:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe111758700 1 Processor -- start 2021-10-08T19:27:03.496 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe111758700 1 -- start start 2021-10-08T19:27:03.497 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe111758700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe10c0f8dd0 0x7fe10c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:03.498 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe111758700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c0fe570 0x7fe10c06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:03.498 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe111758700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0fef10 0x7fe10c1168a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:03.498 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe111758700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c06c4f0 con 0x7fe10c0fe570 2021-10-08T19:27:03.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe111758700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c116de0 con 0x7fe10c0f8dd0 2021-10-08T19:27:03.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe111758700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c116f50 con 0x7fe10c0fef10 2021-10-08T19:27:03.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe10a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c0fe570 0x7fe10c06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:03.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe10b7fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0fef10 0x7fe10c1168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:03.499 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe10a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c0fe570 0x7fe10c06bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34228/0 (socket says 172.21.15.112:34228) 2021-10-08T19:27:03.500 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe10a7fc700 1 -- 172.21.15.112:0/2635400013 learned_addr learned my addr 172.21.15.112:0/2635400013 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:03.500 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.491+0000 7fe10affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe10c0f8dd0 0x7fe10c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:03.500 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe10a7fc700 1 -- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0fef10 msgr2=0x7fe10c1168a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:03.504 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe10a7fc700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0fef10 0x7fe10c1168a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.504 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe10a7fc700 1 -- 172.21.15.112:0/2635400013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe10c0f8dd0 msgr2=0x7fe10c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:03.504 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe10a7fc700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe10c0f8dd0 0x7fe10c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.504 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe10a7fc700 1 -- 172.21.15.112:0/2635400013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc005040 con 0x7fe10c0fe570 2021-10-08T19:27:03.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe10b7fe700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0fef10 0x7fe10c1168a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:03.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe10a7fc700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c0fe570 0x7fe10c06bc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e840 tx=0x7fe10000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:03.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe0f37fe700 1 -- 172.21.15.112:0/2635400013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000092e0 con 0x7fe10c0fe570 2021-10-08T19:27:03.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe104009640 con 0x7fe10c0fe570 2021-10-08T19:27:03.505 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe0f37fe700 1 -- 172.21.15.112:0/2635400013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fe10000f040 con 0x7fe10c0fe570 2021-10-08T19:27:03.506 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe0f37fe700 1 -- 172.21.15.112:0/2635400013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000146f0 con 0x7fe10c0fe570 2021-10-08T19:27:03.506 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.492+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c117530 con 0x7fe10c0fe570 2021-10-08T19:27:03.506 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.493+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c0720a0 con 0x7fe10c0fe570 2021-10-08T19:27:03.508 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.493+0000 7fe0f37fe700 1 -- 172.21.15.112:0/2635400013 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fe10001b030 con 0x7fe10c0fe570 2021-10-08T19:27:03.509 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.494+0000 7fe0f37fe700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe0f40635e0 0x7fe0f4065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.494+0000 7fe0f37fe700 1 -- 172.21.15.112:0/2635400013 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7fe10007f8c0 con 0x7fe10c0fe570 2021-10-08T19:27:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.494+0000 7fe10affd700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe0f40635e0 0x7fe0f4065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.494+0000 7fe10affd700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe0f40635e0 0x7fe0f4065a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009050 tx=0x7fe0fc00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.497+0000 7fe0f37fe700 1 -- 172.21.15.112:0/2635400013 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fe100048b00 con 0x7fe10c0fe570 2021-10-08T19:27:03.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:03 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:27:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:03.659 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.658+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe10c0472f0 con 0x7fe10c0fe570 2021-10-08T19:27:03.660 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.659+0000 7fe0f37fe700 1 -- 172.21.15.112:0/2635400013 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+21385 (secure 0 0 0) 0x7fe100051fc0 con 0x7fe10c0fe570 2021-10-08T19:27:03.660 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:27:03.661 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":67,"fsid":"c1559bde-286c-11ec-8c25-001a4aab830c","created":"2021-10-08T19:21:03.408199+0000","modified":"2021-10-08T19:26:22.557603+0000","last_up_change":"2021-10-08T19:25:55.256730+0000","last_in_change":"2021-10-08T19:25:39.771821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-10-08T19:24:24.578260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-10-08T19:26:02.182312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-10-08T19:26:02.734650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2021-10-08T19:26:04.175169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-10-08T19:26:06.145211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-10-08T19:26:08.191838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"f839ca38-ba44-4bbc-8ecf-d41bd8c8b8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6803","nonce":3277557561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6805","nonce":3277557561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6809","nonce":3277557561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3277557561},{"type":"v1","addr":"172.21.15.112:6807","nonce":3277557561}]},"public_addr":"172.21.15.112:6803/3277557561","cluster_addr":"172.21.15.112:6805/3277557561","heartbeat_back_addr":"172.21.15.112:6809/3277557561","heartbeat_front_addr":"172.21.15.112:6807/3277557561","state":["exists","up"]},{"osd":1,"uuid":"eb484e98-9c69-4c55-84d6-096b231a6135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6811","nonce":3434501439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6813","nonce":3434501439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6817","nonce":3434501439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3434501439},{"type":"v1","addr":"172.21.15.112:6815","nonce":3434501439}]},"public_addr":"172.21.15.112:6811/3434501439","cluster_addr":"172.21.15.112:6813/3434501439","heartbeat_back_addr":"172.21.15.112:6817/3434501439","heartbeat_front_addr":"172.21.15.112:6815/3434501439","state":["exists","up"]},{"osd":2,"uuid":"a751de5f-e823-4e5e-9843-a18b220be8f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6819","nonce":799583119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6821","nonce":799583119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6825","nonce":799583119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":799583119},{"type":"v1","addr":"172.21.15.112:6823","nonce":799583119}]},"public_addr":"172.21.15.112:6819/799583119","cluster_addr":"172.21.15.112:6821/799583119","heartbeat_back_addr":"172.21.15.112:6825/799583119","heartbeat_front_addr":"172.21.15.112:6823/799583119","state":["exists","up"]},{"osd":3,"uuid":"09598391-54ae-4362-9b9b-d61d813c967d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6827","nonce":3674507612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6829","nonce":3674507612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6833","nonce":3674507612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3674507612},{"type":"v1","addr":"172.21.15.112:6831","nonce":3674507612}]},"public_addr":"172.21.15.112:6827/3674507612","cluster_addr":"172.21.15.112:6829/3674507612","heartbeat_back_addr":"172.21.15.112:6833/3674507612","heartbeat_front_addr":"172.21.15.112:6831/3674507612","state":["exists","up"]},{"osd":4,"uuid":"f7a8fbce-2e6e-4ae0-8b21-53e294747dbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6801","nonce":3103692399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6803","nonce":3103692399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6807","nonce":3103692399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3103692399},{"type":"v1","addr":"172.21.15.142:6805","nonce":3103692399}]},"public_addr":"172.21.15.142:6801/3103692399","cluster_addr":"172.21.15.142:6803/3103692399","heartbeat_back_addr":"172.21.15.142:6807/3103692399","heartbeat_front_addr":"172.21.15.142:6805/3103692399","state":["exists","up"]},{"osd":5,"uuid":"2bc6f6dd-7196-4779-86cb-679b6fc75a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6809","nonce":2168767914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6811","nonce":2168767914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6815","nonce":2168767914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2168767914},{"type":"v1","addr":"172.21.15.142:6813","nonce":2168767914}]},"public_addr":"172.21.15.142:6809/2168767914","cluster_addr":"172.21.15.142:6811/2168767914","heartbeat_back_addr":"172.21.15.142:6815/2168767914","heartbeat_front_addr":"172.21.15.142:6813/2168767914","state":["exists","up"]},{"osd":6,"uuid":"a299c900-e42a-4a11-b6d9-ee294f904be5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6817","nonce":2191075949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6819","nonce":2191075949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6823","nonce":2191075949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2191075949},{"type":"v1","addr":"172.21.15.142:6821","nonce":2191075949}]},"public_addr":"172.21.15.142:6817/2191075949","cluster_addr":"172.21.15.142:6819/2191075949","heartbeat_back_addr":"172.21.15.142:6823/2191075949","heartbeat_front_addr":"172.21.15.142:6821/2191075949","state":["exists","up"]},{"osd":7,"uuid":"12f6d2e1-a644-45cb-9df7-7b34880592a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6825","nonce":1647586049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6827","nonce":1647586049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6831","nonce":1647586049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1647586049},{"type":"v1","addr":"172.21.15.142:6829","nonce":1647586049}]},"public_addr":"172.21.15.142:6825/1647586049","cluster_addr":"172.21.15.142:6827/1647586049","heartbeat_back_addr":"172.21.15.142:6831/1647586049","heartbeat_front_addr":"172.21.15.142:6829/1647586049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:23:43.252870+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:02.184618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:20.587330+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:39.108894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:24:57.686832+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:16.949114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:35.403363+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-10-08T19:25:54.052230+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:0/2076151530":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3045630175":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3094970789":"2021-10-09T19:26:22.557570+0000","172.21.15.112:6800/3200748374":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/1685103696":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/1957878248":"2021-10-09T19:21:25.236574+0000","172.21.15.112:6801/3200748374":"2021-10-09T19:26:22.557570+0000","172.21.15.112:0/3971619149":"2021-10-09T19:21:25.236574+0000","172.21.15.112:6801/1703752479":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/3398210384":"2021-10-09T19:26:22.557570+0000","172.21.15.112:6800/1703752479":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/3551391045":"2021-10-09T19:21:46.213537+0000","172.21.15.112:6800/1294788170":"2021-10-09T19:21:46.213537+0000","172.21.15.112:6801/1294788170":"2021-10-09T19:21:46.213537+0000","172.21.15.112:0/1446606652":"2021-10-09T19:21:25.236574+0000","172.21.15.112:0/158418565":"2021-10-09T19:21:46.213537+0000","172.21.15.112:0/3111657923":"2021-10-09T19:21:46.213537+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-10-08T19:27:03.662 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe0f40635e0 msgr2=0x7fe0f4065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:03.662 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe0f40635e0 0x7fe0f4065a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009050 tx=0x7fe0fc00b040 comp rx=0 tx=0).stop 2021-10-08T19:27:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c0fe570 msgr2=0x7fe10c06bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c0fe570 0x7fe10c06bc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e840 tx=0x7fe10000b040 comp rx=0 tx=0).stop 2021-10-08T19:27:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 shutdown_connections 2021-10-08T19:27:03.663 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe0f40635e0 0x7fe0f4065a90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe10c0fef10 0x7fe10c1168a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe10c0f8dd0 0x7fe10c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 --2- 172.21.15.112:0/2635400013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c0fe570 0x7fe10c06bc00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 >> 172.21.15.112:0/2635400013 conn(0x7fe10c070580 msgr2=0x7fe10c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:03.664 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 shutdown_connections 2021-10-08T19:27:03.665 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:03.661+0000 7fe111758700 1 -- 172.21.15.112:0/2635400013 wait complete. 2021-10-08T19:27:04.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:03 smithi142 ceph-mon[33432]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:03 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2635400013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:27:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:03 smithi112 ceph-mon[31694]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:03 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:04.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2635400013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:27:04.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:03 smithi112 ceph-mon[40655]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:04.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:03 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:04.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2635400013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-10-08T19:27:04.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-10-08T19:27:04.812 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:04.863 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:04 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:27:04.864 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:04 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:27:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:04.990 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:04 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:27:04.990 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:04 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:27:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:04.991 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:04 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:27:04.991 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:04 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:27:03] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:05.977 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:05 smithi112 ceph-mon[40655]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:05.977 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:05 smithi112 ceph-mon[31694]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:06.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:05 smithi142 ceph-mon[33432]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:06.167 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.163+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/538616195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 msgr2=0x7f4b880fd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:06.167 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.163+0000 7f4b8d6d7700 1 --2- 172.21.15.112:0/538616195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 0x7f4b880fd880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b780046e0 tx=0x7f4b78009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:06.168 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/538616195 shutdown_connections 2021-10-08T19:27:06.168 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 --2- 172.21.15.112:0/538616195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b880f7c80 0x7f4b881042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:06.168 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 --2- 172.21.15.112:0/538616195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 0x7f4b880fd880 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:06.169 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 --2- 172.21.15.112:0/538616195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b880fde50 0x7f4b880f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:06.169 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/538616195 >> 172.21.15.112:0/538616195 conn(0x7f4b8806e310 msgr2=0x7f4b8806e710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:06.169 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/538616195 shutdown_connections 2021-10-08T19:27:06.169 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/538616195 wait complete. 2021-10-08T19:27:06.169 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 Processor -- start 2021-10-08T19:27:06.170 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.164+0000 7f4b8d6d7700 1 -- start start 2021-10-08T19:27:06.170 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8d6d7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b880f7c80 0x7f4b881075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:06.170 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8d6d7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 0x7f4b88107b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:06.170 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8d6d7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b880fde50 0x7f4b88116c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:06.171 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8d6d7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88108300 con 0x7f4b880fd4b0 2021-10-08T19:27:06.171 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8d6d7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88108470 con 0x7f4b880f7c80 2021-10-08T19:27:06.171 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8d6d7700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b881171f0 con 0x7f4b880fde50 2021-10-08T19:27:06.172 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 0x7f4b88107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:06.172 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8ced6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b880fde50 0x7f4b88116c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:06.172 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 0x7f4b88107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34242/0 (socket says 172.21.15.112:34242) 2021-10-08T19:27:06.172 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 -- 172.21.15.112:0/3735695245 learned_addr learned my addr 172.21.15.112:0/3735695245 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:06.172 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b87fff700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b880f7c80 0x7f4b881075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:06.173 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 -- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b880fde50 msgr2=0x7f4b88116c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:06.173 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b880fde50 0x7f4b88116c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:06.174 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 -- 172.21.15.112:0/3735695245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b880f7c80 msgr2=0x7f4b881075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:06.174 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b880f7c80 0x7f4b881075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:06.174 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 -- 172.21.15.112:0/3735695245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c005040 con 0x7f4b880fd4b0 2021-10-08T19:27:06.174 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8ced6700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b880fde50 0x7f4b88116c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:06.175 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b877fe700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 0x7f4b88107b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c004920 tx=0x7f4b7c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:06.175 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00e050 con 0x7f4b880fd4b0 2021-10-08T19:27:06.175 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f4b7c00f040 con 0x7f4b880fd4b0 2021-10-08T19:27:06.175 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b78005040 con 0x7f4b880fd4b0 2021-10-08T19:27:06.175 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0146d0 con 0x7f4b880fd4b0 2021-10-08T19:27:06.176 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.165+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b88117900 con 0x7f4b880fd4b0 2021-10-08T19:27:06.176 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.166+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b880f6200 con 0x7f4b880fd4b0 2021-10-08T19:27:06.177 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.167+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f4b7c01b020 con 0x7f4b880fd4b0 2021-10-08T19:27:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.167+0000 7f4b84ff9700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b700635e0 0x7f4b70065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.167+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f4b7c080070 con 0x7f4b880fd4b0 2021-10-08T19:27:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.167+0000 7f4b87fff700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b700635e0 0x7f4b70065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:06.179 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.168+0000 7f4b84ff9700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] conn(0x7f4b7006d5c0 0x7f4b7006f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:06.179 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.168+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 --> [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b700700c0 con 0x7f4b7006d5c0 2021-10-08T19:27:06.179 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.168+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b7c080450 con 0x7f4b880fd4b0 2021-10-08T19:27:06.179 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.168+0000 7f4b8ced6700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] conn(0x7f4b7006d5c0 0x7f4b7006f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:06.180 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.168+0000 7f4b87fff700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b700635e0 0x7f4b70065a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b78004d50 tx=0x7f4b78017040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:06.180 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.168+0000 7f4b8ced6700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] conn(0x7f4b7006d5c0 0x7f4b7006f9f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:06.180 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.169+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 <== osd.0 v2:172.21.15.112:6802/3277557561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f4b700700c0 con 0x7f4b7006d5c0 2021-10-08T19:27:06.184 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.183+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 --> [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b8806fe30 con 0x7f4b7006d5c0 2021-10-08T19:27:06.184 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.183+0000 7f4b84ff9700 1 -- 172.21.15.112:0/3735695245 <== osd.0 v2:172.21.15.112:6802/3277557561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b8806fe30 con 0x7f4b7006d5c0 2021-10-08T19:27:06.185 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] conn(0x7f4b7006d5c0 msgr2=0x7f4b7006f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:06.185 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6802/3277557561,v1:172.21.15.112:6803/3277557561] conn(0x7f4b7006d5c0 0x7f4b7006f9f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:06.185 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b700635e0 msgr2=0x7f4b70065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:06.186 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b700635e0 0x7f4b70065a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b78004d50 tx=0x7f4b78017040 comp rx=0 tx=0).stop 2021-10-08T19:27:06.186 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 msgr2=0x7f4b88107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:06.186 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 --2- 172.21.15.112:0/3735695245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b880fd4b0 0x7f4b88107b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c004920 tx=0x7f4b7c009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:06.186 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8ced6700 1 -- 172.21.15.112:0/3735695245 reap_dead start 2021-10-08T19:27:06.187 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 shutdown_connections 2021-10-08T19:27:06.187 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 >> 172.21.15.112:0/3735695245 conn(0x7f4b8806e310 msgr2=0x7f4b880f5830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:06.187 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 shutdown_connections 2021-10-08T19:27:06.187 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:06.184+0000 7f4b8d6d7700 1 -- 172.21.15.112:0/3735695245 wait complete. 2021-10-08T19:27:06.463 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:27:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:27:07.013 INFO:teuthology.orchestra.run.smithi112.stdout:34359738411 2021-10-08T19:27:07.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-10-08T19:27:07.448 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:07.745 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:07.745 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:07 smithi142 ceph-mon[33432]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:08.023 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:07 smithi142 systemd[1]: Starting Ceph prometheus.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:27:08.031 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:08.032 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:07 smithi112 ceph-mon[31694]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:08.032 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:08.032 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:07 smithi112 ceph-mon[40655]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:08.352 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 bash[61879]: 9cde0db828a90806bc07483a763aa1a5c93e57ad0d5ba7b1a53403b798a313c6 2021-10-08T19:27:08.352 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.311Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-10-08T19:27:08.353 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.311Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-10-08T19:27:08.353 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.311Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-10-08T19:27:08.353 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.311Z caller=main.go:339 host_details="(Linux 4.18.0-305.el8.x86_64 #1 SMP Thu Apr 29 08:54:30 EDT 2021 x86_64 smithi142 (none))" 2021-10-08T19:27:08.354 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.311Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-10-08T19:27:08.354 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.311Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-10-08T19:27:08.354 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.312Z caller=main.go:678 msg="Starting TSDB ..." 2021-10-08T19:27:08.355 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.312Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-10-08T19:27:08.355 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.314Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-10-08T19:27:08.355 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.315Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-10-08T19:27:08.355 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.315Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=136.579µs 2021-10-08T19:27:08.356 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.315Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-10-08T19:27:08.356 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.315Z caller=main.go:695 msg="TSDB started" 2021-10-08T19:27:08.356 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.315Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:27:08.357 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.321Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:27:08.357 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 conmon[62065]: level=info ts=2021-10-08T19:27:08.321Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-10-08T19:27:08.617 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:27:08 smithi142 systemd[1]: Started Ceph prometheus.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:27:08.975 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 -- 172.21.15.112:0/1666571798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 msgr2=0x7f2850107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:08.976 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 --2- 172.21.15.112:0/1666571798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 0x7f2850107430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2848009a60 tx=0x7f2848004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:08.976 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 -- 172.21.15.112:0/1666571798 shutdown_connections 2021-10-08T19:27:08.977 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 --2- 172.21.15.112:0/1666571798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 0x7f2850107430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:08.977 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 --2- 172.21.15.112:0/1666571798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285006b5f0 0x7f285006b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:08.977 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 --2- 172.21.15.112:0/1666571798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f285006bf00 0x7f2850104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:08.979 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 -- 172.21.15.112:0/1666571798 >> 172.21.15.112:0/1666571798 conn(0x7f2850070510 msgr2=0x7f2850070910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:08.979 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 -- 172.21.15.112:0/1666571798 shutdown_connections 2021-10-08T19:27:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.969+0000 7f285725d700 1 -- 172.21.15.112:0/1666571798 wait complete. 2021-10-08T19:27:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285725d700 1 Processor -- start 2021-10-08T19:27:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285725d700 1 -- start start 2021-10-08T19:27:08.980 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285725d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285006b5f0 0x7f2850110910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:08.981 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285725d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f285006bf00 0x7f2850110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:08.981 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285725d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 0x7f285010a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:08.981 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285725d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285010ada0 con 0x7f285006b5f0 2021-10-08T19:27:08.982 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285725d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285010af10 con 0x7f285006bf00 2021-10-08T19:27:08.982 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285725d700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285010b0d0 con 0x7f2850105050 2021-10-08T19:27:08.982 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f2856a5c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 0x7f285010a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:08.982 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f2856a5c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 0x7f285010a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56218/0 (socket says 172.21.15.112:56218) 2021-10-08T19:27:08.983 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f2856a5c700 1 -- 172.21.15.112:0/1263789689 learned_addr learned my addr 172.21.15.112:0/1263789689 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:08.983 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f285625b700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285006b5f0 0x7f2850110910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:08.983 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.970+0000 7f2855a5a700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f285006bf00 0x7f2850110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:08.984 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2856a5c700 1 -- 172.21.15.112:0/1263789689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f285006bf00 msgr2=0x7f2850110e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:08.984 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2856a5c700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f285006bf00 0x7f2850110e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:08.984 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2856a5c700 1 -- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285006b5f0 msgr2=0x7f2850110910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:08.985 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2856a5c700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f285006b5f0 0x7f2850110910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:08.985 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2856a5c700 1 -- 172.21.15.112:0/1263789689 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c005040 con 0x7f2850105050 2021-10-08T19:27:08.985 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2856a5c700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 0x7f285010a7d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2848009fd0 tx=0x7f2848004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:08.985 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800e070 con 0x7f2850105050 2021-10-08T19:27:08.986 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f2848009450 con 0x7f2850105050 2021-10-08T19:27:08.986 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2848009640 con 0x7f2850105050 2021-10-08T19:27:08.986 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848012d50 con 0x7f2850105050 2021-10-08T19:27:08.986 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.971+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285010b620 con 0x7f2850105050 2021-10-08T19:27:08.987 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.972+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28500f7fe0 con 0x7f2850105050 2021-10-08T19:27:08.987 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.973+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f2848012410 con 0x7f2850105050 2021-10-08T19:27:08.987 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.973+0000 7f2846ffd700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f283c0635e0 0x7f283c065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:08.987 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.973+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f2848082760 con 0x7f2850105050 2021-10-08T19:27:08.987 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.973+0000 7f285625b700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f283c0635e0 0x7f283c065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:08.988 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.973+0000 7f2846ffd700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] conn(0x7f283c06d540 0x7f283c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:08.988 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.973+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 --> [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f283c070040 con 0x7f283c06d540 2021-10-08T19:27:08.988 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.973+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2848082b40 con 0x7f2850105050 2021-10-08T19:27:08.988 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.973+0000 7f2855a5a700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] conn(0x7f283c06d540 0x7f283c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:08.989 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.974+0000 7f285625b700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f283c0635e0 0x7f283c065a90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f284c009050 tx=0x7f284c00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:08.989 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.974+0000 7f2855a5a700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] conn(0x7f283c06d540 0x7f283c06f970 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:08.989 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.974+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 <== osd.1 v2:172.21.15.112:6810/3434501439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f283c070040 con 0x7f283c06d540 2021-10-08T19:27:08.991 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.989+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 --> [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2850072030 con 0x7f283c06d540 2021-10-08T19:27:08.991 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.990+0000 7f2846ffd700 1 -- 172.21.15.112:0/1263789689 <== osd.1 v2:172.21.15.112:6810/3434501439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2850072030 con 0x7f283c06d540 2021-10-08T19:27:08.992 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.990+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] conn(0x7f283c06d540 msgr2=0x7f283c06f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:08.993 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.990+0000 7f285725d700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6810/3434501439,v1:172.21.15.112:6811/3434501439] conn(0x7f283c06d540 0x7f283c06f970 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:08.993 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.990+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f283c0635e0 msgr2=0x7f283c065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:08.993 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.990+0000 7f285725d700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f283c0635e0 0x7f283c065a90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f284c009050 tx=0x7f284c00b040 comp rx=0 tx=0).stop 2021-10-08T19:27:08.994 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.990+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 msgr2=0x7f285010a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:08.994 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.990+0000 7f285725d700 1 --2- 172.21.15.112:0/1263789689 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2850105050 0x7f285010a7d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2848009fd0 tx=0x7f2848004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:08.994 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.990+0000 7f2856a5c700 1 -- 172.21.15.112:0/1263789689 reap_dead start 2021-10-08T19:27:08.994 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.991+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 shutdown_connections 2021-10-08T19:27:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.991+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 >> 172.21.15.112:0/1263789689 conn(0x7f2850070510 msgr2=0x7f28500f7610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.991+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 shutdown_connections 2021-10-08T19:27:08.995 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:08.991+0000 7f285725d700 1 -- 172.21.15.112:0/1263789689 wait complete. 2021-10-08T19:27:09.018 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:08 smithi112 ceph-mon[40655]: poll took 13998.016 ms: 1 events 2021-10-08T19:27:09.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:08 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:09.019 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:08 smithi112 ceph-mon[31694]: poll took 13998.016 ms: 1 events 2021-10-08T19:27:09.019 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:08 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:09.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:08 smithi142 ceph-mon[33432]: poll took 13998.016 ms: 1 events 2021-10-08T19:27:09.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:08 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:09.663 INFO:teuthology.orchestra.run.smithi112.stdout:55834574887 2021-10-08T19:27:09.664 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-10-08T19:27:10.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:09 smithi142 ceph-mon[33432]: Sending message to agent on host smithi142 2021-10-08T19:27:10.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:09 smithi142 ceph-mon[33432]: Deploying daemon alertmanager.a on smithi112 2021-10-08T19:27:10.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:09 smithi142 ceph-mon[33432]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:10.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:09 smithi112 ceph-mon[40655]: Sending message to agent on host smithi142 2021-10-08T19:27:10.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:09 smithi112 ceph-mon[40655]: Deploying daemon alertmanager.a on smithi112 2021-10-08T19:27:10.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:09 smithi112 ceph-mon[40655]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:10.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:09 smithi112 ceph-mon[31694]: Sending message to agent on host smithi142 2021-10-08T19:27:10.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:09 smithi112 ceph-mon[31694]: Deploying daemon alertmanager.a on smithi112 2021-10-08T19:27:10.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:09 smithi112 ceph-mon[31694]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:10.098 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:11.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:10 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi142 2021-10-08T19:27:11.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:10 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi142 2021-10-08T19:27:11.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:10 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi142 2021-10-08T19:27:11.808 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 -- 172.21.15.112:0/1047895721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 msgr2=0x7fd3241050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:11.808 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 --2- 172.21.15.112:0/1047895721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 0x7fd3241050d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009a60 tx=0x7fd31c004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:11.809 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 -- 172.21.15.112:0/1047895721 shutdown_connections 2021-10-08T19:27:11.809 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 --2- 172.21.15.112:0/1047895721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 0x7fd3241050d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:11.809 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 --2- 172.21.15.112:0/1047895721 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3240f9740 0x7fd3240f9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:11.809 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 --2- 172.21.15.112:0/1047895721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3240fa050 0x7fd3241027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:11.810 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 -- 172.21.15.112:0/1047895721 >> 172.21.15.112:0/1047895721 conn(0x7fd32406e2a0 msgr2=0x7fd3240f5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:11.810 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 -- 172.21.15.112:0/1047895721 shutdown_connections 2021-10-08T19:27:11.810 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.807+0000 7fd3289c8700 1 -- 172.21.15.112:0/1047895721 wait complete. 2021-10-08T19:27:11.813 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd3289c8700 1 Processor -- start 2021-10-08T19:27:11.813 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd3289c8700 1 -- start start 2021-10-08T19:27:11.813 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd3289c8700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3240f9740 0x7fd32410e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd3289c8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3240fa050 0x7fd32410ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd3289c8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 0x7fd324108890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd3289c8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324108e60 con 0x7fd324102cf0 2021-10-08T19:27:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd3289c8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324108fd0 con 0x7fd3240fa050 2021-10-08T19:27:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd3289c8700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324109190 con 0x7fd3240f9740 2021-10-08T19:27:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd322d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 0x7fd324108890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd32259c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3240f9740 0x7fd32410e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd322d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 0x7fd324108890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34312/0 (socket says 172.21.15.112:34312) 2021-10-08T19:27:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd32259c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3240f9740 0x7fd32410e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56268/0 (socket says 172.21.15.112:56268) 2021-10-08T19:27:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd322d9d700 1 -- 172.21.15.112:0/723591245 learned_addr learned my addr 172.21.15.112:0/723591245 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.808+0000 7fd321d9b700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3240fa050 0x7fd32410ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd32259c700 1 -- 172.21.15.112:0/723591245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3240fa050 msgr2=0x7fd32410ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd32259c700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3240fa050 0x7fd32410ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd32259c700 1 -- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 msgr2=0x7fd324108890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:11.817 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd32259c700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 0x7fd324108890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:11.817 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd32259c700 1 -- 172.21.15.112:0/723591245 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd314005040 con 0x7fd3240f9740 2021-10-08T19:27:11.817 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd322d9d700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd324102cf0 0x7fd324108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:11.817 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd32259c700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3240f9740 0x7fd32410e7c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd314004920 tx=0x7fd314009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:11.817 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400e050 con 0x7fd3240f9740 2021-10-08T19:27:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c009640 con 0x7fd3240f9740 2021-10-08T19:27:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fd31400f040 con 0x7fd3240f9740 2021-10-08T19:27:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3140146d0 con 0x7fd3240f9740 2021-10-08T19:27:11.818 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.809+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3241155c0 con 0x7fd3240f9740 2021-10-08T19:27:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.810+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd324104b80 con 0x7fd3240f9740 2021-10-08T19:27:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fd31401b030 con 0x7fd3240f9740 2021-10-08T19:27:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd312ffd700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fd30c0635e0 0x7fd30c065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7fd31407fb00 con 0x7fd3240f9740 2021-10-08T19:27:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd321d9b700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fd30c0635e0 0x7fd30c065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd312ffd700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] conn(0x7fd30c06d540 0x7fd30c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 --> [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd30c070040 con 0x7fd30c06d540 2021-10-08T19:27:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd31407fee0 con 0x7fd3240f9740 2021-10-08T19:27:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd322d9d700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] conn(0x7fd30c06d540 0x7fd30c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:11.821 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.811+0000 7fd321d9b700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fd30c0635e0 0x7fd30c065a90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd324109ff0 tx=0x7fd31800b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:11.821 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.812+0000 7fd322d9d700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] conn(0x7fd30c06d540 0x7fd30c06f970 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:11.821 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.812+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 <== osd.2 v2:172.21.15.112:6818/799583119 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7fd30c070040 con 0x7fd30c06d540 2021-10-08T19:27:11.828 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.827+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 --> [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd324047b50 con 0x7fd30c06d540 2021-10-08T19:27:11.828 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.827+0000 7fd312ffd700 1 -- 172.21.15.112:0/723591245 <== osd.2 v2:172.21.15.112:6818/799583119 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd324047b50 con 0x7fd30c06d540 2021-10-08T19:27:11.830 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] conn(0x7fd30c06d540 msgr2=0x7fd30c06f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:11.830 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6818/799583119,v1:172.21.15.112:6819/799583119] conn(0x7fd30c06d540 0x7fd30c06f970 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:11.831 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fd30c0635e0 msgr2=0x7fd30c065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:11.831 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fd30c0635e0 0x7fd30c065a90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd324109ff0 tx=0x7fd31800b040 comp rx=0 tx=0).stop 2021-10-08T19:27:11.831 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3240f9740 msgr2=0x7fd32410e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:11.831 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 --2- 172.21.15.112:0/723591245 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd3240f9740 0x7fd32410e7c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd314004920 tx=0x7fd314009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:11.831 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd322d9d700 1 -- 172.21.15.112:0/723591245 reap_dead start 2021-10-08T19:27:11.832 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 shutdown_connections 2021-10-08T19:27:11.832 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 >> 172.21.15.112:0/723591245 conn(0x7fd32406e2a0 msgr2=0x7fd32406fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:11.832 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 shutdown_connections 2021-10-08T19:27:11.832 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:11.828+0000 7fd3289c8700 1 -- 172.21.15.112:0/723591245 wait complete. 2021-10-08T19:27:11.857 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:11 smithi112 ceph-mon[40655]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:11.857 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:11 smithi112 ceph-mon[31694]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:12.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:11 smithi142 ceph-mon[33432]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:12.701 INFO:teuthology.orchestra.run.smithi112.stdout:77309411363 2021-10-08T19:27:12.702 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-10-08T19:27:13.150 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:13.691 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:13 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:27:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:13.978 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:13 smithi142 ceph-mon[33432]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:13.978 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:13 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:13.979 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:13 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:14.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:13 smithi112 ceph-mon[40655]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:14.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:13 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:14.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:13 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:14.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:13 smithi112 ceph-mon[31694]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:14.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:13 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:14.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:13 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:15.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:14 smithi142 ceph-mon[33432]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:27:15.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:14 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:27:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:15.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:14 smithi112 ceph-mon[40655]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:27:15.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:14 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:27:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:15.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:14 smithi112 ceph-mon[31694]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:27:15.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:14 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:27:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:15.570 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:15] "GET /metrics HTTP/1.1" 200 153733 "" "Prometheus/2.18.1" 2021-10-08T19:27:16.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:15 smithi142 ceph-mon[33432]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:16.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:15 smithi112 ceph-mon[40655]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:15 smithi112 ceph-mon[31694]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:16.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:27:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:27:16.797 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.792+0000 7f99ab220700 1 -- 172.21.15.112:0/3428026471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a40fd540 msgr2=0x7f99a40fd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:16.797 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.792+0000 7f99ab220700 1 --2- 172.21.15.112:0/3428026471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a40fd540 0x7f99a40fd910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99a0004710 tx=0x7f99a0009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 -- 172.21.15.112:0/3428026471 shutdown_connections 2021-10-08T19:27:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 --2- 172.21.15.112:0/3428026471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a40f7c90 0x7f99a4104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 --2- 172.21.15.112:0/3428026471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a40fd540 0x7f99a40fd910 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:16.798 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 --2- 172.21.15.112:0/3428026471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a40fde50 0x7f99a40f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:16.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 -- 172.21.15.112:0/3428026471 >> 172.21.15.112:0/3428026471 conn(0x7f99a406e330 msgr2=0x7f99a406e730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:16.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 -- 172.21.15.112:0/3428026471 shutdown_connections 2021-10-08T19:27:16.799 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 -- 172.21.15.112:0/3428026471 wait complete. 2021-10-08T19:27:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 Processor -- start 2021-10-08T19:27:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 -- start start 2021-10-08T19:27:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a40f7c90 0x7f99a4107660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:16.800 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a40fd540 0x7f99a4107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a40fde50 0x7f99a4116ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a4108380 con 0x7f99a40fd540 2021-10-08T19:27:16.801 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a41084f0 con 0x7f99a40fde50 2021-10-08T19:27:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99ab220700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a4117270 con 0x7f99a40f7c90 2021-10-08T19:27:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99aa21e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a40f7c90 0x7f99a4107660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99aa21e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a40f7c90 0x7f99a4107660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56282/0 (socket says 172.21.15.112:56282) 2021-10-08T19:27:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99aa21e700 1 -- 172.21.15.112:0/2293974569 learned_addr learned my addr 172.21.15.112:0/2293974569 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:16.802 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99a9a1d700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a40fd540 0x7f99a4107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.793+0000 7f99aaa1f700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a40fde50 0x7f99a4116ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99aa21e700 1 -- 172.21.15.112:0/2293974569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a40fde50 msgr2=0x7f99a4116ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99aa21e700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a40fde50 0x7f99a4116ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:16.803 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99aa21e700 1 -- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a40fd540 msgr2=0x7f99a4107ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:16.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99aa21e700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a40fd540 0x7f99a4107ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:16.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99aa21e700 1 -- 172.21.15.112:0/2293974569 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c009640 con 0x7f99a40f7c90 2021-10-08T19:27:16.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99aaa1f700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99a40fde50 0x7f99a4116ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:16.804 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99a9a1d700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99a40fd540 0x7f99a4107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99aa21e700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a40f7c90 0x7f99a4107660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99a0014470 tx=0x7f99a0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0019070 con 0x7f99a40f7c90 2021-10-08T19:27:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f99a0000d10 con 0x7f99a40f7c90 2021-10-08T19:27:16.805 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a0005040 con 0x7f99a40f7c90 2021-10-08T19:27:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a001ec70 con 0x7f99a40f7c90 2021-10-08T19:27:16.806 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.794+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a4117710 con 0x7f99a40f7c90 2021-10-08T19:27:16.807 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.795+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99a40f7150 con 0x7f99a40f7c90 2021-10-08T19:27:16.807 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.795+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f99a0007b30 con 0x7f99a40f7c90 2021-10-08T19:27:16.807 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f999affd700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f99900635e0 0x7f9990065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:16.807 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f99a0081460 con 0x7f99a40f7c90 2021-10-08T19:27:16.807 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f99a9a1d700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f99900635e0 0x7f9990065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:16.808 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f999affd700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] conn(0x7f999006d540 0x7f999006f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:16.808 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 --> [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9990070040 con 0x7f999006d540 2021-10-08T19:27:16.808 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99a0083ab0 con 0x7f99a40f7c90 2021-10-08T19:27:16.808 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f99aaa1f700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] conn(0x7f999006d540 0x7f999006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:16.809 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f99a9a1d700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f99900635e0 0x7f9990065a90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99a4062420 tx=0x7f999400b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:16.810 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.796+0000 7f99aaa1f700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] conn(0x7f999006d540 0x7f999006f970 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:16.810 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.797+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 <== osd.3 v2:172.21.15.112:6826/3674507612 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f9990070040 con 0x7f999006d540 2021-10-08T19:27:16.813 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 --> [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99a406fe50 con 0x7f999006d540 2021-10-08T19:27:16.814 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f999affd700 1 -- 172.21.15.112:0/2293974569 <== osd.3 v2:172.21.15.112:6826/3674507612 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f99a406fe50 con 0x7f999006d540 2021-10-08T19:27:16.815 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] conn(0x7f999006d540 msgr2=0x7f999006f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:16.815 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6826/3674507612,v1:172.21.15.112:6827/3674507612] conn(0x7f999006d540 0x7f999006f970 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:16.815 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f99900635e0 msgr2=0x7f9990065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:16.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f99900635e0 0x7f9990065a90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99a4062420 tx=0x7f999400b040 comp rx=0 tx=0).stop 2021-10-08T19:27:16.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a40f7c90 msgr2=0x7f99a4107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:16.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 --2- 172.21.15.112:0/2293974569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99a40f7c90 0x7f99a4107660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99a0014470 tx=0x7f99a0009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:16.816 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99aaa1f700 1 -- 172.21.15.112:0/2293974569 reap_dead start 2021-10-08T19:27:16.817 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 shutdown_connections 2021-10-08T19:27:16.817 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 >> 172.21.15.112:0/2293974569 conn(0x7f99a406e330 msgr2=0x7f99a40f6780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:16.818 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 shutdown_connections 2021-10-08T19:27:16.818 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:16.813+0000 7f99ab220700 1 -- 172.21.15.112:0/2293974569 wait complete. 2021-10-08T19:27:18.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:18.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:17 smithi142 ceph-mon[33432]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:18.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:18.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:17 smithi112 ceph-mon[40655]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:18.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:18.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:17 smithi112 ceph-mon[31694]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:18.364 INFO:teuthology.orchestra.run.smithi112.stdout:111669149730 2021-10-08T19:27:18.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-10-08T19:27:18.972 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:19.448 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:19 smithi112 ceph-mon[31694]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:19.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:19 smithi142 ceph-mon[33432]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:19.809 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:19 smithi112 ceph-mon[40655]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:20.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:20 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:27:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:20.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:20 smithi112 systemd[1]: Starting Ceph alertmanager.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:27:21.311 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.307+0000 7f643d5a2700 1 -- 172.21.15.112:0/1372728242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64380f83f0 msgr2=0x7f6438104400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:21.311 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.307+0000 7f643d5a2700 1 --2- 172.21.15.112:0/1372728242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64380f83f0 0x7f6438104400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6430009ab0 tx=0x7f6430004c50 comp rx=0 tx=0).stop 2021-10-08T19:27:21.312 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 -- 172.21.15.112:0/1372728242 shutdown_connections 2021-10-08T19:27:21.312 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 --2- 172.21.15.112:0/1372728242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64380f83f0 0x7f6438104400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:21.312 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 --2- 172.21.15.112:0/1372728242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64380fd590 0x7f64380fd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:21.312 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 --2- 172.21.15.112:0/1372728242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64380fdf30 0x7f64380f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:21.313 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 -- 172.21.15.112:0/1372728242 >> 172.21.15.112:0/1372728242 conn(0x7f6438070b90 msgr2=0x7f64380f4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:21.313 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 -- 172.21.15.112:0/1372728242 shutdown_connections 2021-10-08T19:27:21.313 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 -- 172.21.15.112:0/1372728242 wait complete. 2021-10-08T19:27:21.313 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 Processor -- start 2021-10-08T19:27:21.313 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 -- start start 2021-10-08T19:27:21.314 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64380f83f0 0x7f6438109740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:21.314 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64380fd590 0x7f6438109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:21.314 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.308+0000 7f643d5a2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64380fdf30 0x7f64381147c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:21.314 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f643d5a2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643810a440 con 0x7f64380fdf30 2021-10-08T19:27:21.315 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f643d5a2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643810a5b0 con 0x7f64380f83f0 2021-10-08T19:27:21.315 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f643d5a2700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6438114d30 con 0x7f64380fd590 2021-10-08T19:27:21.315 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64380fdf30 0x7f64381147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:21.315 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64380fdf30 0x7f64381147c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34342/0 (socket says 172.21.15.112:34342) 2021-10-08T19:27:21.315 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 -- 172.21.15.112:0/1890497106 learned_addr learned my addr 172.21.15.112:0/1890497106 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:21.316 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f6436ffd700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64380f83f0 0x7f6438109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:21.316 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64367fc700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64380fd590 0x7f6438109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:21.316 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 -- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64380fd590 msgr2=0x7f6438109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:21.316 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64380fd590 0x7f6438109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:21.316 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 -- 172.21.15.112:0/1890497106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64380f83f0 msgr2=0x7f6438109740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:21.317 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64380f83f0 0x7f6438109740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:21.317 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 -- 172.21.15.112:0/1890497106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428005040 con 0x7f64380fdf30 2021-10-08T19:27:21.317 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64367fc700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64380fd590 0x7f6438109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:27:21.317 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f64377fe700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64380fdf30 0x7f64381147c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6430009a80 tx=0x7f6430004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:21.318 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643000e030 con 0x7f64380fdf30 2021-10-08T19:27:21.318 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6430009640 con 0x7f64380fdf30 2021-10-08T19:27:21.318 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f643000b870 con 0x7f64380fdf30 2021-10-08T19:27:21.318 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643001cce0 con 0x7f64380fdf30 2021-10-08T19:27:21.318 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.309+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64381152a0 con 0x7f64380fdf30 2021-10-08T19:27:21.319 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.310+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f643806e270 con 0x7f64380fdf30 2021-10-08T19:27:21.320 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.311+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f643002c070 con 0x7f64380fdf30 2021-10-08T19:27:21.320 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.311+0000 7f641f7fe700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f64200635e0 0x7f6420065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:21.320 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.311+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7414+0+0 (secure 0 0 0) 0x7f643001ce40 con 0x7f64380fdf30 2021-10-08T19:27:21.321 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.311+0000 7f6436ffd700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f64200635e0 0x7f6420065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:21.321 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.311+0000 7f641f7fe700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] conn(0x7f642006d540 0x7f642006f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:21.321 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.311+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 --> [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6420070040 con 0x7f642006d540 2021-10-08T19:27:21.321 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.311+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6430082930 con 0x7f64380fdf30 2021-10-08T19:27:21.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.312+0000 7f64367fc700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] conn(0x7f642006d540 0x7f642006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:21.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.312+0000 7f6436ffd700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f64200635e0 0x7f6420065a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6428009fd0 tx=0x7f642800b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:21.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.312+0000 7f64367fc700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] conn(0x7f642006d540 0x7f642006f970 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:21.322 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.313+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 <== osd.4 v2:172.21.15.142:6800/3103692399 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f6420070040 con 0x7f642006d540 2021-10-08T19:27:21.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[40655]: poll took 10892.968 ms: 1 events 2021-10-08T19:27:21.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:21.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[40655]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:21.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:27:21.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:27:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:21.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[31694]: poll took 10892.968 ms: 1 events 2021-10-08T19:27:21.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:21.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:21.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:27:21.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:21 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:27:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:21.330 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.329+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 --> [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f643806e620 con 0x7f642006d540 2021-10-08T19:27:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.330+0000 7f641f7fe700 1 -- 172.21.15.112:0/1890497106 <== osd.4 v2:172.21.15.142:6800/3103692399 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f643806e620 con 0x7f642006d540 2021-10-08T19:27:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.330+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 >> [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] conn(0x7f642006d540 msgr2=0x7f642006f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.330+0000 7f643d5a2700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.142:6800/3103692399,v1:172.21.15.142:6801/3103692399] conn(0x7f642006d540 0x7f642006f970 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f64200635e0 msgr2=0x7f6420065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f643d5a2700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f64200635e0 0x7f6420065a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6428009fd0 tx=0x7f642800b040 comp rx=0 tx=0).stop 2021-10-08T19:27:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64380fdf30 msgr2=0x7f64381147c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f643d5a2700 1 --2- 172.21.15.112:0/1890497106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64380fdf30 0x7f64381147c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6430009a80 tx=0x7f6430004c50 comp rx=0 tx=0).stop 2021-10-08T19:27:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f64377fe700 1 -- 172.21.15.112:0/1890497106 reap_dead start 2021-10-08T19:27:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 shutdown_connections 2021-10-08T19:27:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 >> 172.21.15.112:0/1890497106 conn(0x7f6438070b90 msgr2=0x7f643806d920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 shutdown_connections 2021-10-08T19:27:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:21.331+0000 7f643d5a2700 1 -- 172.21.15.112:0/1890497106 wait complete. 2021-10-08T19:27:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:21 smithi142 ceph-mon[33432]: poll took 10892.968 ms: 1 events 2021-10-08T19:27:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:21 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:21 smithi142 ceph-mon[33432]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:21 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:27:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:21 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:27:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:21.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 bash[73487]: 5b4be44af79d9f058faca66a4b3cfbd84eca9751fe025984bed4d3a5178ecb80 2021-10-08T19:27:21.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:21.325Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-10-08T19:27:21.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:21.325Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-10-08T19:27:21.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:21.325Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.112 port=9094 2021-10-08T19:27:21.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:21.326Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-10-08T19:27:21.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:21.346Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:27:21.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:21.347Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:27:21.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:21.349Z caller=main.go:497 msg=Listening address=:9093 2021-10-08T19:27:21.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:21 smithi112 systemd[1]: Started Ceph alertmanager.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:27:22.185 INFO:teuthology.orchestra.run.smithi112.stdout:133143986206 2021-10-08T19:27:22.186 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-10-08T19:27:22.210 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[40655]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:22.211 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.211 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.211 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.211 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:27:22.212 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.212 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[31694]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:22.212 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.213 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.213 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.213 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:27:22.213 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:22 smithi142 ceph-mon[33432]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:27:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:22.690 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:23.193 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: poll took 1560.733 ms: 1 events 2021-10-08T19:27:23.193 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: Sending message to agent on host smithi112 2021-10-08T19:27:23.194 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:27:23.194 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: Deploying daemon grafana.a on smithi142 2021-10-08T19:27:23.194 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi112 2021-10-08T19:27:23.194 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-10-08T19:27:23.195 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-10-08T19:27:23.195 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-10-08T19:27:23.195 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.195 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-10-08T19:27:23.196 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.196 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.196 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.196 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:23.196 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:23.197 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:23.197 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:23.197 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:23.197 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: poll took 1560.733 ms: 1 events 2021-10-08T19:27:23.198 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: Sending message to agent on host smithi112 2021-10-08T19:27:23.198 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:27:23.198 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: Deploying daemon grafana.a on smithi142 2021-10-08T19:27:23.198 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi112 2021-10-08T19:27:23.199 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-10-08T19:27:23.199 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-10-08T19:27:23.199 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-10-08T19:27:23.199 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.199 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-10-08T19:27:23.200 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.200 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.200 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.200 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:23.201 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:23.201 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:23.201 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:23.201 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:23.522 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:27:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: poll took 1560.733 ms: 1 events 2021-10-08T19:27:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: Sending message to agent on host smithi112 2021-10-08T19:27:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-10-08T19:27:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: Deploying daemon grafana.a on smithi142 2021-10-08T19:27:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi112 2021-10-08T19:27:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-10-08T19:27:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-10-08T19:27:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-10-08T19:27:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-10-08T19:27:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-10-08T19:27:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:23.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:27:23.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:23.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:27:23.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:23.645 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:23 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:23.327Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000096111s 2021-10-08T19:27:24.393 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[40655]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:24.393 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2021-10-08T19:27:24.393 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]': finished 2021-10-08T19:27:24.394 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-10-08T19:27:24.394 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2021-10-08T19:27:24.394 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[40655]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:27:24.394 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[31694]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:24.395 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2021-10-08T19:27:24.395 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]': finished 2021-10-08T19:27:24.395 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-10-08T19:27:24.395 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2021-10-08T19:27:24.396 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:24 smithi112 ceph-mon[31694]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:27:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:24 smithi142 ceph-mon[33432]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2021-10-08T19:27:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]': finished 2021-10-08T19:27:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-10-08T19:27:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2021-10-08T19:27:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:24 smithi142 ceph-mon[33432]: osdmap e68: 8 total, 8 up, 8 in 2021-10-08T19:27:24.937 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 -- 172.21.15.112:0/4246653946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35200f84e0 msgr2=0x7f3520104410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:24.937 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 --2- 172.21.15.112:0/4246653946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35200f84e0 0x7f3520104410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3518009a90 tx=0x7f3518004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:24.937 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 -- 172.21.15.112:0/4246653946 shutdown_connections 2021-10-08T19:27:24.938 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 --2- 172.21.15.112:0/4246653946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35200f84e0 0x7f3520104410 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:24.938 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 --2- 172.21.15.112:0/4246653946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35200fd5a0 0x7f35200fd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:24.938 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 --2- 172.21.15.112:0/4246653946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200fdf40 0x7f35200f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:24.938 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 -- 172.21.15.112:0/4246653946 >> 172.21.15.112:0/4246653946 conn(0x7f3520070b90 msgr2=0x7f35200f4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 -- 172.21.15.112:0/4246653946 shutdown_connections 2021-10-08T19:27:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.932+0000 7f3527ada700 1 -- 172.21.15.112:0/4246653946 wait complete. 2021-10-08T19:27:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3527ada700 1 Processor -- start 2021-10-08T19:27:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3527ada700 1 -- start start 2021-10-08T19:27:24.939 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3527ada700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35200f84e0 0x7f35201096d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3527ada700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200fd5a0 0x7f3520109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3527ada700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35200fdf40 0x7f3520114750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3527ada700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352010a3f0 con 0x7f35200fdf40 2021-10-08T19:27:24.940 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3527ada700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352010a560 con 0x7f35200fd5a0 2021-10-08T19:27:24.941 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3527ada700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3520114ce0 con 0x7f35200f84e0 2021-10-08T19:27:24.941 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3525876700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35200f84e0 0x7f35201096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:24.941 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3526077700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35200fdf40 0x7f3520114750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3525876700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35200f84e0 0x7f35201096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56314/0 (socket says 172.21.15.112:56314) 2021-10-08T19:27:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3525876700 1 -- 172.21.15.112:0/1780053458 learned_addr learned my addr 172.21.15.112:0/1780053458 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3525075700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200fd5a0 0x7f3520109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:24.943 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3526077700 1 -- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35200f84e0 msgr2=0x7f35201096d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:24.943 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3526077700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35200f84e0 0x7f35201096d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:24.943 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3526077700 1 -- 172.21.15.112:0/1780053458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200fd5a0 msgr2=0x7f3520109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:24.943 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3526077700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200fd5a0 0x7f3520109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:24.944 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3526077700 1 -- 172.21.15.112:0/1780053458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518009640 con 0x7f35200fdf40 2021-10-08T19:27:24.944 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.933+0000 7f3525876700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35200f84e0 0x7f35201096d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:24.944 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.934+0000 7f3526077700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35200fdf40 0x7f3520114750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3518015040 tx=0x7f3518004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:24.944 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.934+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800e070 con 0x7f35200fdf40 2021-10-08T19:27:24.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.934+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3518009450 con 0x7f35200fdf40 2021-10-08T19:27:24.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.934+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3520114f60 con 0x7f35200fdf40 2021-10-08T19:27:24.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.934+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518012410 con 0x7f35200fdf40 2021-10-08T19:27:24.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.934+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35201153c0 con 0x7f35200fdf40 2021-10-08T19:27:24.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.934+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35200fcb30 con 0x7f35200fdf40 2021-10-08T19:27:24.946 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.935+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f351801c440 con 0x7f35200fdf40 2021-10-08T19:27:24.946 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.935+0000 7f35167fc700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f350c0635e0 0x7f350c065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:24.946 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.935+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f3518081e20 con 0x7f35200fdf40 2021-10-08T19:27:24.946 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.935+0000 7f3525876700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f350c0635e0 0x7f350c065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.936+0000 7f35167fc700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] conn(0x7f350c06d700 0x7f350c06fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.936+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 --> [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f350c070260 con 0x7f350c06d700 2021-10-08T19:27:24.947 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.936+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3518087480 con 0x7f35200fdf40 2021-10-08T19:27:24.948 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.936+0000 7f3525876700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f350c0635e0 0x7f350c065a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f351c007a30 tx=0x7f351c00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:24.948 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.936+0000 7f3525075700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] conn(0x7f350c06d700 0x7f350c06fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:24.949 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.936+0000 7f3525075700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] conn(0x7f350c06d700 0x7f350c06fb90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:24.949 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.937+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 <== osd.5 v2:172.21.15.142:6808/2168767914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f350c070260 con 0x7f350c06d700 2021-10-08T19:27:24.953 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.952+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 --> [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35200fcee0 con 0x7f350c06d700 2021-10-08T19:27:24.954 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.952+0000 7f35167fc700 1 -- 172.21.15.112:0/1780053458 <== osd.5 v2:172.21.15.142:6808/2168767914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f35200fcee0 con 0x7f350c06d700 2021-10-08T19:27:24.954 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.952+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 >> [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] conn(0x7f350c06d700 msgr2=0x7f350c06fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:24.954 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.952+0000 7f3527ada700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.142:6808/2168767914,v1:172.21.15.142:6809/2168767914] conn(0x7f350c06d700 0x7f350c06fb90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:24.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f350c0635e0 msgr2=0x7f350c065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:24.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3527ada700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f350c0635e0 0x7f350c065a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f351c007a30 tx=0x7f351c00b040 comp rx=0 tx=0).stop 2021-10-08T19:27:24.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35200fdf40 msgr2=0x7f3520114750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:24.955 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3527ada700 1 --2- 172.21.15.112:0/1780053458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35200fdf40 0x7f3520114750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3518015040 tx=0x7f3518004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:24.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3526077700 1 -- 172.21.15.112:0/1780053458 reap_dead start 2021-10-08T19:27:24.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 shutdown_connections 2021-10-08T19:27:24.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 >> 172.21.15.112:0/1780053458 conn(0x7f3520070b90 msgr2=0x7f35200fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:24.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 shutdown_connections 2021-10-08T19:27:24.956 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:24.953+0000 7f3527ada700 1 -- 172.21.15.112:0/1780053458 wait complete. 2021-10-08T19:27:25.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:25 smithi142 ceph-mon[33432]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:27:25.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:25 smithi142 ceph-mon[33432]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:25.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:25] "GET /metrics HTTP/1.1" 200 153733 "" "Prometheus/2.18.1" 2021-10-08T19:27:25.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:25 smithi112 ceph-mon[31694]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:27:25.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:25 smithi112 ceph-mon[31694]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:25.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:25 smithi112 ceph-mon[40655]: osdmap e69: 8 total, 8 up, 8 in 2021-10-08T19:27:25.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:25 smithi112 ceph-mon[40655]: pgmap v36: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:26.205 INFO:teuthology.orchestra.run.smithi112.stdout:163208757275 2021-10-08T19:27:26.205 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-10-08T19:27:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:26 smithi142 ceph-mon[33432]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:26.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:27:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:27:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:26 smithi112 ceph-mon[40655]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:26 smithi112 ceph-mon[31694]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2021-10-08T19:27:26.655 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:27.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:27 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:27 smithi112 ceph-mon[40655]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:27.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:27 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:27 smithi112 ceph-mon[31694]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:27.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:27 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:27.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:27 smithi142 ceph-mon[33432]: pgmap v37: 132 pgs: 4 peering, 128 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:28.277 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/2100384449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fd5d0 msgr2=0x7f2dcc0fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 --2- 172.21.15.112:0/2100384449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fd5d0 0x7f2dcc0fd9a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc004650 tx=0x7f2dbc009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/2100384449 shutdown_connections 2021-10-08T19:27:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 --2- 172.21.15.112:0/2100384449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dcc0f7d60 0x7f2dcc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 --2- 172.21.15.112:0/2100384449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fd5d0 0x7f2dcc0fd9a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:28.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 --2- 172.21.15.112:0/2100384449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dcc0fdf70 0x7f2dcc0f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:28.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/2100384449 >> 172.21.15.112:0/2100384449 conn(0x7f2dcc06f330 msgr2=0x7f2dcc06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:28.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/2100384449 shutdown_connections 2021-10-08T19:27:28.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.273+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/2100384449 wait complete. 2021-10-08T19:27:28.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dd1fb0700 1 Processor -- start 2021-10-08T19:27:28.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dd1fb0700 1 -- start start 2021-10-08T19:27:28.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dd1fb0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dcc0f7d60 0x7f2dcc109920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:28.280 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dd1fb0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fd5d0 0x7f2dcc109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:28.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dd1fb0700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dcc0fdf70 0x7f2dcc1149a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:28.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dd1fb0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc10a640 con 0x7f2dcc0fd5d0 2021-10-08T19:27:28.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dd1fb0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc10a7b0 con 0x7f2dcc0f7d60 2021-10-08T19:27:28.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dd1fb0700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc114f30 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dcb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dcc0f7d60 0x7f2dcc109920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dc2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fd5d0 0x7f2dcc109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dcbfff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dcc0fdf70 0x7f2dcc1149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dcb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dcc0f7d60 0x7f2dcc109920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.112:53544/0 (socket says 172.21.15.112:53544) 2021-10-08T19:27:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.274+0000 7f2dcb7fe700 1 -- 172.21.15.112:0/354218978 learned_addr learned my addr 172.21.15.112:0/354218978 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dcbfff700 1 -- 172.21.15.112:0/354218978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dcc0f7d60 msgr2=0x7f2dcc109920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dcbfff700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dcc0f7d60 0x7f2dcc109920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dcbfff700 1 -- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fd5d0 msgr2=0x7f2dcc109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dcbfff700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fd5d0 0x7f2dcc109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dcbfff700 1 -- 172.21.15.112:0/354218978 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4009640 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dcb7fe700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2dcc0f7d60 0x7f2dcc109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dcbfff700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dcc0fdf70 0x7f2dcc1149a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4001cb0 tx=0x7f2dc4004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:28.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40092e0 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f2dc4009440 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dbc005040 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.286 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4007a40 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.286 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.275+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc1155a0 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.287 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.276+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dcc0f7040 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.277+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f2dc401c030 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.277+0000 7f2dc8ff9700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2db80635e0 0x7f2db8065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.277+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f2dc4080960 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.277+0000 7f2dcb7fe700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2db80635e0 0x7f2db8065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.277+0000 7f2dc8ff9700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] conn(0x7f2db806d700 0x7f2db806fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.277+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 --> [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2db8070260 con 0x7f2db806d700 2021-10-08T19:27:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.277+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dc4080c90 con 0x7f2dcc0fdf70 2021-10-08T19:27:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.278+0000 7f2dc2ffd700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] conn(0x7f2db806d700 0x7f2db806fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:28.290 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.278+0000 7f2dcb7fe700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2db80635e0 0x7f2db8065a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000e50 tx=0x7f2dbc009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:28.290 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.278+0000 7f2dc2ffd700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] conn(0x7f2db806d700 0x7f2db806fb90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:28.290 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.279+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 <== osd.6 v2:172.21.15.142:6816/2191075949 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f2db8070260 con 0x7f2db806d700 2021-10-08T19:27:28.296 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.295+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 --> [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2dcc0f73f0 con 0x7f2db806d700 2021-10-08T19:27:28.296 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.295+0000 7f2dc8ff9700 1 -- 172.21.15.112:0/354218978 <== osd.6 v2:172.21.15.142:6816/2191075949 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2dcc0f73f0 con 0x7f2db806d700 2021-10-08T19:27:28.298 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 >> [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] conn(0x7f2db806d700 msgr2=0x7f2db806fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:28.298 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.142:6816/2191075949,v1:172.21.15.142:6817/2191075949] conn(0x7f2db806d700 0x7f2db806fb90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:28.298 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2db80635e0 msgr2=0x7f2db8065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:28.299 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2db80635e0 0x7f2db8065a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc000e50 tx=0x7f2dbc009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:28.299 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dcc0fdf70 msgr2=0x7f2dcc1149a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:28.299 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 --2- 172.21.15.112:0/354218978 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dcc0fdf70 0x7f2dcc1149a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4001cb0 tx=0x7f2dc4004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:28.299 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dcbfff700 1 -- 172.21.15.112:0/354218978 reap_dead start 2021-10-08T19:27:28.300 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 shutdown_connections 2021-10-08T19:27:28.300 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 >> 172.21.15.112:0/354218978 conn(0x7f2dcc06f330 msgr2=0x7f2dcc0f66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:28.300 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 shutdown_connections 2021-10-08T19:27:28.300 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:28.296+0000 7f2dd1fb0700 1 -- 172.21.15.112:0/354218978 wait complete. 2021-10-08T19:27:29.015 INFO:teuthology.orchestra.run.smithi112.stdout:193273528344 2021-10-08T19:27:29.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-10-08T19:27:29.464 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:29.720 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:29 smithi112 ceph-mon[31694]: pgmap v38: 132 pgs: 3 peering, 129 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:27:29.721 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:29 smithi112 ceph-mon[40655]: pgmap v38: 132 pgs: 3 peering, 129 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:27:29.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:29 smithi142 ceph-mon[33432]: pgmap v38: 132 pgs: 3 peering, 129 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 13 B/s, 0 objects/s recovering 2021-10-08T19:27:31.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:30 smithi112 ceph-mon[40655]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2021-10-08T19:27:31.025 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:30 smithi112 ceph-mon[40655]: Cluster is now healthy 2021-10-08T19:27:31.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:30 smithi142 ceph-mon[33432]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2021-10-08T19:27:31.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:30 smithi142 ceph-mon[33432]: Cluster is now healthy 2021-10-08T19:27:31.027 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:30 smithi112 ceph-mon[31694]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2021-10-08T19:27:31.027 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:30 smithi112 ceph-mon[31694]: Cluster is now healthy 2021-10-08T19:27:31.233 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.229+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/532866809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb40fe720 msgr2=0x7f7eb40feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:31.234 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.229+0000 7f7ebc2d4700 1 --2- 172.21.15.112:0/532866809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb40fe720 0x7f7eb40feaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009a60 tx=0x7f7eb0004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:31.234 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/532866809 shutdown_connections 2021-10-08T19:27:31.234 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 --2- 172.21.15.112:0/532866809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40f8ea0 0x7f7eb4105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 --2- 172.21.15.112:0/532866809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb40fe720 0x7f7eb40feaf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 --2- 172.21.15.112:0/532866809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb40ff0c0 0x7f7eb40f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/532866809 >> 172.21.15.112:0/532866809 conn(0x7f7eb406f3f0 msgr2=0x7f7eb40f6820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/532866809 shutdown_connections 2021-10-08T19:27:31.235 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/532866809 wait complete. 2021-10-08T19:27:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 Processor -- start 2021-10-08T19:27:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 -- start start 2021-10-08T19:27:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb40f8ea0 0x7f7eb410e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:31.236 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb40fe720 0x7f7eb410ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40ff0c0 0x7f7eb4108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4109080 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.237 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb41091f0 con 0x7f7eb40ff0c0 2021-10-08T19:27:31.238 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.230+0000 7f7ebc2d4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb41093b0 con 0x7f7eb40fe720 2021-10-08T19:27:31.238 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb40f8ea0 0x7f7eb410e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:31.239 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb40f8ea0 0x7f7eb410e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34382/0 (socket says 172.21.15.112:34382) 2021-10-08T19:27:31.239 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 -- 172.21.15.112:0/2412606882 learned_addr learned my addr 172.21.15.112:0/2412606882 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:31.239 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eb986f700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb40fe720 0x7f7eb410ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:31.240 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba871700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40ff0c0 0x7f7eb4108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:31.240 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 -- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb40fe720 msgr2=0x7f7eb410ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:31.240 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb40fe720 0x7f7eb410ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:31.241 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 -- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40ff0c0 msgr2=0x7f7eb4108ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:31.241 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40ff0c0 0x7f7eb4108ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:31.242 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 -- 172.21.15.112:0/2412606882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4005040 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.242 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eb986f700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb40fe720 0x7f7eb410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:27:31.242 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba871700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7eb40ff0c0 0x7f7eb4108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:27:31.243 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eba070700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb40f8ea0 0x7f7eb410e9e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000bed0 tx=0x7f7eb0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:31.243 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000e030 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.243 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f7eb0009450 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.243 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb0009640 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.244 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb001caf0 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.244 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.231+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb41157e0 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.244 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.232+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7eb4059a80 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.246 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f7eb002c070 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.246 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eaaffd700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f7ea00635e0 0x7f7ea0065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:31.246 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f7eb0081ec0 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.246 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eb986f700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f7ea00635e0 0x7f7ea0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:31.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eaaffd700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] conn(0x7f7ea006d680 0x7f7ea006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:31.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 --> [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ea00701e0 con 0x7f7ea006d680 2021-10-08T19:27:31.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7eb0087520 con 0x7f7eb40f8ea0 2021-10-08T19:27:31.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eba871700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] conn(0x7f7ea006d680 0x7f7ea006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:31.247 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.233+0000 7f7eb986f700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f7ea00635e0 0x7f7ea0065a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7eb410a210 tx=0x7f7ea4009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:31.248 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.234+0000 7f7eba871700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] conn(0x7f7ea006d680 0x7f7ea006fb10 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:31.248 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.234+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 <== osd.7 v2:172.21.15.142:6824/1647586049 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23746 (crc 0 0 0) 0x7f7ea00701e0 con 0x7f7ea006d680 2021-10-08T19:27:31.251 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.249+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 --> [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7eb4047b50 con 0x7f7ea006d680 2021-10-08T19:27:31.251 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7eaaffd700 1 -- 172.21.15.112:0/2412606882 <== osd.7 v2:172.21.15.142:6824/1647586049 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7eb4047b50 con 0x7f7ea006d680 2021-10-08T19:27:31.252 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] conn(0x7f7ea006d680 msgr2=0x7f7ea006fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:31.253 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7ebc2d4700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.142:6824/1647586049,v1:172.21.15.142:6825/1647586049] conn(0x7f7ea006d680 0x7f7ea006fb10 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:31.253 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f7ea00635e0 msgr2=0x7f7ea0065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:31.253 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7ebc2d4700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f7ea00635e0 0x7f7ea0065a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7eb410a210 tx=0x7f7ea4009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:31.253 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb40f8ea0 msgr2=0x7f7eb410e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:31.254 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7ebc2d4700 1 --2- 172.21.15.112:0/2412606882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb40f8ea0 0x7f7eb410e9e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000bed0 tx=0x7f7eb0004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:31.254 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7eba871700 1 -- 172.21.15.112:0/2412606882 reap_dead start 2021-10-08T19:27:31.254 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 shutdown_connections 2021-10-08T19:27:31.254 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.250+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 >> 172.21.15.112:0/2412606882 conn(0x7f7eb406f3f0 msgr2=0x7f7eb4070690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:31.255 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.251+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 shutdown_connections 2021-10-08T19:27:31.255 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:31.251+0000 7f7ebc2d4700 1 -- 172.21.15.112:0/2412606882 wait complete. 2021-10-08T19:27:31.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:27:31 smithi112 conmon[73761]: level=info ts=2021-10-08T19:27:31.327Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000572158s 2021-10-08T19:27:32.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:31 smithi142 ceph-mon[33432]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 1 objects/s recovering 2021-10-08T19:27:32.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:31 smithi112 ceph-mon[40655]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 1 objects/s recovering 2021-10-08T19:27:32.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:31 smithi112 ceph-mon[31694]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 54 B/s, 1 objects/s recovering 2021-10-08T19:27:32.273 INFO:teuthology.orchestra.run.smithi112.stdout:223338299413 2021-10-08T19:27:32.274 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-10-08T19:27:32.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:32 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:27:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:33.186 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:33.187 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:33.187 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:27:33.187 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:27:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:33.188 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[31694]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 46 B/s, 1 objects/s recovering 2021-10-08T19:27:33.522 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:27:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:33.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:33 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:33 smithi142 ceph-mon[33432]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:33 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:27:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:33 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:27:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:33 smithi142 ceph-mon[33432]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 46 B/s, 1 objects/s recovering 2021-10-08T19:27:33.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:33.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[40655]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:27:33.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:27:33.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:27:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:27:33.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:33 smithi112 ceph-mon[40655]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 46 B/s, 1 objects/s recovering 2021-10-08T19:27:34.276 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1680304184 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 msgr2=0x7f9e140f7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1680304184 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 0x7f9e140f7640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e040046e0 tx=0x7f9e04009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1680304184 shutdown_connections 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1680304184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e140f7d20 0x7f9e141043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.277 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1680304184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e140fd5e0 0x7f9e140fd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1680304184 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 0x7f9e140f7640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1680304184 >> 172.21.15.112:0/1680304184 conn(0x7f9e1406f330 msgr2=0x7f9e1406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:34.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1680304184 shutdown_connections 2021-10-08T19:27:34.278 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.274+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1680304184 wait complete. 2021-10-08T19:27:34.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e1aa6a700 1 Processor -- start 2021-10-08T19:27:34.279 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e1aa6a700 1 -- start start 2021-10-08T19:27:34.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e1aa6a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e140f7d20 0x7f9e1410da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:34.281 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e1aa6a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e140fd5e0 0x7f9e1410df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:34.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e1aa6a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 0x7f9e14107900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:34.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e1aa6a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14107ed0 con 0x7f9e140fd5e0 2021-10-08T19:27:34.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e1aa6a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14108040 con 0x7f9e140f7d20 2021-10-08T19:27:34.282 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e1aa6a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14108200 con 0x7f9e140fdf80 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e19007700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 0x7f9e14107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e0bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e140fd5e0 0x7f9e1410df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e18806700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e140f7d20 0x7f9e1410da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e19007700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 0x7f9e14107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56362/0 (socket says 172.21.15.112:56362) 2021-10-08T19:27:34.283 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e18806700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e140f7d20 0x7f9e1410da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.112:53574/0 (socket says 172.21.15.112:53574) 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e0bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e140fd5e0 0x7f9e1410df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34400/0 (socket says 172.21.15.112:34400) 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e19007700 1 -- 172.21.15.112:0/1423884637 learned_addr learned my addr 172.21.15.112:0/1423884637 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e19007700 1 -- 172.21.15.112:0/1423884637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e140f7d20 msgr2=0x7f9e1410da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:34.284 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e19007700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e140f7d20 0x7f9e1410da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e19007700 1 -- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e140fd5e0 msgr2=0x7f9e1410df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e19007700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e140fd5e0 0x7f9e1410df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e19007700 1 -- 172.21.15.112:0/1423884637 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c005040 con 0x7f9e140fdf80 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.275+0000 7f9e0bfff700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e140fd5e0 0x7f9e1410df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:34.285 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.276+0000 7f9e19007700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 0x7f9e14107900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0048f0 tx=0x7f9e0c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:34.286 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.276+0000 7f9e097fa700 1 -- 172.21.15.112:0/1423884637 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00e050 con 0x7f9e140fdf80 2021-10-08T19:27:34.286 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.276+0000 7f9e097fa700 1 -- 172.21.15.112:0/1423884637 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f9e0c00f040 con 0x7f9e140fdf80 2021-10-08T19:27:34.287 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.276+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e04005040 con 0x7f9e140fdf80 2021-10-08T19:27:34.287 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.276+0000 7f9e097fa700 1 -- 172.21.15.112:0/1423884637 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0146d0 con 0x7f9e140fdf80 2021-10-08T19:27:34.288 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.276+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e140619c0 con 0x7f9e140fdf80 2021-10-08T19:27:34.288 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.277+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1406ff30 con 0x7f9e140fdf80 2021-10-08T19:27:34.288 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.278+0000 7f9e097fa700 1 -- 172.21.15.112:0/1423884637 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f9e0c01b030 con 0x7f9e140fdf80 2021-10-08T19:27:34.288 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.278+0000 7f9e097fa700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f9dfc0635e0 0x7f9dfc065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.278+0000 7f9e097fa700 1 -- 172.21.15.112:0/1423884637 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f9e0c07fd60 con 0x7f9e140fdf80 2021-10-08T19:27:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.278+0000 7f9e18806700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f9dfc0635e0 0x7f9dfc065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:34.289 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.279+0000 7f9e18806700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f9dfc0635e0 0x7f9dfc065a90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e10004fd0 tx=0x7f9e1000b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:34.290 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.282+0000 7f9e097fa700 1 -- 172.21.15.112:0/1423884637 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f9e0c052350 con 0x7f9e140fdf80 2021-10-08T19:27:34.443 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.440+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e140472f0 con 0x7f9e140fdf80 2021-10-08T19:27:34.443 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.441+0000 7f9e097fa700 1 -- 172.21.15.112:0/1423884637 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e0c019070 con 0x7f9e140fdf80 2021-10-08T19:27:34.444 INFO:teuthology.orchestra.run.smithi112.stdout:34359738416 2021-10-08T19:27:34.446 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f9dfc0635e0 msgr2=0x7f9dfc065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:34.447 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f9dfc0635e0 0x7f9dfc065a90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e10004fd0 tx=0x7f9e1000b040 comp rx=0 tx=0).stop 2021-10-08T19:27:34.447 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 msgr2=0x7f9e14107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:34.448 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 0x7f9e14107900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0048f0 tx=0x7f9e0c009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:34.449 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 shutdown_connections 2021-10-08T19:27:34.449 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f9dfc0635e0 0x7f9dfc065a90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.450 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e140fdf80 0x7f9e14107900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.450 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e140f7d20 0x7f9e1410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.451 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 --2- 172.21.15.112:0/1423884637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e140fd5e0 0x7f9e1410df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:34.451 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.442+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 >> 172.21.15.112:0/1423884637 conn(0x7f9e1406f330 msgr2=0x7f9e140f6890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:34.451 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.443+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 shutdown_connections 2021-10-08T19:27:34.452 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:34.443+0000 7f9e1aa6a700 1 -- 172.21.15.112:0/1423884637 wait complete. 2021-10-08T19:27:34.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1423884637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:27:34.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1423884637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:27:34.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1423884637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-10-08T19:27:35.219 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738411 got 34359738416 for osd.0 2021-10-08T19:27:35.220 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-10-08T19:27:35.451 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:35] "GET /metrics HTTP/1.1" 200 153733 "" "Prometheus/2.18.1" 2021-10-08T19:27:35.659 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:35.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:35 smithi142 ceph-mon[33432]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 0 op/s; 41 B/s, 1 objects/s recovering 2021-10-08T19:27:35.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:35 smithi112 ceph-mon[31694]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 0 op/s; 41 B/s, 1 objects/s recovering 2021-10-08T19:27:35.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:35 smithi112 ceph-mon[40655]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 0 op/s; 41 B/s, 1 objects/s recovering 2021-10-08T19:27:36.522 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:27:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:27:37.255 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 -- 172.21.15.112:0/3444333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 msgr2=0x7fdb9c1055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:37.255 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 --2- 172.21.15.112:0/3444333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 0x7fdb9c1055f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009a60 tx=0x7fdb94004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:37.255 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 -- 172.21.15.112:0/3444333 shutdown_connections 2021-10-08T19:27:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 --2- 172.21.15.112:0/3444333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 0x7fdb9c1055f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 --2- 172.21.15.112:0/3444333 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c0fe7d0 0x7fdb9c0feba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 --2- 172.21.15.112:0/3444333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb9c0ff170 0x7fdb9c0f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.256 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 -- 172.21.15.112:0/3444333 >> 172.21.15.112:0/3444333 conn(0x7fdb9c06f500 msgr2=0x7fdb9c0f67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:37.257 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 -- 172.21.15.112:0/3444333 shutdown_connections 2021-10-08T19:27:37.257 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.250+0000 7fdba3419700 1 -- 172.21.15.112:0/3444333 wait complete. 2021-10-08T19:27:37.257 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba3419700 1 Processor -- start 2021-10-08T19:27:37.257 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba3419700 1 -- start start 2021-10-08T19:27:37.258 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba3419700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 0x7fdb9c10e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:37.258 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba3419700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb9c0fe7d0 0x7fdb9c10eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:37.258 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba3419700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c0ff170 0x7fdb9c108690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:37.258 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba3419700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c108c60 con 0x7fdb9c0f8f00 2021-10-08T19:27:37.258 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba3419700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c108dd0 con 0x7fdb9c0fe7d0 2021-10-08T19:27:37.259 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba3419700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c108f90 con 0x7fdb9c0ff170 2021-10-08T19:27:37.259 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba11b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 0x7fdb9c10e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:37.259 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba19b6700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c0ff170 0x7fdb9c108690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:37.259 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba11b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 0x7fdb9c10e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34412/0 (socket says 172.21.15.112:34412) 2021-10-08T19:27:37.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba09b4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb9c0fe7d0 0x7fdb9c10eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:37.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba11b5700 1 -- 172.21.15.112:0/3796187335 learned_addr learned my addr 172.21.15.112:0/3796187335 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:37.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba19b6700 1 -- 172.21.15.112:0/3796187335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb9c0fe7d0 msgr2=0x7fdb9c10eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:37.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba19b6700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb9c0fe7d0 0x7fdb9c10eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba19b6700 1 -- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 msgr2=0x7fdb9c10e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:37.261 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba19b6700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 0x7fdb9c10e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.261 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba19b6700 1 -- 172.21.15.112:0/3796187335 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98005040 con 0x7fdb9c0ff170 2021-10-08T19:27:37.261 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba11b5700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 0x7fdb9c10e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:37.261 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.251+0000 7fdba19b6700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c0ff170 0x7fdb9c108690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb94015040 tx=0x7fdb94004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:37.261 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.252+0000 7fdb91ffb700 1 -- 172.21.15.112:0/3796187335 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9400e070 con 0x7fdb9c0ff170 2021-10-08T19:27:37.262 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.252+0000 7fdb91ffb700 1 -- 172.21.15.112:0/3796187335 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fdb94009450 con 0x7fdb9c0ff170 2021-10-08T19:27:37.262 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.252+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb94009640 con 0x7fdb9c0ff170 2021-10-08T19:27:37.262 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.252+0000 7fdb91ffb700 1 -- 172.21.15.112:0/3796187335 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9401cd90 con 0x7fdb9c0ff170 2021-10-08T19:27:37.262 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.252+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c1094e0 con 0x7fdb9c0ff170 2021-10-08T19:27:37.263 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.253+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c047b50 con 0x7fdb9c0ff170 2021-10-08T19:27:37.263 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.253+0000 7fdb91ffb700 1 -- 172.21.15.112:0/3796187335 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fdb9401c440 con 0x7fdb9c0ff170 2021-10-08T19:27:37.264 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.254+0000 7fdb91ffb700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdb880635e0 0x7fdb88065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:37.264 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.254+0000 7fdb91ffb700 1 -- 172.21.15.112:0/3796187335 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7fdb94081ec0 con 0x7fdb9c0ff170 2021-10-08T19:27:37.264 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.254+0000 7fdba11b5700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdb880635e0 0x7fdb88065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:37.265 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.254+0000 7fdba11b5700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdb880635e0 0x7fdb88065a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009fd0 tx=0x7fdb9800b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:37.265 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.258+0000 7fdb91ffb700 1 -- 172.21.15.112:0/3796187335 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fdb94054520 con 0x7fdb9c0ff170 2021-10-08T19:27:37.417 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.415+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb9c109ba0 con 0x7fdb9c0ff170 2021-10-08T19:27:37.417 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.415+0000 7fdb91ffb700 1 -- 172.21.15.112:0/3796187335 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb94017090 con 0x7fdb9c0ff170 2021-10-08T19:27:37.418 INFO:teuthology.orchestra.run.smithi112.stdout:55834574892 2021-10-08T19:27:37.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdb880635e0 msgr2=0x7fdb88065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:37.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdb880635e0 0x7fdb88065a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009fd0 tx=0x7fdb9800b040 comp rx=0 tx=0).stop 2021-10-08T19:27:37.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c0ff170 msgr2=0x7fdb9c108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:37.419 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c0ff170 0x7fdb9c108690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb94015040 tx=0x7fdb94004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:37.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 shutdown_connections 2021-10-08T19:27:37.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdb880635e0 0x7fdb88065a90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdb9c0ff170 0x7fdb9c108690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb9c0f8f00 0x7fdb9c10e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.420 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 --2- 172.21.15.112:0/3796187335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb9c0fe7d0 0x7fdb9c10eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:37.421 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 >> 172.21.15.112:0/3796187335 conn(0x7fdb9c06f500 msgr2=0x7fdb9c0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:37.421 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 shutdown_connections 2021-10-08T19:27:37.421 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:37.417+0000 7fdba3419700 1 -- 172.21.15.112:0/3796187335 wait complete. 2021-10-08T19:27:37.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:37 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:37.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:37 smithi112 ceph-mon[40655]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36 B/s, 1 objects/s recovering 2021-10-08T19:27:37.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3796187335' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:27:37.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:37 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:37.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:37 smithi112 ceph-mon[31694]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36 B/s, 1 objects/s recovering 2021-10-08T19:27:37.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3796187335' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:27:38.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:37 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:38.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:37 smithi142 ceph-mon[33432]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36 B/s, 1 objects/s recovering 2021-10-08T19:27:38.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3796187335' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-10-08T19:27:38.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574887 got 55834574892 for osd.1 2021-10-08T19:27:38.067 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-10-08T19:27:38.504 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:39.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:38 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:39.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:38 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:39.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:38 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:39.880 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:39 smithi112 ceph-mon[31694]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36 B/s, 1 objects/s recovering 2021-10-08T19:27:39.881 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:39 smithi112 ceph-mon[40655]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36 B/s, 1 objects/s recovering 2021-10-08T19:27:40.072 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/993120943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 msgr2=0x7fbcd40fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/993120943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 0x7fbcd40fda10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00046e0 tx=0x7fbcd0009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:40.073 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/993120943 shutdown_connections 2021-10-08T19:27:40.074 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/993120943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd40f8930 0x7fbcd4104400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.076 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/993120943 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 0x7fbcd40fda10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.076 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/993120943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd40f7f80 0x7fbcd40f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.077 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/993120943 >> 172.21.15.112:0/993120943 conn(0x7fbcd406ce70 msgr2=0x7fbcd406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:40.077 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/993120943 shutdown_connections 2021-10-08T19:27:40.078 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/993120943 wait complete. 2021-10-08T19:27:40.080 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 Processor -- start 2021-10-08T19:27:40.081 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.066+0000 7fbcdbd8e700 1 -- start start 2021-10-08T19:27:40.081 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcdbd8e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd40f7f80 0x7fbcd4109900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:40.081 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcdbd8e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd40f8930 0x7fbcd4109e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:40.082 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcdbd8e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 0x7fbcd4114980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:40.083 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcdbd8e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd410a660 con 0x7fbcd40f7f80 2021-10-08T19:27:40.083 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcdbd8e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd410a7d0 con 0x7fbcd40f8930 2021-10-08T19:27:40.084 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcdbd8e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd4114f40 con 0x7fbcd40fd640 2021-10-08T19:27:40.084 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 0x7fbcd4114980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:40.085 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 0x7fbcd4114980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56390/0 (socket says 172.21.15.112:56390) 2021-10-08T19:27:40.086 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcd9b2a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd40f7f80 0x7fbcd4109900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:40.087 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 -- 172.21.15.112:0/3967120133 learned_addr learned my addr 172.21.15.112:0/3967120133 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:40.087 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcd9329700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd40f8930 0x7fbcd4109e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:40.088 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 -- 172.21.15.112:0/3967120133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd40f8930 msgr2=0x7fbcd4109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:40.088 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd40f8930 0x7fbcd4109e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.089 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 -- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd40f7f80 msgr2=0x7fbcd4109900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:40.089 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd40f7f80 0x7fbcd4109900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.089 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 -- 172.21.15.112:0/3967120133 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc009640 con 0x7fbcd40fd640 2021-10-08T19:27:40.090 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcd9329700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd40f8930 0x7fbcd4109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:27:40.091 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcd9b2a700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd40f7f80 0x7fbcd4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:40.092 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcda32b700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 0x7fbcd4114980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbccc001c30 tx=0x7fbccc004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:40.092 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcca7fc700 1 -- 172.21.15.112:0/3967120133 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0092e0 con 0x7fbcd40fd640 2021-10-08T19:27:40.092 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcca7fc700 1 -- 172.21.15.112:0/3967120133 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbccc009440 con 0x7fbcd40fd640 2021-10-08T19:27:40.093 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd0005040 con 0x7fbcd40fd640 2021-10-08T19:27:40.094 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcca7fc700 1 -- 172.21.15.112:0/3967120133 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc007ad0 con 0x7fbcd40fd640 2021-10-08T19:27:40.095 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.067+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd4115530 con 0x7fbcd40fd640 2021-10-08T19:27:40.095 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.068+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd4047b50 con 0x7fbcd40fd640 2021-10-08T19:27:40.096 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.069+0000 7fbcca7fc700 1 -- 172.21.15.112:0/3967120133 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fbccc00f770 con 0x7fbcd40fd640 2021-10-08T19:27:40.096 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.069+0000 7fbcca7fc700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbcc00635e0 0x7fbcc0065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:40.096 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.069+0000 7fbcd9b2a700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbcc00635e0 0x7fbcc0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:40.097 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.069+0000 7fbcca7fc700 1 -- 172.21.15.112:0/3967120133 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7fbccc080090 con 0x7fbcd40fd640 2021-10-08T19:27:40.097 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.069+0000 7fbcd9b2a700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbcc00635e0 0x7fbcc0065a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009c10 tx=0x7fbcd0009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:40.098 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.073+0000 7fbcca7fc700 1 -- 172.21.15.112:0/3967120133 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fbccc052760 con 0x7fbcd40fd640 2021-10-08T19:27:40.236 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.234+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbcd40f7560 con 0x7fbcd40fd640 2021-10-08T19:27:40.236 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.234+0000 7fbcca7fc700 1 -- 172.21.15.112:0/3967120133 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbccc052350 con 0x7fbcd40fd640 2021-10-08T19:27:40.237 INFO:teuthology.orchestra.run.smithi112.stdout:77309411368 2021-10-08T19:27:40.238 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbcc00635e0 msgr2=0x7fbcc0065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:40.239 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbcc00635e0 0x7fbcc0065a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009c10 tx=0x7fbcd0009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:40.240 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 msgr2=0x7fbcd4114980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:40.240 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 0x7fbcd4114980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbccc001c30 tx=0x7fbccc004c50 comp rx=0 tx=0).stop 2021-10-08T19:27:40.241 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 shutdown_connections 2021-10-08T19:27:40.241 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbcc00635e0 0x7fbcc0065a90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.241 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbcd40fd640 0x7fbcd4114980 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.241 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcd40f7f80 0x7fbcd4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.242 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 --2- 172.21.15.112:0/3967120133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcd40f8930 0x7fbcd4109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:40.242 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 >> 172.21.15.112:0/3967120133 conn(0x7fbcd406ce70 msgr2=0x7fbcd40f5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:40.242 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 shutdown_connections 2021-10-08T19:27:40.242 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:40.236+0000 7fbcdbd8e700 1 -- 172.21.15.112:0/3967120133 wait complete. 2021-10-08T19:27:40.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:39 smithi142 ceph-mon[33432]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36 B/s, 1 objects/s recovering 2021-10-08T19:27:41.006 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411363 got 77309411368 for osd.2 2021-10-08T19:27:41.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-10-08T19:27:41.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3967120133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:27:41.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3967120133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:27:41.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3967120133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-10-08T19:27:41.442 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:42.003 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:41 smithi112 ceph-mon[40655]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 0 objects/s recovering 2021-10-08T19:27:42.003 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:41 smithi112 ceph-mon[31694]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 0 objects/s recovering 2021-10-08T19:27:42.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:41 smithi142 ceph-mon[33432]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 0 objects/s recovering 2021-10-08T19:27:43.011 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 -- 172.21.15.112:0/647502348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940f7d60 msgr2=0x7f4b941043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:43.011 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/647502348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940f7d60 0x7f4b941043d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009a60 tx=0x7f4b8c004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:43.011 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 -- 172.21.15.112:0/647502348 shutdown_connections 2021-10-08T19:27:43.011 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/647502348 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940f7d60 0x7f4b941043d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.012 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/647502348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940fd5d0 0x7f4b940fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.012 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/647502348 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b940fdf70 0x7f4b940f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.012 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 -- 172.21.15.112:0/647502348 >> 172.21.15.112:0/647502348 conn(0x7f4b9406f330 msgr2=0x7f4b9406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:43.012 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 -- 172.21.15.112:0/647502348 shutdown_connections 2021-10-08T19:27:43.013 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.007+0000 7f4b9c53a700 1 -- 172.21.15.112:0/647502348 wait complete. 2021-10-08T19:27:43.013 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9c53a700 1 Processor -- start 2021-10-08T19:27:43.013 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9c53a700 1 -- start start 2021-10-08T19:27:43.013 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9c53a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940f7d60 0x7f4b94109700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:43.013 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9c53a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b940fd5d0 0x7f4b94109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:43.014 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9c53a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940fdf70 0x7f4b94114780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:43.014 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9c53a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9410a420 con 0x7f4b940fd5d0 2021-10-08T19:27:43.014 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9c53a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9410a590 con 0x7f4b940f7d60 2021-10-08T19:27:43.014 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9c53a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94114d10 con 0x7f4b940fdf70 2021-10-08T19:27:43.015 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b940fd5d0 0x7f4b94109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:43.015 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9aad7700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940fdf70 0x7f4b94114780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:43.015 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b940fd5d0 0x7f4b94109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34440/0 (socket says 172.21.15.112:34440) 2021-10-08T19:27:43.015 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 -- 172.21.15.112:0/3659539813 learned_addr learned my addr 172.21.15.112:0/3659539813 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:43.015 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9a2d6700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940f7d60 0x7f4b94109700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:43.016 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 -- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940fdf70 msgr2=0x7f4b94114780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:43.016 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940fdf70 0x7f4b94114780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.016 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 -- 172.21.15.112:0/3659539813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940f7d60 msgr2=0x7f4b94109700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:43.016 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940f7d60 0x7f4b94109700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.017 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 -- 172.21.15.112:0/3659539813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84005040 con 0x7f4b940fd5d0 2021-10-08T19:27:43.017 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9aad7700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940fdf70 0x7f4b94114780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:43.017 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b9a2d6700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940f7d60 0x7f4b94109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:43.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b99ad5700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b940fd5d0 0x7f4b94109c40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b84004920 tx=0x7f4b84009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:43.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.008+0000 7f4b8affd700 1 -- 172.21.15.112:0/3659539813 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8400e050 con 0x7f4b940fd5d0 2021-10-08T19:27:43.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.009+0000 7f4b8affd700 1 -- 172.21.15.112:0/3659539813 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f4b8400f040 con 0x7f4b940fd5d0 2021-10-08T19:27:43.018 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.009+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c009640 con 0x7f4b940fd5d0 2021-10-08T19:27:43.019 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.009+0000 7f4b8affd700 1 -- 172.21.15.112:0/3659539813 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b840146d0 con 0x7f4b940fd5d0 2021-10-08T19:27:43.019 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.009+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b941152c0 con 0x7f4b940fd5d0 2021-10-08T19:27:43.020 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.010+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b94047b50 con 0x7f4b940fd5d0 2021-10-08T19:27:43.020 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.010+0000 7f4b8affd700 1 -- 172.21.15.112:0/3659539813 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f4b8401b030 con 0x7f4b940fd5d0 2021-10-08T19:27:43.020 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.010+0000 7f4b8affd700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b800635e0 0x7f4b80065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:43.021 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.010+0000 7f4b8affd700 1 -- 172.21.15.112:0/3659539813 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f4b8407f8b0 con 0x7f4b940fd5d0 2021-10-08T19:27:43.021 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.010+0000 7f4b9a2d6700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b800635e0 0x7f4b80065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:43.021 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.011+0000 7f4b9a2d6700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b800635e0 0x7f4b80065a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009fd0 tx=0x7f4b9000b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:43.021 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.014+0000 7f4b8affd700 1 -- 172.21.15.112:0/3659539813 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f4b84048b00 con 0x7f4b940fd5d0 2021-10-08T19:27:43.173 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.171+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b94115510 con 0x7f4b940fd5d0 2021-10-08T19:27:43.174 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.171+0000 7f4b8affd700 1 -- 172.21.15.112:0/3659539813 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b84019090 con 0x7f4b940fd5d0 2021-10-08T19:27:43.174 INFO:teuthology.orchestra.run.smithi112.stdout:111669149735 2021-10-08T19:27:43.175 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b800635e0 msgr2=0x7f4b80065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:43.175 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b800635e0 0x7f4b80065a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009fd0 tx=0x7f4b9000b040 comp rx=0 tx=0).stop 2021-10-08T19:27:43.175 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b940fd5d0 msgr2=0x7f4b94109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:43.176 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b940fd5d0 0x7f4b94109c40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b84004920 tx=0x7f4b84009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:43.176 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 shutdown_connections 2021-10-08T19:27:43.176 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f4b800635e0 0x7f4b80065a90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.176 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4b940fdf70 0x7f4b94114780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.176 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940f7d60 0x7f4b94109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.177 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 --2- 172.21.15.112:0/3659539813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b940fd5d0 0x7f4b94109c40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:43.177 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 >> 172.21.15.112:0/3659539813 conn(0x7f4b9406f330 msgr2=0x7f4b940fb170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:43.177 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 shutdown_connections 2021-10-08T19:27:43.177 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:43.173+0000 7f4b9c53a700 1 -- 172.21.15.112:0/3659539813 wait complete. 2021-10-08T19:27:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:27:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:43.945 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149730 got 111669149735 for osd.3 2021-10-08T19:27:43.946 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-10-08T19:27:44.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:43 smithi112 ceph-mon[40655]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:44.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3659539813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:27:44.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:43 smithi112 ceph-mon[31694]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:44.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3659539813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:27:44.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:43 smithi142 ceph-mon[33432]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:44.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3659539813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-10-08T19:27:44.381 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:45.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:45] "GET /metrics HTTP/1.1" 200 153760 "" "Prometheus/2.18.1" 2021-10-08T19:27:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.935+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1200658637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 msgr2=0x7f8ac01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:45.942 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.935+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1200658637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 0x7f8ac01043d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009a60 tx=0x7f8ab8004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.935+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1200658637 shutdown_connections 2021-10-08T19:27:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.935+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1200658637 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 0x7f8ac01043d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.935+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1200658637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac00fd5d0 0x7f8ac00fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:45.943 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.935+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1200658637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00fdf70 0x7f8ac00f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:45.944 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.935+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1200658637 >> 172.21.15.112:0/1200658637 conn(0x7f8ac006f330 msgr2=0x7f8ac006f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:45.944 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1200658637 shutdown_connections 2021-10-08T19:27:45.944 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1200658637 wait complete. 2021-10-08T19:27:45.944 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 Processor -- start 2021-10-08T19:27:45.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 -- start start 2021-10-08T19:27:45.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 0x7f8ac01096a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:45.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac00fd5d0 0x7f8ac0109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:45.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00fdf70 0x7f8ac0114720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:45.945 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac010a3c0 con 0x7f8ac00fdf70 2021-10-08T19:27:45.946 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac010a530 con 0x7f8ac00fd5d0 2021-10-08T19:27:45.946 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac7c66700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac0114cb0 con 0x7f8ac00f7d60 2021-10-08T19:27:45.946 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac5a02700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 0x7f8ac01096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:45.946 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.936+0000 7f8ac5a02700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 0x7f8ac01096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56410/0 (socket says 172.21.15.112:56410) 2021-10-08T19:27:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac5a02700 1 -- 172.21.15.112:0/1981170941 learned_addr learned my addr 172.21.15.112:0/1981170941 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac6203700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00fdf70 0x7f8ac0114720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac5201700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac00fd5d0 0x7f8ac0109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac5a02700 1 -- 172.21.15.112:0/1981170941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac00fd5d0 msgr2=0x7f8ac0109be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:45.947 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac5a02700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac00fd5d0 0x7f8ac0109be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac5a02700 1 -- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00fdf70 msgr2=0x7f8ac0114720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac5a02700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00fdf70 0x7f8ac0114720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac5a02700 1 -- 172.21.15.112:0/1981170941 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8009640 con 0x7f8ac00f7d60 2021-10-08T19:27:45.948 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac6203700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00fdf70 0x7f8ac0114720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac5a02700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 0x7f8ac01096a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8abc002780 tx=0x7f8abc009de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ab27fc700 1 -- 172.21.15.112:0/1981170941 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0092e0 con 0x7f8ac00f7d60 2021-10-08T19:27:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ab27fc700 1 -- 172.21.15.112:0/1981170941 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8abc00f040 con 0x7f8ac00f7d60 2021-10-08T19:27:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac0114f90 con 0x7f8ac00f7d60 2021-10-08T19:27:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ab27fc700 1 -- 172.21.15.112:0/1981170941 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc013660 con 0x7f8ac00f7d60 2021-10-08T19:27:45.950 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.937+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac01154c0 con 0x7f8ac00f7d60 2021-10-08T19:27:45.950 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.938+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac0047b50 con 0x7f8ac00f7d60 2021-10-08T19:27:45.950 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.938+0000 7f8ab27fc700 1 -- 172.21.15.112:0/1981170941 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f8abc0077b0 con 0x7f8ac00f7d60 2021-10-08T19:27:45.950 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.939+0000 7f8ab27fc700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f8aac0635e0 0x7f8aac065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:45.950 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.939+0000 7f8ac5201700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f8aac0635e0 0x7f8aac065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:45.951 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.939+0000 7f8ab27fc700 1 -- 172.21.15.112:0/1981170941 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f8abc07fea0 con 0x7f8ac00f7d60 2021-10-08T19:27:45.951 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.939+0000 7f8ac5201700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f8aac0635e0 0x7f8aac065a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0062230 tx=0x7f8ab400b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:45.952 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:45.943+0000 7f8ab27fc700 1 -- 172.21.15.112:0/1981170941 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f8abc052500 con 0x7f8ac00f7d60 2021-10-08T19:27:46.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:45 smithi112 ceph-mon[31694]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:46.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:45 smithi112 ceph-mon[40655]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:46.105 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.102+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8ac01156b0 con 0x7f8ac00f7d60 2021-10-08T19:27:46.105 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.103+0000 7f8ab27fc700 1 -- 172.21.15.112:0/1981170941 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8abc0520f0 con 0x7f8ac00f7d60 2021-10-08T19:27:46.105 INFO:teuthology.orchestra.run.smithi112.stdout:133143986211 2021-10-08T19:27:46.106 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f8aac0635e0 msgr2=0x7f8aac065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:46.107 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f8aac0635e0 0x7f8aac065a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0062230 tx=0x7f8ab400b040 comp rx=0 tx=0).stop 2021-10-08T19:27:46.107 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 msgr2=0x7f8ac01096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:46.107 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 0x7f8ac01096a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8abc002780 tx=0x7f8abc009de0 comp rx=0 tx=0).stop 2021-10-08T19:27:46.108 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 shutdown_connections 2021-10-08T19:27:46.108 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f8aac0635e0 0x7f8aac065a90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:46.108 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac00fdf70 0x7f8ac0114720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:46.108 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ac00f7d60 0x7f8ac01096a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:46.109 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 --2- 172.21.15.112:0/1981170941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac00fd5d0 0x7f8ac0109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:46.109 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 >> 172.21.15.112:0/1981170941 conn(0x7f8ac006f330 msgr2=0x7f8ac00fb170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:46.109 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 shutdown_connections 2021-10-08T19:27:46.109 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:46.105+0000 7f8ac7c66700 1 -- 172.21.15.112:0/1981170941 wait complete. 2021-10-08T19:27:46.239 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:45 smithi142 ceph-mon[33432]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:46.522 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:27:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:27:46.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986206 got 133143986211 for osd.4 2021-10-08T19:27:46.785 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-10-08T19:27:47.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:46 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1981170941' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:27:47.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:46 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1981170941' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:27:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:47.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:46 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1981170941' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-10-08T19:27:48.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:47 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:48.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:47 smithi112 ceph-mon[40655]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:48.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:47 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:48.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:47 smithi112 ceph-mon[31694]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:48.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:47 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:48.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:47 smithi142 ceph-mon[33432]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:48.713 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 -- 172.21.15.112:0/423865315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 msgr2=0x7fbf100f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:48.713 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/423865315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 0x7fbf100f75a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf040046e0 tx=0x7fbf04009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:48.714 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 -- 172.21.15.112:0/423865315 shutdown_connections 2021-10-08T19:27:48.714 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/423865315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf100f7c80 0x7fbf101042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.714 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/423865315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100fd4b0 0x7fbf100fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.714 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/423865315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 0x7fbf100f75a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.717 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 -- 172.21.15.112:0/423865315 >> 172.21.15.112:0/423865315 conn(0x7fbf1006e310 msgr2=0x7fbf1006e710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:48.717 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 -- 172.21.15.112:0/423865315 shutdown_connections 2021-10-08T19:27:48.717 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.707+0000 7fbf0f59e700 1 -- 172.21.15.112:0/423865315 wait complete. 2021-10-08T19:27:48.717 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0f59e700 1 Processor -- start 2021-10-08T19:27:48.718 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0f59e700 1 -- start start 2021-10-08T19:27:48.718 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100f7c80 0x7fbf1010e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:48.718 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0f59e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf100fd4b0 0x7fbf1010eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:48.719 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 0x7fbf10108870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:48.719 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10108e40 con 0x7fbf100fde50 2021-10-08T19:27:48.719 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0f59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10108fb0 con 0x7fbf100f7c80 2021-10-08T19:27:48.719 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0f59e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10109170 con 0x7fbf100fd4b0 2021-10-08T19:27:48.720 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0dd9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf100fd4b0 0x7fbf1010eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:48.720 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 0x7fbf10108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:48.720 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100f7c80 0x7fbf1010e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:48.720 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 0x7fbf10108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34466/0 (socket says 172.21.15.112:34466) 2021-10-08T19:27:48.721 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0dd9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf100fd4b0 0x7fbf1010eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56424/0 (socket says 172.21.15.112:56424) 2021-10-08T19:27:48.721 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0ed9d700 1 -- 172.21.15.112:0/2378179992 learned_addr learned my addr 172.21.15.112:0/2378179992 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:48.721 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.708+0000 7fbf0e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100f7c80 0x7fbf1010e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.112:53638/0 (socket says 172.21.15.112:53638) 2021-10-08T19:27:48.722 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0e59c700 1 -- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf100fd4b0 msgr2=0x7fbf1010eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:48.722 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0e59c700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf100fd4b0 0x7fbf1010eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.722 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0e59c700 1 -- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 msgr2=0x7fbf10108870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:48.723 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0e59c700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 0x7fbf10108870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.723 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0e59c700 1 -- 172.21.15.112:0/2378179992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf08009640 con 0x7fbf100f7c80 2021-10-08T19:27:48.723 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0ed9d700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 0x7fbf10108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:48.723 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0e59c700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100f7c80 0x7fbf1010e9b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000e840 tx=0x7fbf0000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:48.724 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbefeffd700 1 -- 172.21.15.112:0/2378179992 <== mon.2 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000093b0 con 0x7fbf100f7c80 2021-10-08T19:27:48.724 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf04005040 con 0x7fbf100f7c80 2021-10-08T19:27:48.724 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbefeffd700 1 -- 172.21.15.112:0/2378179992 <== mon.2 v2:172.21.15.142:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbf0000f040 con 0x7fbf100f7c80 2021-10-08T19:27:48.724 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbefeffd700 1 -- 172.21.15.112:0/2378179992 <== mon.2 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000146f0 con 0x7fbf100f7c80 2021-10-08T19:27:48.724 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.709+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf101157b0 con 0x7fbf100f7c80 2021-10-08T19:27:48.725 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.710+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1006fe30 con 0x7fbf100f7c80 2021-10-08T19:27:48.725 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.710+0000 7fbefeffd700 1 -- 172.21.15.112:0/2378179992 <== mon.2 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fbf0001b030 con 0x7fbf100f7c80 2021-10-08T19:27:48.725 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.711+0000 7fbefeffd700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbef80635e0 0x7fbef8065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:48.725 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.711+0000 7fbefeffd700 1 -- 172.21.15.112:0/2378179992 <== mon.2 v2:172.21.15.142:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7fbf0007fa30 con 0x7fbf100f7c80 2021-10-08T19:27:48.726 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.711+0000 7fbf0dd9b700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbef80635e0 0x7fbef8065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:48.726 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.711+0000 7fbf0dd9b700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbef80635e0 0x7fbef8065a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009da0 tx=0x7fbf04009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:48.727 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.718+0000 7fbefeffd700 1 -- 172.21.15.112:0/2378179992 <== mon.2 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fbf00048b00 con 0x7fbf100f7c80 2021-10-08T19:27:48.877 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.875+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbf100472f0 con 0x7fbf100f7c80 2021-10-08T19:27:48.877 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.875+0000 7fbefeffd700 1 -- 172.21.15.112:0/2378179992 <== mon.2 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf00019020 con 0x7fbf100f7c80 2021-10-08T19:27:48.878 INFO:teuthology.orchestra.run.smithi112.stdout:163208757279 2021-10-08T19:27:48.879 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbef80635e0 msgr2=0x7fbef8065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:48.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbef80635e0 0x7fbef8065a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009da0 tx=0x7fbf04009b30 comp rx=0 tx=0).stop 2021-10-08T19:27:48.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100f7c80 msgr2=0x7fbf1010e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:48.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100f7c80 0x7fbf1010e9b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000e840 tx=0x7fbf0000b040 comp rx=0 tx=0).stop 2021-10-08T19:27:48.880 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 shutdown_connections 2021-10-08T19:27:48.881 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbef80635e0 0x7fbef8065a90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.881 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf100fde50 0x7fbf10108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.881 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf100f7c80 0x7fbf1010e9b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.881 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 --2- 172.21.15.112:0/2378179992 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbf100fd4b0 0x7fbf1010eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:48.882 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 >> 172.21.15.112:0/2378179992 conn(0x7fbf1006e310 msgr2=0x7fbf100fb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:48.882 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 shutdown_connections 2021-10-08T19:27:48.882 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:48.877+0000 7fbf0f59e700 1 -- 172.21.15.112:0/2378179992 wait complete. 2021-10-08T19:27:49.723 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:49 smithi112 ceph-mon[40655]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:49.723 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2378179992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:27:49.724 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:49 smithi112 ceph-mon[31694]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:49.724 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2378179992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:27:49.726 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757275 got 163208757279 for osd.5 2021-10-08T19:27:49.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-10-08T19:27:49.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:49 smithi142 ceph-mon[33432]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:49.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2378179992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-10-08T19:27:50.166 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:51.670 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 -- 172.21.15.112:0/478954911 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 msgr2=0x7f19ec0fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:51.670 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 --2- 172.21.15.112:0/478954911 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 0x7f19ec0fd9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009a60 tx=0x7f19e8004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:51.671 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 -- 172.21.15.112:0/478954911 shutdown_connections 2021-10-08T19:27:51.671 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 --2- 172.21.15.112:0/478954911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec0f7d60 0x7f19ec1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.671 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 --2- 172.21.15.112:0/478954911 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 0x7f19ec0fd9a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.671 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 --2- 172.21.15.112:0/478954911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19ec0fdf70 0x7f19ec0f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.672 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 -- 172.21.15.112:0/478954911 >> 172.21.15.112:0/478954911 conn(0x7f19ec06f330 msgr2=0x7f19ec06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:51.672 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 -- 172.21.15.112:0/478954911 shutdown_connections 2021-10-08T19:27:51.672 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 -- 172.21.15.112:0/478954911 wait complete. 2021-10-08T19:27:51.672 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 Processor -- start 2021-10-08T19:27:51.672 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 -- start start 2021-10-08T19:27:51.673 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19ec0f7d60 0x7f19ec10d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:51.673 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 0x7f19ec10dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:51.673 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.665+0000 7f19f3541700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec0fdf70 0x7f19ec107860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:51.673 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f3541700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec107e30 con 0x7f19ec0fdf70 2021-10-08T19:27:51.673 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f3541700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec107fa0 con 0x7f19ec0f7d60 2021-10-08T19:27:51.674 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f3541700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec108160 con 0x7f19ec0fd5d0 2021-10-08T19:27:51.674 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f0adc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 0x7f19ec10dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:51.674 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f1ade700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec0fdf70 0x7f19ec107860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:51.674 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f0adc700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 0x7f19ec10dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56438/0 (socket says 172.21.15.112:56438) 2021-10-08T19:27:51.675 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f0adc700 1 -- 172.21.15.112:0/3224644704 learned_addr learned my addr 172.21.15.112:0/3224644704 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:51.675 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f12dd700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19ec0f7d60 0x7f19ec10d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:51.675 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f1ade700 1 -- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 msgr2=0x7f19ec10dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:51.675 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f1ade700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 0x7f19ec10dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.676 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f1ade700 1 -- 172.21.15.112:0/3224644704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19ec0f7d60 msgr2=0x7f19ec10d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:51.676 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f1ade700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19ec0f7d60 0x7f19ec10d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.676 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f1ade700 1 -- 172.21.15.112:0/3224644704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8009640 con 0x7f19ec0fdf70 2021-10-08T19:27:51.676 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f0adc700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 0x7f19ec10dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:27:51.677 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f12dd700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19ec0f7d60 0x7f19ec10d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:27:51.677 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f1ade700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec0fdf70 0x7f19ec107860 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19e400e840 tx=0x7f19e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:51.677 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19e1ffb700 1 -- 172.21.15.112:0/3224644704 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e40093b0 con 0x7f19ec0fdf70 2021-10-08T19:27:51.677 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19e1ffb700 1 -- 172.21.15.112:0/3224644704 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f19e400f040 con 0x7f19ec0fdf70 2021-10-08T19:27:51.677 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec1083e0 con 0x7f19ec0fdf70 2021-10-08T19:27:51.678 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.666+0000 7f19e1ffb700 1 -- 172.21.15.112:0/3224644704 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e40146f0 con 0x7f19ec0fdf70 2021-10-08T19:27:51.678 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.667+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec114750 con 0x7f19ec0fdf70 2021-10-08T19:27:51.678 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.667+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec047b50 con 0x7f19ec0fdf70 2021-10-08T19:27:51.678 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.668+0000 7f19e1ffb700 1 -- 172.21.15.112:0/3224644704 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f19e401b030 con 0x7f19ec0fdf70 2021-10-08T19:27:51.679 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.668+0000 7f19e1ffb700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f19d80635e0 0x7f19d8065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:51.679 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.668+0000 7f19e1ffb700 1 -- 172.21.15.112:0/3224644704 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f19e407faa0 con 0x7f19ec0fdf70 2021-10-08T19:27:51.679 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.668+0000 7f19f12dd700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f19d80635e0 0x7f19d8065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:51.679 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.668+0000 7f19f12dd700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f19d80635e0 0x7f19d8065a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009fd0 tx=0x7f19e8004d10 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:51.680 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.672+0000 7f19e1ffb700 1 -- 172.21.15.112:0/3224644704 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f19e4048b00 con 0x7f19ec0fdf70 2021-10-08T19:27:51.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:51 smithi112 ceph-mon[40655]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:51.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:51 smithi112 ceph-mon[31694]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:51.836 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.834+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f19ec108d70 con 0x7f19ec0fdf70 2021-10-08T19:27:51.836 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.834+0000 7f19e1ffb700 1 -- 172.21.15.112:0/3224644704 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19e4019090 con 0x7f19ec0fdf70 2021-10-08T19:27:51.837 INFO:teuthology.orchestra.run.smithi112.stdout:193273528349 2021-10-08T19:27:51.838 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f19d80635e0 msgr2=0x7f19d8065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:51.838 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f19d80635e0 0x7f19d8065a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009fd0 tx=0x7f19e8004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:51.839 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec0fdf70 msgr2=0x7f19ec107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:51.839 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec0fdf70 0x7f19ec107860 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19e400e840 tx=0x7f19e400b040 comp rx=0 tx=0).stop 2021-10-08T19:27:51.839 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 shutdown_connections 2021-10-08T19:27:51.839 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f19d80635e0 0x7f19d8065a90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.840 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec0fdf70 0x7f19ec107860 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.840 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19ec0f7d60 0x7f19ec10d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.840 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 --2- 172.21.15.112:0/3224644704 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19ec0fd5d0 0x7f19ec10dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:51.840 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 >> 172.21.15.112:0/3224644704 conn(0x7f19ec06f330 msgr2=0x7f19ec0f66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:51.840 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 shutdown_connections 2021-10-08T19:27:51.841 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:51.836+0000 7f19f3541700 1 -- 172.21.15.112:0/3224644704 wait complete. 2021-10-08T19:27:52.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:51 smithi142 ceph-mon[33432]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:52.683 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528344 got 193273528349 for osd.6 2021-10-08T19:27:52.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-10-08T19:27:53.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3224644704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:27:53.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3224644704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:27:53.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3224644704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-10-08T19:27:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:27:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:27:53.748 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:53.963 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:53 smithi112 ceph-mon[40655]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:53.964 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:53 smithi112 ceph-mon[31694]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:54.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:53 smithi142 ceph-mon[33432]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:55.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:27:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:27:55] "GET /metrics HTTP/1.1" 200 153748 "" "Prometheus/2.18.1" 2021-10-08T19:27:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:55 smithi142 ceph-mon[33432]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 -- 172.21.15.112:0/187441708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0f8e70 msgr2=0x7fe22c105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:56.031 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 --2- 172.21.15.112:0/187441708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0f8e70 0x7fe22c105510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe224009a60 tx=0x7fe224004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:56.031 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 -- 172.21.15.112:0/187441708 shutdown_connections 2021-10-08T19:27:56.031 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 --2- 172.21.15.112:0/187441708 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0f8e70 0x7fe22c105510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.031 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 --2- 172.21.15.112:0/187441708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0fe6f0 0x7fe22c0feac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.032 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 --2- 172.21.15.112:0/187441708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe22c0ff090 0x7fe22c0f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.032 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 -- 172.21.15.112:0/187441708 >> 172.21.15.112:0/187441708 conn(0x7fe22c06f3d0 msgr2=0x7fe22c0f6800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:56.032 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 -- 172.21.15.112:0/187441708 shutdown_connections 2021-10-08T19:27:56.032 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 -- 172.21.15.112:0/187441708 wait complete. 2021-10-08T19:27:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 Processor -- start 2021-10-08T19:27:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.024+0000 7fe23421e700 1 -- start start 2021-10-08T19:27:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe23421e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe22c0f8e70 0x7fe22c10e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe23421e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0fe6f0 0x7fe22c10ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe23421e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0ff090 0x7fe22c108820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe23421e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c108df0 con 0x7fe22c0f8e70 2021-10-08T19:27:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe23421e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c108f60 con 0x7fe22c0fe6f0 2021-10-08T19:27:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe23421e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c109120 con 0x7fe22c0ff090 2021-10-08T19:27:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0ff090 0x7fe22c108820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0ff090 0x7fe22c108820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56454/0 (socket says 172.21.15.112:56454) 2021-10-08T19:27:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 -- 172.21.15.112:0/1611418208 learned_addr learned my addr 172.21.15.112:0/1611418208 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:27:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe231fba700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe22c0f8e70 0x7fe22c10e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2317b9700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0fe6f0 0x7fe22c10ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 -- 172.21.15.112:0/1611418208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0fe6f0 msgr2=0x7fe22c10ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0fe6f0 0x7fe22c10ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 -- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe22c0f8e70 msgr2=0x7fe22c10e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:56.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe22c0f8e70 0x7fe22c10e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 -- 172.21.15.112:0/1611418208 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c005040 con 0x7fe22c0ff090 2021-10-08T19:27:56.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2327bb700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0ff090 0x7fe22c108820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe224015040 tx=0x7fe224004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:56.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2227fc700 1 -- 172.21.15.112:0/1611418208 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400e070 con 0x7fe22c0ff090 2021-10-08T19:27:56.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2227fc700 1 -- 172.21.15.112:0/1611418208 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fe224009450 con 0x7fe22c0ff090 2021-10-08T19:27:56.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe224009640 con 0x7fe22c0ff090 2021-10-08T19:27:56.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.025+0000 7fe2227fc700 1 -- 172.21.15.112:0/1611418208 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22401c440 con 0x7fe22c0ff090 2021-10-08T19:27:56.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.026+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c1095c0 con 0x7fe22c0ff090 2021-10-08T19:27:56.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.026+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c047b50 con 0x7fe22c0ff090 2021-10-08T19:27:56.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.027+0000 7fe2227fc700 1 -- 172.21.15.112:0/1611418208 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fe224012620 con 0x7fe22c0ff090 2021-10-08T19:27:56.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.027+0000 7fe2227fc700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe2180679f0 0x7fe218069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:27:56.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.028+0000 7fe2227fc700 1 -- 172.21.15.112:0/1611418208 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7fe2240826a0 con 0x7fe22c0ff090 2021-10-08T19:27:56.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.028+0000 7fe231fba700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe2180679f0 0x7fe218069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:27:56.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.028+0000 7fe231fba700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe2180679f0 0x7fe218069ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe228004ce0 tx=0x7fe22800b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:27:56.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.031+0000 7fe2227fc700 1 -- 172.21.15.112:0/1611418208 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fe224054e60 con 0x7fe22c0ff090 2021-10-08T19:27:56.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:55 smithi112 ceph-mon[40655]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:56.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:55 smithi112 ceph-mon[31694]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:27:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.209+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe22c109d30 con 0x7fe22c0ff090 2021-10-08T19:27:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.209+0000 7fe2227fc700 1 -- 172.21.15.112:0/1611418208 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe224017070 con 0x7fe22c0ff090 2021-10-08T19:27:56.212 INFO:teuthology.orchestra.run.smithi112.stdout:223338299418 2021-10-08T19:27:56.213 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.211+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe2180679f0 msgr2=0x7fe218069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:56.214 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.211+0000 7fe23421e700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe2180679f0 0x7fe218069ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe228004ce0 tx=0x7fe22800b040 comp rx=0 tx=0).stop 2021-10-08T19:27:56.214 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.211+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0ff090 msgr2=0x7fe22c108820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:27:56.214 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.211+0000 7fe23421e700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0ff090 0x7fe22c108820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe224015040 tx=0x7fe224004d10 comp rx=0 tx=0).stop 2021-10-08T19:27:56.214 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.212+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 shutdown_connections 2021-10-08T19:27:56.215 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.212+0000 7fe23421e700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fe2180679f0 0x7fe218069ea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.215 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.212+0000 7fe23421e700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c0ff090 0x7fe22c108820 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.215 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.212+0000 7fe23421e700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe22c0f8e70 0x7fe22c10e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.215 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.212+0000 7fe23421e700 1 --2- 172.21.15.112:0/1611418208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0fe6f0 0x7fe22c10ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:27:56.216 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.212+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 >> 172.21.15.112:0/1611418208 conn(0x7fe22c06f3d0 msgr2=0x7fe22c0702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:27:56.217 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.212+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 shutdown_connections 2021-10-08T19:27:56.217 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:27:56.212+0000 7fe23421e700 1 -- 172.21.15.112:0/1611418208 wait complete. 2021-10-08T19:27:56.519 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:27:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:27:56.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1611418208' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:27:56.774 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:56 smithi142 systemd[1]: Starting Ceph grafana.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:27:57.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1611418208' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:27:57.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1611418208' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-10-08T19:27:57.130 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-10-08T19:27:57.130 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-10-08T19:27:57.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-10-08T19:27:57.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-10-08T19:27:57.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-10-08T19:27:57.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-10-08T19:27:57.132 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-10-08T19:27:57.132 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-10-08T19:27:57.132 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-10-08T19:27:57.132 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-10-08T19:27:57.133 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-10-08T19:27:57.133 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-10-08T19:27:57.133 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="App mode production" logger=settings 2021-10-08T19:27:57.133 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-10-08T19:27:57.134 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-10-08T19:27:57.134 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-10-08T19:27:57.134 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-10-08T19:27:57.134 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 bash[64860]: 9a2cc6e69b1ff30c010e658cf58b0a8e871e41bbb39bf0e63ccc00e31e61d5b5 2021-10-08T19:27:57.135 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-10-08T19:27:57.162 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299413 got 223338299418 for osd.7 2021-10-08T19:27:57.163 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-10-08T19:27:57.164 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:27:57.441 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 systemd[1]: Started Ceph grafana.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:27:57.442 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-10-08T19:27:57.442 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-10-08T19:27:57.442 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-10-08T19:27:57.442 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-10-08T19:27:57.442 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-10-08T19:27:57.443 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-10-08T19:27:57.443 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-10-08T19:27:57.640 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:27:57.713 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-10-08T19:27:57.713 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-10-08T19:27:57.714 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-10-08T19:27:57.714 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-10-08T19:27:57.715 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:57.715 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[31694]: poll took 34210.118 ms: 1 events 2021-10-08T19:27:57.715 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[31694]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:57.715 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:57.716 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:57.716 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:57.716 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:57.716 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:57.979 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-10-08T19:27:57.979 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-10-08T19:27:57.979 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-10-08T19:27:57.979 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-10-08T19:27:57.980 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-10-08T19:27:57.980 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-10-08T19:27:57.980 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:57 smithi142 conmon[65044]: t=2021-10-08T19:27:57+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-10-08T19:27:57.981 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:57.981 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:57 smithi142 ceph-mon[33432]: poll took 34210.118 ms: 1 events 2021-10-08T19:27:57.981 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:57 smithi142 ceph-mon[33432]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:57.981 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:57 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:57.981 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:57 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:57.982 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:57 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:57.982 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:57 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:57.982 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:57 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:58.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:27:58.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[40655]: poll took 34210.118 ms: 1 events 2021-10-08T19:27:58.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[40655]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:58.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:58.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:27:58.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:27:58.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:27:58.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:57 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:58.255 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-10-08T19:27:58.256 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-10-08T19:27:58.256 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-10-08T19:27:58.257 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-10-08T19:27:58.257 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-10-08T19:27:58.523 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-10-08T19:27:58.523 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-10-08T19:27:58.523 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-10-08T19:27:58.524 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-10-08T19:27:58.524 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-10-08T19:27:58.812 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-10-08T19:27:58.813 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-10-08T19:27:58.813 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-10-08T19:27:58.813 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-10-08T19:27:59.001 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[31694]: Sending message to agent on host smithi142 2021-10-08T19:27:59.001 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:59.002 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[31694]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:27:59.002 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[31694]: Reconfiguring daemon alertmanager.a on smithi112 2021-10-08T19:27:59.002 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[31694]: Received "ACK" from agent on host smithi142 2021-10-08T19:27:59.003 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:59.003 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[40655]: Sending message to agent on host smithi142 2021-10-08T19:27:59.003 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:59.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[40655]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:27:59.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[40655]: Reconfiguring daemon alertmanager.a on smithi112 2021-10-08T19:27:59.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[40655]: Received "ACK" from agent on host smithi142 2021-10-08T19:27:59.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:58 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:59.098 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:58 smithi142 conmon[65044]: t=2021-10-08T19:27:58+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-10-08T19:27:59.099 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:58 smithi142 ceph-mon[33432]: Sending message to agent on host smithi142 2021-10-08T19:27:59.099 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:58 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:27:59.099 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:58 smithi142 ceph-mon[33432]: Reconfiguring alertmanager.a (dependencies changed)... 2021-10-08T19:27:59.099 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:58 smithi142 ceph-mon[33432]: Reconfiguring daemon alertmanager.a on smithi112 2021-10-08T19:27:59.100 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:58 smithi142 ceph-mon[33432]: Received "ACK" from agent on host smithi142 2021-10-08T19:27:59.100 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:58 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:27:59.386 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-10-08T19:27:59.386 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-10-08T19:27:59.387 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-10-08T19:27:59.647 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-10-08T19:27:59.648 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-10-08T19:27:59.648 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-10-08T19:27:59.648 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-10-08T19:27:59.648 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-10-08T19:27:59.649 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-10-08T19:27:59.649 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-10-08T19:27:59.649 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-10-08T19:27:59.649 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-10-08T19:27:59.923 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:27:59 smithi142 ceph-mon[33432]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:27:59.924 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-10-08T19:27:59.924 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-10-08T19:27:59.924 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-10-08T19:27:59.925 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-10-08T19:27:59.925 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-10-08T19:27:59.925 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-10-08T19:27:59.925 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-10-08T19:28:00.036 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 -- 172.21.15.112:0/2377213176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f88062070 msgr2=0x7f6f881053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:00.036 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 --2- 172.21.15.112:0/2377213176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f88062070 0x7f6f881053e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009a90 tx=0x7f6f80004d10 comp rx=0 tx=0).stop 2021-10-08T19:28:00.036 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 -- 172.21.15.112:0/2377213176 shutdown_connections 2021-10-08T19:28:00.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 --2- 172.21.15.112:0/2377213176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f88062070 0x7f6f881053e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 --2- 172.21.15.112:0/2377213176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f880fe570 0x7f6f880fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 --2- 172.21.15.112:0/2377213176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f880fef10 0x7f6f88061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 -- 172.21.15.112:0/2377213176 >> 172.21.15.112:0/2377213176 conn(0x7f6f8806e310 msgr2=0x7f6f8806e710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:28:00.037 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 -- 172.21.15.112:0/2377213176 shutdown_connections 2021-10-08T19:28:00.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.030+0000 7f6f8759e700 1 -- 172.21.15.112:0/2377213176 wait complete. 2021-10-08T19:28:00.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8759e700 1 Processor -- start 2021-10-08T19:28:00.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8759e700 1 -- start start 2021-10-08T19:28:00.038 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f88062070 0x7f6f8810e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:00.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8759e700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f880fe570 0x7f6f8810eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:00.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f880fef10 0x7f6f881084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:00.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88108b20 con 0x7f6f880fef10 2021-10-08T19:28:00.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88108c90 con 0x7f6f88062070 2021-10-08T19:28:00.039 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8759e700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88108e50 con 0x7f6f880fe570 2021-10-08T19:28:00.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f86d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f880fef10 0x7f6f881084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:00.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f7dd9b700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f880fe570 0x7f6f8810eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:00.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f86d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f880fef10 0x7f6f881084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34508/0 (socket says 172.21.15.112:34508) 2021-10-08T19:28:00.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f86d9d700 1 -- 172.21.15.112:0/1097240160 learned_addr learned my addr 172.21.15.112:0/1097240160 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:28:00.040 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.031+0000 7f6f8659c700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f88062070 0x7f6f8810e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:00.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f86d9d700 1 -- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f880fe570 msgr2=0x7f6f8810eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:00.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f86d9d700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f880fe570 0x7f6f8810eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f86d9d700 1 -- 172.21.15.112:0/1097240160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f88062070 msgr2=0x7f6f8810e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:00.041 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f86d9d700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f88062070 0x7f6f8810e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f86d9d700 1 -- 172.21.15.112:0/1097240160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70005040 con 0x7f6f880fef10 2021-10-08T19:28:00.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f7dd9b700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f880fe570 0x7f6f8810eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:28:00.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f86d9d700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f880fef10 0x7f6f881084d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6f80007950 tx=0x7f6f80004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:28:00.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f7f7fe700 1 -- 172.21.15.112:0/1097240160 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000e070 con 0x7f6f880fef10 2021-10-08T19:28:00.042 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f7f7fe700 1 -- 172.21.15.112:0/1097240160 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6f80009450 con 0x7f6f880fef10 2021-10-08T19:28:00.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f80009640 con 0x7f6f880fef10 2021-10-08T19:28:00.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f7f7fe700 1 -- 172.21.15.112:0/1097240160 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8001ce60 con 0x7f6f880fef10 2021-10-08T19:28:00.043 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.032+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f88115410 con 0x7f6f880fef10 2021-10-08T19:28:00.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.033+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8806fe30 con 0x7f6f880fef10 2021-10-08T19:28:00.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.033+0000 7f6f7f7fe700 1 -- 172.21.15.112:0/1097240160 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f6f8001c440 con 0x7f6f880fef10 2021-10-08T19:28:00.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.033+0000 7f6f7f7fe700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f6f740635e0 0x7f6f74065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:00.044 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.034+0000 7f6f7f7fe700 1 -- 172.21.15.112:0/1097240160 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f6f80081eb0 con 0x7f6f880fef10 2021-10-08T19:28:00.045 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.034+0000 7f6f8659c700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f6f740635e0 0x7f6f74065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:00.045 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.034+0000 7f6f8659c700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f6f740635e0 0x7f6f74065a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f780041d0 tx=0x7f6f78009040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:28:00.046 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.038+0000 7f6f7f7fe700 1 -- 172.21.15.112:0/1097240160 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f6f80054600 con 0x7f6f880fef10 2021-10-08T19:28:00.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:27:59 smithi112 ceph-mon[40655]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:00.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:27:59 smithi112 ceph-mon[31694]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:00.226 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.223+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 --> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f880472f0 con 0x7f6f740635e0 2021-10-08T19:28:00.227 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:27:59 smithi142 conmon[65044]: t=2021-10-08T19:27:59+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-10-08T19:28:00.227 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-10-08T19:28:00.227 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-10-08T19:28:00.228 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-10-08T19:28:00.235 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.234+0000 7f6f7f7fe700 1 -- 172.21.15.112:0/1097240160 <== mgr.14532 v2:172.21.15.112:6800/471677461 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359450 (secure 0 0 0) 0x7f6f880472f0 con 0x7f6f740635e0 2021-10-08T19:28:00.240 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:28:00.243 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f6f740635e0 msgr2=0x7f6f74065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:00.243 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f6f740635e0 0x7f6f74065a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f780041d0 tx=0x7f6f78009040 comp rx=0 tx=0).stop 2021-10-08T19:28:00.244 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f880fef10 msgr2=0x7f6f881084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:00.244 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f880fef10 0x7f6f881084d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6f80007950 tx=0x7f6f80004d10 comp rx=0 tx=0).stop 2021-10-08T19:28:00.244 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 shutdown_connections 2021-10-08T19:28:00.244 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f6f740635e0 0x7f6f74065a90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f880fef10 0x7f6f881084d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f88062070 0x7f6f8810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 --2- 172.21.15.112:0/1097240160 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f880fe570 0x7f6f8810eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:00.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 >> 172.21.15.112:0/1097240160 conn(0x7f6f8806e310 msgr2=0x7f6f880ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:28:00.245 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 shutdown_connections 2021-10-08T19:28:00.246 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:00.237+0000 7f6f8759e700 1 -- 172.21.15.112:0/1097240160 wait complete. 2021-10-08T19:28:00.246 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2021-10-08T19:28:00.502 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-10-08T19:28:00.502 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-10-08T19:28:00.502 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-10-08T19:28:00.503 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-10-08T19:28:00.773 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-10-08T19:28:00.871 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-10-08T19:28:00.871 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-10-08T19:28:00.871 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-10-08T19:28:00.872 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-10-08T19:28:00.872 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-10-08T19:28:00.872 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-10-08T19:28:01.047 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-10-08T19:28:01.047 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-10-08T19:28:01.048 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-10-08T19:28:01.048 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-10-08T19:28:01.048 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-10-08T19:28:01.048 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:00 smithi142 conmon[65044]: t=2021-10-08T19:28:00+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-10-08T19:28:01.049 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-10-08T19:28:01.049 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-10-08T19:28:01.308 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-10-08T19:28:01.309 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-10-08T19:28:01.309 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-10-08T19:28:01.309 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-10-08T19:28:01.310 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-10-08T19:28:01.310 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-10-08T19:28:01.310 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-10-08T19:28:01.576 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-10-08T19:28:01.576 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-10-08T19:28:01.577 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-10-08T19:28:01.577 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-10-08T19:28:01.577 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-10-08T19:28:01.577 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-10-08T19:28:01.578 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-10-08T19:28:01.578 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-10-08T19:28:01.578 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-10-08T19:28:01.822 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2021-10-08T19:27:58.641577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":1040,"num_read_kb":886,"num_write":607,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1771544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":594,"ondisk_log_size":594,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":54124,"kb_used_data":7724,"kb_used_omap":0,"kb_used_meta":46336,"kb_avail":749907092,"statfs":{"total":767960285184,"available":767904862208,"internally_reserved":0,"allocated":7909376,"data_stored":4331969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47448064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003100"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135124+0000","last_change":"2021-10-08T19:26:10.034848+0000","last_active":"2021-10-08T19:27:23.135124+0000","last_peered":"2021-10-08T19:27:23.135124+0000","last_clean":"2021-10-08T19:27:23.135124+0000","last_became_active":"2021-10-08T19:26:10.034531+0000","last_became_peered":"2021-10-08T19:26:10.034531+0000","last_unstale":"2021-10-08T19:27:23.135124+0000","last_undegraded":"2021-10-08T19:27:23.135124+0000","last_fullsized":"2021-10-08T19:27:23.135124+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134246+0000","last_change":"2021-10-08T19:26:07.901641+0000","last_active":"2021-10-08T19:27:23.134246+0000","last_peered":"2021-10-08T19:27:23.134246+0000","last_clean":"2021-10-08T19:27:23.134246+0000","last_became_active":"2021-10-08T19:26:07.901370+0000","last_became_peered":"2021-10-08T19:26:07.901370+0000","last_unstale":"2021-10-08T19:27:23.134246+0000","last_undegraded":"2021-10-08T19:27:23.134246+0000","last_fullsized":"2021-10-08T19:27:23.134246+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130341+0000","last_change":"2021-10-08T19:26:03.879023+0000","last_active":"2021-10-08T19:27:23.130341+0000","last_peered":"2021-10-08T19:27:23.130341+0000","last_clean":"2021-10-08T19:27:23.130341+0000","last_became_active":"2021-10-08T19:26:03.878733+0000","last_became_peered":"2021-10-08T19:26:03.878733+0000","last_unstale":"2021-10-08T19:27:23.130341+0000","last_undegraded":"2021-10-08T19:27:23.130341+0000","last_fullsized":"2021-10-08T19:27:23.130341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":43,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135759+0000","last_change":"2021-10-08T19:26:05.898230+0000","last_active":"2021-10-08T19:27:23.135759+0000","last_peered":"2021-10-08T19:27:23.135759+0000","last_clean":"2021-10-08T19:27:23.135759+0000","last_became_active":"2021-10-08T19:26:05.897279+0000","last_became_peered":"2021-10-08T19:26:05.897279+0000","last_unstale":"2021-10-08T19:27:23.135759+0000","last_undegraded":"2021-10-08T19:27:23.135759+0000","last_fullsized":"2021-10-08T19:27:23.135759+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134336+0000","last_change":"2021-10-08T19:26:09.904300+0000","last_active":"2021-10-08T19:27:23.134336+0000","last_peered":"2021-10-08T19:27:23.134336+0000","last_clean":"2021-10-08T19:27:23.134336+0000","last_became_active":"2021-10-08T19:26:09.903947+0000","last_became_peered":"2021-10-08T19:26:09.903947+0000","last_unstale":"2021-10-08T19:27:23.134336+0000","last_undegraded":"2021-10-08T19:27:23.134336+0000","last_fullsized":"2021-10-08T19:27:23.134336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129176+0000","last_change":"2021-10-08T19:26:07.897609+0000","last_active":"2021-10-08T19:27:23.129176+0000","last_peered":"2021-10-08T19:27:23.129176+0000","last_clean":"2021-10-08T19:27:23.129176+0000","last_became_active":"2021-10-08T19:26:07.897333+0000","last_became_peered":"2021-10-08T19:26:07.897333+0000","last_unstale":"2021-10-08T19:27:23.129176+0000","last_undegraded":"2021-10-08T19:27:23.129176+0000","last_fullsized":"2021-10-08T19:27:23.129176+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136276+0000","last_change":"2021-10-08T19:26:03.877871+0000","last_active":"2021-10-08T19:27:23.136276+0000","last_peered":"2021-10-08T19:27:23.136276+0000","last_clean":"2021-10-08T19:27:23.136276+0000","last_became_active":"2021-10-08T19:26:03.877577+0000","last_became_peered":"2021-10-08T19:26:03.877577+0000","last_unstale":"2021-10-08T19:27:23.136276+0000","last_undegraded":"2021-10-08T19:27:23.136276+0000","last_fullsized":"2021-10-08T19:27:23.136276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"66'9","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:24.485283+0000","last_change":"2021-10-08T19:27:24.485283+0000","last_active":"2021-10-08T19:27:24.485283+0000","last_peered":"2021-10-08T19:27:24.485283+0000","last_clean":"2021-10-08T19:27:24.485283+0000","last_became_active":"2021-10-08T19:27:24.138369+0000","last_became_peered":"2021-10-08T19:27:24.138369+0000","last_unstale":"2021-10-08T19:27:24.485283+0000","last_undegraded":"2021-10-08T19:27:24.485283+0000","last_fullsized":"2021-10-08T19:27:24.485283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"66'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132557+0000","last_change":"2021-10-08T19:26:09.909495+0000","last_active":"2021-10-08T19:27:23.132557+0000","last_peered":"2021-10-08T19:27:23.132557+0000","last_clean":"2021-10-08T19:27:23.132557+0000","last_became_active":"2021-10-08T19:26:09.909192+0000","last_became_peered":"2021-10-08T19:26:09.909192+0000","last_unstale":"2021-10-08T19:27:23.132557+0000","last_undegraded":"2021-10-08T19:27:23.132557+0000","last_fullsized":"2021-10-08T19:27:23.132557+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136982+0000","last_change":"2021-10-08T19:26:07.902637+0000","last_active":"2021-10-08T19:27:23.136982+0000","last_peered":"2021-10-08T19:27:23.136982+0000","last_clean":"2021-10-08T19:27:23.136982+0000","last_became_active":"2021-10-08T19:26:07.902328+0000","last_became_peered":"2021-10-08T19:26:07.902328+0000","last_unstale":"2021-10-08T19:27:23.136982+0000","last_undegraded":"2021-10-08T19:27:23.136982+0000","last_fullsized":"2021-10-08T19:27:23.136982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:24.138442+0000","last_change":"2021-10-08T19:27:24.138442+0000","last_active":"2021-10-08T19:27:24.138442+0000","last_peered":"2021-10-08T19:27:24.138442+0000","last_clean":"2021-10-08T19:27:24.138442+0000","last_became_active":"2021-10-08T19:27:24.138089+0000","last_became_peered":"2021-10-08T19:27:24.138089+0000","last_unstale":"2021-10-08T19:27:24.138442+0000","last_undegraded":"2021-10-08T19:27:24.138442+0000","last_fullsized":"2021-10-08T19:27:24.138442+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134496+0000","last_change":"2021-10-08T19:26:05.893169+0000","last_active":"2021-10-08T19:27:23.134496+0000","last_peered":"2021-10-08T19:27:23.134496+0000","last_clean":"2021-10-08T19:27:23.134496+0000","last_became_active":"2021-10-08T19:26:05.892899+0000","last_became_peered":"2021-10-08T19:26:05.892899+0000","last_unstale":"2021-10-08T19:27:23.134496+0000","last_undegraded":"2021-10-08T19:27:23.134496+0000","last_fullsized":"2021-10-08T19:27:23.134496+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129125+0000","last_change":"2021-10-08T19:26:09.907391+0000","last_active":"2021-10-08T19:27:23.129125+0000","last_peered":"2021-10-08T19:27:23.129125+0000","last_clean":"2021-10-08T19:27:23.129125+0000","last_became_active":"2021-10-08T19:26:09.907070+0000","last_became_peered":"2021-10-08T19:26:09.907070+0000","last_unstale":"2021-10-08T19:27:23.129125+0000","last_undegraded":"2021-10-08T19:27:23.129125+0000","last_fullsized":"2021-10-08T19:27:23.129125+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132794+0000","last_change":"2021-10-08T19:26:07.893185+0000","last_active":"2021-10-08T19:27:23.132794+0000","last_peered":"2021-10-08T19:27:23.132794+0000","last_clean":"2021-10-08T19:27:23.132794+0000","last_became_active":"2021-10-08T19:26:07.892961+0000","last_became_peered":"2021-10-08T19:26:07.892961+0000","last_unstale":"2021-10-08T19:27:23.132794+0000","last_undegraded":"2021-10-08T19:27:23.132794+0000","last_fullsized":"2021-10-08T19:27:23.132794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136752+0000","last_change":"2021-10-08T19:26:03.888590+0000","last_active":"2021-10-08T19:27:23.136752+0000","last_peered":"2021-10-08T19:27:23.136752+0000","last_clean":"2021-10-08T19:27:23.136752+0000","last_became_active":"2021-10-08T19:26:03.888171+0000","last_became_peered":"2021-10-08T19:26:03.888171+0000","last_unstale":"2021-10-08T19:27:23.136752+0000","last_undegraded":"2021-10-08T19:27:23.136752+0000","last_fullsized":"2021-10-08T19:27:23.136752+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134597+0000","last_change":"2021-10-08T19:26:05.898274+0000","last_active":"2021-10-08T19:27:23.134597+0000","last_peered":"2021-10-08T19:27:23.134597+0000","last_clean":"2021-10-08T19:27:23.134597+0000","last_became_active":"2021-10-08T19:26:05.897976+0000","last_became_peered":"2021-10-08T19:26:05.897976+0000","last_unstale":"2021-10-08T19:27:23.134597+0000","last_undegraded":"2021-10-08T19:27:23.134597+0000","last_fullsized":"2021-10-08T19:27:23.134597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136289+0000","last_change":"2021-10-08T19:26:10.033219+0000","last_active":"2021-10-08T19:27:23.136289+0000","last_peered":"2021-10-08T19:27:23.136289+0000","last_clean":"2021-10-08T19:27:23.136289+0000","last_became_active":"2021-10-08T19:26:10.032877+0000","last_became_peered":"2021-10-08T19:26:10.032877+0000","last_unstale":"2021-10-08T19:27:23.136289+0000","last_undegraded":"2021-10-08T19:27:23.136289+0000","last_fullsized":"2021-10-08T19:27:23.136289+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135274+0000","last_change":"2021-10-08T19:26:07.896829+0000","last_active":"2021-10-08T19:27:23.135274+0000","last_peered":"2021-10-08T19:27:23.135274+0000","last_clean":"2021-10-08T19:27:23.135274+0000","last_became_active":"2021-10-08T19:26:07.896524+0000","last_became_peered":"2021-10-08T19:26:07.896524+0000","last_unstale":"2021-10-08T19:27:23.135274+0000","last_undegraded":"2021-10-08T19:27:23.135274+0000","last_fullsized":"2021-10-08T19:27:23.135274+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135256+0000","last_change":"2021-10-08T19:26:03.882005+0000","last_active":"2021-10-08T19:27:23.135256+0000","last_peered":"2021-10-08T19:27:23.135256+0000","last_clean":"2021-10-08T19:27:23.135256+0000","last_became_active":"2021-10-08T19:26:03.881714+0000","last_became_peered":"2021-10-08T19:26:03.881714+0000","last_unstale":"2021-10-08T19:27:23.135256+0000","last_undegraded":"2021-10-08T19:27:23.135256+0000","last_fullsized":"2021-10-08T19:27:23.135256+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:24.568448+0000","last_change":"2021-10-08T19:27:24.568448+0000","last_active":"2021-10-08T19:27:24.568448+0000","last_peered":"2021-10-08T19:27:24.568448+0000","last_clean":"2021-10-08T19:27:24.568448+0000","last_became_active":"2021-10-08T19:27:24.137083+0000","last_became_peered":"2021-10-08T19:27:24.137083+0000","last_unstale":"2021-10-08T19:27:24.568448+0000","last_undegraded":"2021-10-08T19:27:24.568448+0000","last_fullsized":"2021-10-08T19:27:24.568448+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136561+0000","last_change":"2021-10-08T19:26:10.032782+0000","last_active":"2021-10-08T19:27:23.136561+0000","last_peered":"2021-10-08T19:27:23.136561+0000","last_clean":"2021-10-08T19:27:23.136561+0000","last_became_active":"2021-10-08T19:26:10.032533+0000","last_became_peered":"2021-10-08T19:26:10.032533+0000","last_unstale":"2021-10-08T19:27:23.136561+0000","last_undegraded":"2021-10-08T19:27:23.136561+0000","last_fullsized":"2021-10-08T19:27:23.136561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.131817+0000","last_change":"2021-10-08T19:26:07.891601+0000","last_active":"2021-10-08T19:27:23.131817+0000","last_peered":"2021-10-08T19:27:23.131817+0000","last_clean":"2021-10-08T19:27:23.131817+0000","last_became_active":"2021-10-08T19:26:07.891289+0000","last_became_peered":"2021-10-08T19:26:07.891289+0000","last_unstale":"2021-10-08T19:27:23.131817+0000","last_undegraded":"2021-10-08T19:27:23.131817+0000","last_fullsized":"2021-10-08T19:27:23.131817+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137976+0000","last_change":"2021-10-08T19:26:03.890877+0000","last_active":"2021-10-08T19:27:23.137976+0000","last_peered":"2021-10-08T19:27:23.137976+0000","last_clean":"2021-10-08T19:27:23.137976+0000","last_became_active":"2021-10-08T19:26:03.890602+0000","last_became_peered":"2021-10-08T19:26:03.890602+0000","last_unstale":"2021-10-08T19:27:23.137976+0000","last_undegraded":"2021-10-08T19:27:23.137976+0000","last_fullsized":"2021-10-08T19:27:23.137976+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"66'15","reported_seq":43,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132864+0000","last_change":"2021-10-08T19:26:05.898226+0000","last_active":"2021-10-08T19:27:23.132864+0000","last_peered":"2021-10-08T19:27:23.132864+0000","last_clean":"2021-10-08T19:27:23.132864+0000","last_became_active":"2021-10-08T19:26:05.897942+0000","last_became_peered":"2021-10-08T19:26:05.897942+0000","last_unstale":"2021-10-08T19:27:23.132864+0000","last_undegraded":"2021-10-08T19:27:23.132864+0000","last_fullsized":"2021-10-08T19:27:23.132864+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130670+0000","last_change":"2021-10-08T19:26:09.903686+0000","last_active":"2021-10-08T19:27:23.130670+0000","last_peered":"2021-10-08T19:27:23.130670+0000","last_clean":"2021-10-08T19:27:23.130670+0000","last_became_active":"2021-10-08T19:26:09.903368+0000","last_became_peered":"2021-10-08T19:26:09.903368+0000","last_unstale":"2021-10-08T19:27:23.130670+0000","last_undegraded":"2021-10-08T19:27:23.130670+0000","last_fullsized":"2021-10-08T19:27:23.130670+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129605+0000","last_change":"2021-10-08T19:26:07.895240+0000","last_active":"2021-10-08T19:27:23.129605+0000","last_peered":"2021-10-08T19:27:23.129605+0000","last_clean":"2021-10-08T19:27:23.129605+0000","last_became_active":"2021-10-08T19:26:07.894919+0000","last_became_peered":"2021-10-08T19:26:07.894919+0000","last_unstale":"2021-10-08T19:27:23.129605+0000","last_undegraded":"2021-10-08T19:27:23.129605+0000","last_fullsized":"2021-10-08T19:27:23.129605+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135354+0000","last_change":"2021-10-08T19:26:03.880568+0000","last_active":"2021-10-08T19:27:23.135354+0000","last_peered":"2021-10-08T19:27:23.135354+0000","last_clean":"2021-10-08T19:27:23.135354+0000","last_became_active":"2021-10-08T19:26:03.880315+0000","last_became_peered":"2021-10-08T19:26:03.880315+0000","last_unstale":"2021-10-08T19:27:23.135354+0000","last_undegraded":"2021-10-08T19:27:23.135354+0000","last_fullsized":"2021-10-08T19:27:23.135354+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":58,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:24.574076+0000","last_change":"2021-10-08T19:27:24.574076+0000","last_active":"2021-10-08T19:27:24.574076+0000","last_peered":"2021-10-08T19:27:24.574076+0000","last_clean":"2021-10-08T19:27:24.574076+0000","last_became_active":"2021-10-08T19:27:24.140145+0000","last_became_peered":"2021-10-08T19:27:24.140145+0000","last_unstale":"2021-10-08T19:27:24.574076+0000","last_undegraded":"2021-10-08T19:27:24.574076+0000","last_fullsized":"2021-10-08T19:27:24.574076+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137336+0000","last_change":"2021-10-08T19:26:09.902640+0000","last_active":"2021-10-08T19:27:23.137336+0000","last_peered":"2021-10-08T19:27:23.137336+0000","last_clean":"2021-10-08T19:27:23.137336+0000","last_became_active":"2021-10-08T19:26:09.902355+0000","last_became_peered":"2021-10-08T19:26:09.902355+0000","last_unstale":"2021-10-08T19:27:23.137336+0000","last_undegraded":"2021-10-08T19:27:23.137336+0000","last_fullsized":"2021-10-08T19:27:23.137336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":50,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961389+0000","last_change":"2021-10-08T19:26:07.900501+0000","last_active":"2021-10-08T19:27:51.961389+0000","last_peered":"2021-10-08T19:27:51.961389+0000","last_clean":"2021-10-08T19:27:51.961389+0000","last_became_active":"2021-10-08T19:26:07.899641+0000","last_became_peered":"2021-10-08T19:26:07.899641+0000","last_unstale":"2021-10-08T19:27:51.961389+0000","last_undegraded":"2021-10-08T19:27:51.961389+0000","last_fullsized":"2021-10-08T19:27:51.961389+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132495+0000","last_change":"2021-10-08T19:26:03.887011+0000","last_active":"2021-10-08T19:27:23.132495+0000","last_peered":"2021-10-08T19:27:23.132495+0000","last_clean":"2021-10-08T19:27:23.132495+0000","last_became_active":"2021-10-08T19:26:03.886613+0000","last_became_peered":"2021-10-08T19:26:03.886613+0000","last_unstale":"2021-10-08T19:27:23.132495+0000","last_undegraded":"2021-10-08T19:27:23.132495+0000","last_fullsized":"2021-10-08T19:27:23.132495+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129567+0000","last_change":"2021-10-08T19:26:05.910273+0000","last_active":"2021-10-08T19:27:23.129567+0000","last_peered":"2021-10-08T19:27:23.129567+0000","last_clean":"2021-10-08T19:27:23.129567+0000","last_became_active":"2021-10-08T19:26:05.910087+0000","last_became_peered":"2021-10-08T19:26:05.910087+0000","last_unstale":"2021-10-08T19:27:23.129567+0000","last_undegraded":"2021-10-08T19:27:23.129567+0000","last_fullsized":"2021-10-08T19:27:23.129567+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135446+0000","last_change":"2021-10-08T19:26:10.034836+0000","last_active":"2021-10-08T19:27:23.135446+0000","last_peered":"2021-10-08T19:27:23.135446+0000","last_clean":"2021-10-08T19:27:23.135446+0000","last_became_active":"2021-10-08T19:26:10.034534+0000","last_became_peered":"2021-10-08T19:26:10.034534+0000","last_unstale":"2021-10-08T19:27:23.135446+0000","last_undegraded":"2021-10-08T19:27:23.135446+0000","last_fullsized":"2021-10-08T19:27:23.135446+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136630+0000","last_change":"2021-10-08T19:26:07.902664+0000","last_active":"2021-10-08T19:27:23.136630+0000","last_peered":"2021-10-08T19:27:23.136630+0000","last_clean":"2021-10-08T19:27:23.136630+0000","last_became_active":"2021-10-08T19:26:07.902357+0000","last_became_peered":"2021-10-08T19:26:07.902357+0000","last_unstale":"2021-10-08T19:27:23.136630+0000","last_undegraded":"2021-10-08T19:27:23.136630+0000","last_fullsized":"2021-10-08T19:27:23.136630+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.138400+0000","last_change":"2021-10-08T19:26:03.887617+0000","last_active":"2021-10-08T19:27:23.138400+0000","last_peered":"2021-10-08T19:27:23.138400+0000","last_clean":"2021-10-08T19:27:23.138400+0000","last_became_active":"2021-10-08T19:26:03.887363+0000","last_became_peered":"2021-10-08T19:26:03.887363+0000","last_unstale":"2021-10-08T19:27:23.138400+0000","last_undegraded":"2021-10-08T19:27:23.138400+0000","last_fullsized":"2021-10-08T19:27:23.138400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":37,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135671+0000","last_change":"2021-10-08T19:26:05.911795+0000","last_active":"2021-10-08T19:27:23.135671+0000","last_peered":"2021-10-08T19:27:23.135671+0000","last_clean":"2021-10-08T19:27:23.135671+0000","last_became_active":"2021-10-08T19:26:05.911564+0000","last_became_peered":"2021-10-08T19:26:05.911564+0000","last_unstale":"2021-10-08T19:27:23.135671+0000","last_undegraded":"2021-10-08T19:27:23.135671+0000","last_fullsized":"2021-10-08T19:27:23.135671+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136726+0000","last_change":"2021-10-08T19:26:09.905671+0000","last_active":"2021-10-08T19:27:23.136726+0000","last_peered":"2021-10-08T19:27:23.136726+0000","last_clean":"2021-10-08T19:27:23.136726+0000","last_became_active":"2021-10-08T19:26:09.905343+0000","last_became_peered":"2021-10-08T19:26:09.905343+0000","last_unstale":"2021-10-08T19:27:23.136726+0000","last_undegraded":"2021-10-08T19:27:23.136726+0000","last_fullsized":"2021-10-08T19:27:23.136726+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135223+0000","last_change":"2021-10-08T19:26:07.899987+0000","last_active":"2021-10-08T19:27:23.135223+0000","last_peered":"2021-10-08T19:27:23.135223+0000","last_clean":"2021-10-08T19:27:23.135223+0000","last_became_active":"2021-10-08T19:26:07.899615+0000","last_became_peered":"2021-10-08T19:26:07.899615+0000","last_unstale":"2021-10-08T19:27:23.135223+0000","last_undegraded":"2021-10-08T19:27:23.135223+0000","last_fullsized":"2021-10-08T19:27:23.135223+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133208+0000","last_change":"2021-10-08T19:26:03.887303+0000","last_active":"2021-10-08T19:27:23.133208+0000","last_peered":"2021-10-08T19:27:23.133208+0000","last_clean":"2021-10-08T19:27:23.133208+0000","last_became_active":"2021-10-08T19:26:03.887040+0000","last_became_peered":"2021-10-08T19:26:03.887040+0000","last_unstale":"2021-10-08T19:27:23.133208+0000","last_undegraded":"2021-10-08T19:27:23.133208+0000","last_fullsized":"2021-10-08T19:27:23.133208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135076+0000","last_change":"2021-10-08T19:26:05.901072+0000","last_active":"2021-10-08T19:27:23.135076+0000","last_peered":"2021-10-08T19:27:23.135076+0000","last_clean":"2021-10-08T19:27:23.135076+0000","last_became_active":"2021-10-08T19:26:05.900863+0000","last_became_peered":"2021-10-08T19:26:05.900863+0000","last_unstale":"2021-10-08T19:27:23.135076+0000","last_undegraded":"2021-10-08T19:27:23.135076+0000","last_fullsized":"2021-10-08T19:27:23.135076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135211+0000","last_change":"2021-10-08T19:26:09.908606+0000","last_active":"2021-10-08T19:27:23.135211+0000","last_peered":"2021-10-08T19:27:23.135211+0000","last_clean":"2021-10-08T19:27:23.135211+0000","last_became_active":"2021-10-08T19:26:09.908280+0000","last_became_peered":"2021-10-08T19:26:09.908280+0000","last_unstale":"2021-10-08T19:27:23.135211+0000","last_undegraded":"2021-10-08T19:27:23.135211+0000","last_fullsized":"2021-10-08T19:27:23.135211+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129884+0000","last_change":"2021-10-08T19:26:07.897604+0000","last_active":"2021-10-08T19:27:23.129884+0000","last_peered":"2021-10-08T19:27:23.129884+0000","last_clean":"2021-10-08T19:27:23.129884+0000","last_became_active":"2021-10-08T19:26:07.897291+0000","last_became_peered":"2021-10-08T19:26:07.897291+0000","last_unstale":"2021-10-08T19:27:23.129884+0000","last_undegraded":"2021-10-08T19:27:23.129884+0000","last_fullsized":"2021-10-08T19:27:23.129884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130790+0000","last_change":"2021-10-08T19:26:03.894683+0000","last_active":"2021-10-08T19:27:23.130790+0000","last_peered":"2021-10-08T19:27:23.130790+0000","last_clean":"2021-10-08T19:27:23.130790+0000","last_became_active":"2021-10-08T19:26:03.894352+0000","last_became_peered":"2021-10-08T19:26:03.894352+0000","last_unstale":"2021-10-08T19:27:23.130790+0000","last_undegraded":"2021-10-08T19:27:23.130790+0000","last_fullsized":"2021-10-08T19:27:23.130790+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":37,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135432+0000","last_change":"2021-10-08T19:26:05.887262+0000","last_active":"2021-10-08T19:27:23.135432+0000","last_peered":"2021-10-08T19:27:23.135432+0000","last_clean":"2021-10-08T19:27:23.135432+0000","last_became_active":"2021-10-08T19:26:05.886913+0000","last_became_peered":"2021-10-08T19:26:05.886913+0000","last_unstale":"2021-10-08T19:27:23.135432+0000","last_undegraded":"2021-10-08T19:27:23.135432+0000","last_fullsized":"2021-10-08T19:27:23.135432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.128647+0000","last_change":"2021-10-08T19:26:09.903712+0000","last_active":"2021-10-08T19:27:23.128647+0000","last_peered":"2021-10-08T19:27:23.128647+0000","last_clean":"2021-10-08T19:27:23.128647+0000","last_became_active":"2021-10-08T19:26:09.903130+0000","last_became_peered":"2021-10-08T19:26:09.903130+0000","last_unstale":"2021-10-08T19:27:23.128647+0000","last_undegraded":"2021-10-08T19:27:23.128647+0000","last_fullsized":"2021-10-08T19:27:23.128647+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135335+0000","last_change":"2021-10-08T19:26:07.890038+0000","last_active":"2021-10-08T19:27:23.135335+0000","last_peered":"2021-10-08T19:27:23.135335+0000","last_clean":"2021-10-08T19:27:23.135335+0000","last_became_active":"2021-10-08T19:26:07.889789+0000","last_became_peered":"2021-10-08T19:26:07.889789+0000","last_unstale":"2021-10-08T19:27:23.135335+0000","last_undegraded":"2021-10-08T19:27:23.135335+0000","last_fullsized":"2021-10-08T19:27:23.135335+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135661+0000","last_change":"2021-10-08T19:26:03.887558+0000","last_active":"2021-10-08T19:27:23.135661+0000","last_peered":"2021-10-08T19:27:23.135661+0000","last_clean":"2021-10-08T19:27:23.135661+0000","last_became_active":"2021-10-08T19:26:03.887234+0000","last_became_peered":"2021-10-08T19:26:03.887234+0000","last_unstale":"2021-10-08T19:27:23.135661+0000","last_undegraded":"2021-10-08T19:27:23.135661+0000","last_fullsized":"2021-10-08T19:27:23.135661+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129741+0000","last_change":"2021-10-08T19:26:05.890793+0000","last_active":"2021-10-08T19:27:23.129741+0000","last_peered":"2021-10-08T19:27:23.129741+0000","last_clean":"2021-10-08T19:27:23.129741+0000","last_became_active":"2021-10-08T19:26:05.890457+0000","last_became_peered":"2021-10-08T19:26:05.890457+0000","last_unstale":"2021-10-08T19:27:23.129741+0000","last_undegraded":"2021-10-08T19:27:23.129741+0000","last_fullsized":"2021-10-08T19:27:23.129741+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136077+0000","last_change":"2021-10-08T19:26:09.903811+0000","last_active":"2021-10-08T19:27:23.136077+0000","last_peered":"2021-10-08T19:27:23.136077+0000","last_clean":"2021-10-08T19:27:23.136077+0000","last_became_active":"2021-10-08T19:26:09.902730+0000","last_became_peered":"2021-10-08T19:26:09.902730+0000","last_unstale":"2021-10-08T19:27:23.136077+0000","last_undegraded":"2021-10-08T19:27:23.136077+0000","last_fullsized":"2021-10-08T19:27:23.136077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961103+0000","last_change":"2021-10-08T19:26:07.894331+0000","last_active":"2021-10-08T19:27:51.961103+0000","last_peered":"2021-10-08T19:27:51.961103+0000","last_clean":"2021-10-08T19:27:51.961103+0000","last_became_active":"2021-10-08T19:26:07.894034+0000","last_became_peered":"2021-10-08T19:26:07.894034+0000","last_unstale":"2021-10-08T19:27:51.961103+0000","last_undegraded":"2021-10-08T19:27:51.961103+0000","last_fullsized":"2021-10-08T19:27:51.961103+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130728+0000","last_change":"2021-10-08T19:26:03.878269+0000","last_active":"2021-10-08T19:27:23.130728+0000","last_peered":"2021-10-08T19:27:23.130728+0000","last_clean":"2021-10-08T19:27:23.130728+0000","last_became_active":"2021-10-08T19:26:03.878002+0000","last_became_peered":"2021-10-08T19:26:03.878002+0000","last_unstale":"2021-10-08T19:27:23.130728+0000","last_undegraded":"2021-10-08T19:27:23.130728+0000","last_fullsized":"2021-10-08T19:27:23.130728+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133126+0000","last_change":"2021-10-08T19:26:05.908668+0000","last_active":"2021-10-08T19:27:23.133126+0000","last_peered":"2021-10-08T19:27:23.133126+0000","last_clean":"2021-10-08T19:27:23.133126+0000","last_became_active":"2021-10-08T19:26:05.908363+0000","last_became_peered":"2021-10-08T19:26:05.908363+0000","last_unstale":"2021-10-08T19:27:23.133126+0000","last_undegraded":"2021-10-08T19:27:23.133126+0000","last_fullsized":"2021-10-08T19:27:23.133126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129330+0000","last_change":"2021-10-08T19:26:09.906423+0000","last_active":"2021-10-08T19:27:23.129330+0000","last_peered":"2021-10-08T19:27:23.129330+0000","last_clean":"2021-10-08T19:27:23.129330+0000","last_became_active":"2021-10-08T19:26:09.906117+0000","last_became_peered":"2021-10-08T19:26:09.906117+0000","last_unstale":"2021-10-08T19:27:23.129330+0000","last_undegraded":"2021-10-08T19:27:23.129330+0000","last_fullsized":"2021-10-08T19:27:23.129330+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961485+0000","last_change":"2021-10-08T19:26:07.895413+0000","last_active":"2021-10-08T19:27:51.961485+0000","last_peered":"2021-10-08T19:27:51.961485+0000","last_clean":"2021-10-08T19:27:51.961485+0000","last_became_active":"2021-10-08T19:26:07.894969+0000","last_became_peered":"2021-10-08T19:26:07.894969+0000","last_unstale":"2021-10-08T19:27:51.961485+0000","last_undegraded":"2021-10-08T19:27:51.961485+0000","last_fullsized":"2021-10-08T19:27:51.961485+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132692+0000","last_change":"2021-10-08T19:26:03.885303+0000","last_active":"2021-10-08T19:27:23.132692+0000","last_peered":"2021-10-08T19:27:23.132692+0000","last_clean":"2021-10-08T19:27:23.132692+0000","last_became_active":"2021-10-08T19:26:03.884768+0000","last_became_peered":"2021-10-08T19:26:03.884768+0000","last_unstale":"2021-10-08T19:27:23.132692+0000","last_undegraded":"2021-10-08T19:27:23.132692+0000","last_fullsized":"2021-10-08T19:27:23.132692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136058+0000","last_change":"2021-10-08T19:26:05.911070+0000","last_active":"2021-10-08T19:27:23.136058+0000","last_peered":"2021-10-08T19:27:23.136058+0000","last_clean":"2021-10-08T19:27:23.136058+0000","last_became_active":"2021-10-08T19:26:05.910852+0000","last_became_peered":"2021-10-08T19:26:05.910852+0000","last_unstale":"2021-10-08T19:27:23.136058+0000","last_undegraded":"2021-10-08T19:27:23.136058+0000","last_fullsized":"2021-10-08T19:27:23.136058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136951+0000","last_change":"2021-10-08T19:26:10.034573+0000","last_active":"2021-10-08T19:27:23.136951+0000","last_peered":"2021-10-08T19:27:23.136951+0000","last_clean":"2021-10-08T19:27:23.136951+0000","last_became_active":"2021-10-08T19:26:10.034291+0000","last_became_peered":"2021-10-08T19:26:10.034291+0000","last_unstale":"2021-10-08T19:27:23.136951+0000","last_undegraded":"2021-10-08T19:27:23.136951+0000","last_fullsized":"2021-10-08T19:27:23.136951+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133166+0000","last_change":"2021-10-08T19:26:07.895711+0000","last_active":"2021-10-08T19:27:23.133166+0000","last_peered":"2021-10-08T19:27:23.133166+0000","last_clean":"2021-10-08T19:27:23.133166+0000","last_became_active":"2021-10-08T19:26:07.895160+0000","last_became_peered":"2021-10-08T19:26:07.895160+0000","last_unstale":"2021-10-08T19:27:23.133166+0000","last_undegraded":"2021-10-08T19:27:23.133166+0000","last_fullsized":"2021-10-08T19:27:23.133166+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135308+0000","last_change":"2021-10-08T19:26:03.891822+0000","last_active":"2021-10-08T19:27:23.135308+0000","last_peered":"2021-10-08T19:27:23.135308+0000","last_clean":"2021-10-08T19:27:23.135308+0000","last_became_active":"2021-10-08T19:26:03.891524+0000","last_became_peered":"2021-10-08T19:26:03.891524+0000","last_unstale":"2021-10-08T19:27:23.135308+0000","last_undegraded":"2021-10-08T19:27:23.135308+0000","last_fullsized":"2021-10-08T19:27:23.135308+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136239+0000","last_change":"2021-10-08T19:26:05.911264+0000","last_active":"2021-10-08T19:27:23.136239+0000","last_peered":"2021-10-08T19:27:23.136239+0000","last_clean":"2021-10-08T19:27:23.136239+0000","last_became_active":"2021-10-08T19:26:05.910975+0000","last_became_peered":"2021-10-08T19:26:05.910975+0000","last_unstale":"2021-10-08T19:27:23.136239+0000","last_undegraded":"2021-10-08T19:27:23.136239+0000","last_fullsized":"2021-10-08T19:27:23.136239+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132390+0000","last_change":"2021-10-08T19:26:09.906398+0000","last_active":"2021-10-08T19:27:23.132390+0000","last_peered":"2021-10-08T19:27:23.132390+0000","last_clean":"2021-10-08T19:27:23.132390+0000","last_became_active":"2021-10-08T19:26:09.904737+0000","last_became_peered":"2021-10-08T19:26:09.904737+0000","last_unstale":"2021-10-08T19:27:23.132390+0000","last_undegraded":"2021-10-08T19:27:23.132390+0000","last_fullsized":"2021-10-08T19:27:23.132390+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136333+0000","last_change":"2021-10-08T19:26:07.891864+0000","last_active":"2021-10-08T19:27:23.136333+0000","last_peered":"2021-10-08T19:27:23.136333+0000","last_clean":"2021-10-08T19:27:23.136333+0000","last_became_active":"2021-10-08T19:26:07.891533+0000","last_became_peered":"2021-10-08T19:26:07.891533+0000","last_unstale":"2021-10-08T19:27:23.136333+0000","last_undegraded":"2021-10-08T19:27:23.136333+0000","last_fullsized":"2021-10-08T19:27:23.136333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133109+0000","last_change":"2021-10-08T19:26:03.884069+0000","last_active":"2021-10-08T19:27:23.133109+0000","last_peered":"2021-10-08T19:27:23.133109+0000","last_clean":"2021-10-08T19:27:23.133109+0000","last_became_active":"2021-10-08T19:26:03.883753+0000","last_became_peered":"2021-10-08T19:26:03.883753+0000","last_unstale":"2021-10-08T19:27:23.133109+0000","last_undegraded":"2021-10-08T19:27:23.133109+0000","last_fullsized":"2021-10-08T19:27:23.133109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129464+0000","last_change":"2021-10-08T19:26:05.910425+0000","last_active":"2021-10-08T19:27:23.129464+0000","last_peered":"2021-10-08T19:27:23.129464+0000","last_clean":"2021-10-08T19:27:23.129464+0000","last_became_active":"2021-10-08T19:26:05.910134+0000","last_became_peered":"2021-10-08T19:26:05.910134+0000","last_unstale":"2021-10-08T19:27:23.129464+0000","last_undegraded":"2021-10-08T19:27:23.129464+0000","last_fullsized":"2021-10-08T19:27:23.129464+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135398+0000","last_change":"2021-10-08T19:26:09.908294+0000","last_active":"2021-10-08T19:27:23.135398+0000","last_peered":"2021-10-08T19:27:23.135398+0000","last_clean":"2021-10-08T19:27:23.135398+0000","last_became_active":"2021-10-08T19:26:09.907996+0000","last_became_peered":"2021-10-08T19:26:09.907996+0000","last_unstale":"2021-10-08T19:27:23.135398+0000","last_undegraded":"2021-10-08T19:27:23.135398+0000","last_fullsized":"2021-10-08T19:27:23.135398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"58'2","reported_seq":36,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135882+0000","last_change":"2021-10-08T19:26:03.879079+0000","last_active":"2021-10-08T19:27:23.135882+0000","last_peered":"2021-10-08T19:27:23.135882+0000","last_clean":"2021-10-08T19:27:23.135882+0000","last_became_active":"2021-10-08T19:26:03.878782+0000","last_became_peered":"2021-10-08T19:26:03.878782+0000","last_unstale":"2021-10-08T19:27:23.135882+0000","last_undegraded":"2021-10-08T19:27:23.135882+0000","last_fullsized":"2021-10-08T19:27:23.135882+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"66'12","reported_seq":41,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134876+0000","last_change":"2021-10-08T19:26:05.898379+0000","last_active":"2021-10-08T19:27:23.134876+0000","last_peered":"2021-10-08T19:27:23.134876+0000","last_clean":"2021-10-08T19:27:23.134876+0000","last_became_active":"2021-10-08T19:26:05.898072+0000","last_became_peered":"2021-10-08T19:26:05.898072+0000","last_unstale":"2021-10-08T19:27:23.134876+0000","last_undegraded":"2021-10-08T19:27:23.134876+0000","last_fullsized":"2021-10-08T19:27:23.134876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133065+0000","last_change":"2021-10-08T19:26:07.896897+0000","last_active":"2021-10-08T19:27:23.133065+0000","last_peered":"2021-10-08T19:27:23.133065+0000","last_clean":"2021-10-08T19:27:23.133065+0000","last_became_active":"2021-10-08T19:26:07.896676+0000","last_became_peered":"2021-10-08T19:26:07.896676+0000","last_unstale":"2021-10-08T19:27:23.133065+0000","last_undegraded":"2021-10-08T19:27:23.133065+0000","last_fullsized":"2021-10-08T19:27:23.133065+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.128747+0000","last_change":"2021-10-08T19:26:09.908725+0000","last_active":"2021-10-08T19:27:23.128747+0000","last_peered":"2021-10-08T19:27:23.128747+0000","last_clean":"2021-10-08T19:27:23.128747+0000","last_became_active":"2021-10-08T19:26:09.908405+0000","last_became_peered":"2021-10-08T19:26:09.908405+0000","last_unstale":"2021-10-08T19:27:23.128747+0000","last_undegraded":"2021-10-08T19:27:23.128747+0000","last_fullsized":"2021-10-08T19:27:23.128747+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130466+0000","last_change":"2021-10-08T19:26:03.888663+0000","last_active":"2021-10-08T19:27:23.130466+0000","last_peered":"2021-10-08T19:27:23.130466+0000","last_clean":"2021-10-08T19:27:23.130466+0000","last_became_active":"2021-10-08T19:26:03.888376+0000","last_became_peered":"2021-10-08T19:26:03.888376+0000","last_unstale":"2021-10-08T19:27:23.130466+0000","last_undegraded":"2021-10-08T19:27:23.130466+0000","last_fullsized":"2021-10-08T19:27:23.130466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129816+0000","last_change":"2021-10-08T19:26:05.889724+0000","last_active":"2021-10-08T19:27:23.129816+0000","last_peered":"2021-10-08T19:27:23.129816+0000","last_clean":"2021-10-08T19:27:23.129816+0000","last_became_active":"2021-10-08T19:26:05.889320+0000","last_became_peered":"2021-10-08T19:26:05.889320+0000","last_unstale":"2021-10-08T19:27:23.129816+0000","last_undegraded":"2021-10-08T19:27:23.129816+0000","last_fullsized":"2021-10-08T19:27:23.129816+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":50,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961017+0000","last_change":"2021-10-08T19:26:07.892150+0000","last_active":"2021-10-08T19:27:51.961017+0000","last_peered":"2021-10-08T19:27:51.961017+0000","last_clean":"2021-10-08T19:27:51.961017+0000","last_became_active":"2021-10-08T19:26:07.891650+0000","last_became_peered":"2021-10-08T19:26:07.891650+0000","last_unstale":"2021-10-08T19:27:51.961017+0000","last_undegraded":"2021-10-08T19:27:51.961017+0000","last_fullsized":"2021-10-08T19:27:51.961017+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136364+0000","last_change":"2021-10-08T19:26:09.907036+0000","last_active":"2021-10-08T19:27:23.136364+0000","last_peered":"2021-10-08T19:27:23.136364+0000","last_clean":"2021-10-08T19:27:23.136364+0000","last_became_active":"2021-10-08T19:26:09.906695+0000","last_became_peered":"2021-10-08T19:26:09.906695+0000","last_unstale":"2021-10-08T19:27:23.136364+0000","last_undegraded":"2021-10-08T19:27:23.136364+0000","last_fullsized":"2021-10-08T19:27:23.136364+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132786+0000","last_change":"2021-10-08T19:26:03.885188+0000","last_active":"2021-10-08T19:27:23.132786+0000","last_peered":"2021-10-08T19:27:23.132786+0000","last_clean":"2021-10-08T19:27:23.132786+0000","last_became_active":"2021-10-08T19:26:03.883778+0000","last_became_peered":"2021-10-08T19:26:03.883778+0000","last_unstale":"2021-10-08T19:27:23.132786+0000","last_undegraded":"2021-10-08T19:27:23.132786+0000","last_fullsized":"2021-10-08T19:27:23.132786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"66'28","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:46.960124+0000","last_change":"2021-10-08T19:26:05.899759+0000","last_active":"2021-10-08T19:27:46.960124+0000","last_peered":"2021-10-08T19:27:46.960124+0000","last_clean":"2021-10-08T19:27:46.960124+0000","last_became_active":"2021-10-08T19:26:05.899269+0000","last_became_peered":"2021-10-08T19:26:05.899269+0000","last_unstale":"2021-10-08T19:27:46.960124+0000","last_undegraded":"2021-10-08T19:27:46.960124+0000","last_fullsized":"2021-10-08T19:27:46.960124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130294+0000","last_change":"2021-10-08T19:26:07.899304+0000","last_active":"2021-10-08T19:27:23.130294+0000","last_peered":"2021-10-08T19:27:23.130294+0000","last_clean":"2021-10-08T19:27:23.130294+0000","last_became_active":"2021-10-08T19:26:07.899003+0000","last_became_peered":"2021-10-08T19:26:07.899003+0000","last_unstale":"2021-10-08T19:27:23.130294+0000","last_undegraded":"2021-10-08T19:27:23.130294+0000","last_fullsized":"2021-10-08T19:27:23.130294+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137048+0000","last_change":"2021-10-08T19:26:10.034569+0000","last_active":"2021-10-08T19:27:23.137048+0000","last_peered":"2021-10-08T19:27:23.137048+0000","last_clean":"2021-10-08T19:27:23.137048+0000","last_became_active":"2021-10-08T19:26:10.034137+0000","last_became_peered":"2021-10-08T19:26:10.034137+0000","last_unstale":"2021-10-08T19:27:23.137048+0000","last_undegraded":"2021-10-08T19:27:23.137048+0000","last_fullsized":"2021-10-08T19:27:23.137048+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"66'5","reported_seq":126,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:52.298814+0000","last_change":"2021-10-08T19:26:03.886440+0000","last_active":"2021-10-08T19:27:52.298814+0000","last_peered":"2021-10-08T19:27:52.298814+0000","last_clean":"2021-10-08T19:27:52.298814+0000","last_became_active":"2021-10-08T19:26:03.886152+0000","last_became_peered":"2021-10-08T19:26:03.886152+0000","last_unstale":"2021-10-08T19:27:52.298814+0000","last_undegraded":"2021-10-08T19:27:52.298814+0000","last_fullsized":"2021-10-08T19:27:52.298814+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132722+0000","last_change":"2021-10-08T19:26:03.876728+0000","last_active":"2021-10-08T19:27:23.132722+0000","last_peered":"2021-10-08T19:27:23.132722+0000","last_clean":"2021-10-08T19:27:23.132722+0000","last_became_active":"2021-10-08T19:26:03.876378+0000","last_became_peered":"2021-10-08T19:26:03.876378+0000","last_unstale":"2021-10-08T19:27:23.132722+0000","last_undegraded":"2021-10-08T19:27:23.132722+0000","last_fullsized":"2021-10-08T19:27:23.132722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":45,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133620+0000","last_change":"2021-10-08T19:26:05.890969+0000","last_active":"2021-10-08T19:27:23.133620+0000","last_peered":"2021-10-08T19:27:23.133620+0000","last_clean":"2021-10-08T19:27:23.133620+0000","last_became_active":"2021-10-08T19:26:05.890656+0000","last_became_peered":"2021-10-08T19:26:05.890656+0000","last_unstale":"2021-10-08T19:27:23.133620+0000","last_undegraded":"2021-10-08T19:27:23.133620+0000","last_fullsized":"2021-10-08T19:27:23.133620+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133660+0000","last_change":"2021-10-08T19:26:07.897148+0000","last_active":"2021-10-08T19:27:23.133660+0000","last_peered":"2021-10-08T19:27:23.133660+0000","last_clean":"2021-10-08T19:27:23.133660+0000","last_became_active":"2021-10-08T19:26:07.896843+0000","last_became_peered":"2021-10-08T19:26:07.896843+0000","last_unstale":"2021-10-08T19:27:23.133660+0000","last_undegraded":"2021-10-08T19:27:23.133660+0000","last_fullsized":"2021-10-08T19:27:23.133660+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133542+0000","last_change":"2021-10-08T19:26:09.909550+0000","last_active":"2021-10-08T19:27:23.133542+0000","last_peered":"2021-10-08T19:27:23.133542+0000","last_clean":"2021-10-08T19:27:23.133542+0000","last_became_active":"2021-10-08T19:26:09.909241+0000","last_became_peered":"2021-10-08T19:26:09.909241+0000","last_unstale":"2021-10-08T19:27:23.133542+0000","last_undegraded":"2021-10-08T19:27:23.133542+0000","last_fullsized":"2021-10-08T19:27:23.133542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135903+0000","last_change":"2021-10-08T19:26:03.880862+0000","last_active":"2021-10-08T19:27:23.135903+0000","last_peered":"2021-10-08T19:27:23.135903+0000","last_clean":"2021-10-08T19:27:23.135903+0000","last_became_active":"2021-10-08T19:26:03.880338+0000","last_became_peered":"2021-10-08T19:26:03.880338+0000","last_unstale":"2021-10-08T19:27:23.135903+0000","last_undegraded":"2021-10-08T19:27:23.135903+0000","last_fullsized":"2021-10-08T19:27:23.135903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132926+0000","last_change":"2021-10-08T19:26:03.886658+0000","last_active":"2021-10-08T19:27:23.132926+0000","last_peered":"2021-10-08T19:27:23.132926+0000","last_clean":"2021-10-08T19:27:23.132926+0000","last_became_active":"2021-10-08T19:26:03.886359+0000","last_became_peered":"2021-10-08T19:26:03.886359+0000","last_unstale":"2021-10-08T19:27:23.132926+0000","last_undegraded":"2021-10-08T19:27:23.132926+0000","last_fullsized":"2021-10-08T19:27:23.132926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"67'128","reported_seq":268,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136466+0000","last_change":"2021-10-08T19:25:59.227631+0000","last_active":"2021-10-08T19:27:23.136466+0000","last_peered":"2021-10-08T19:27:23.136466+0000","last_clean":"2021-10-08T19:27:23.136466+0000","last_became_active":"2021-10-08T19:25:59.227199+0000","last_became_peered":"2021-10-08T19:25:59.227199+0000","last_unstale":"2021-10-08T19:27:23.136466+0000","last_undegraded":"2021-10-08T19:27:23.136466+0000","last_fullsized":"2021-10-08T19:27:23.136466+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:25.035234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:24:25.035234+0000","last_clean_scrub_stamp":"2021-10-08T19:24:25.035234+0000","log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"66'14","reported_seq":40,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137503+0000","last_change":"2021-10-08T19:26:05.909813+0000","last_active":"2021-10-08T19:27:23.137503+0000","last_peered":"2021-10-08T19:27:23.137503+0000","last_clean":"2021-10-08T19:27:23.137503+0000","last_became_active":"2021-10-08T19:26:05.909567+0000","last_became_peered":"2021-10-08T19:26:05.909567+0000","last_unstale":"2021-10-08T19:27:23.137503+0000","last_undegraded":"2021-10-08T19:27:23.137503+0000","last_fullsized":"2021-10-08T19:27:23.137503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137164+0000","last_change":"2021-10-08T19:26:07.897122+0000","last_active":"2021-10-08T19:27:23.137164+0000","last_peered":"2021-10-08T19:27:23.137164+0000","last_clean":"2021-10-08T19:27:23.137164+0000","last_became_active":"2021-10-08T19:26:07.896817+0000","last_became_peered":"2021-10-08T19:26:07.896817+0000","last_unstale":"2021-10-08T19:27:23.137164+0000","last_undegraded":"2021-10-08T19:27:23.137164+0000","last_fullsized":"2021-10-08T19:27:23.137164+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130244+0000","last_change":"2021-10-08T19:26:09.910118+0000","last_active":"2021-10-08T19:27:23.130244+0000","last_peered":"2021-10-08T19:27:23.130244+0000","last_clean":"2021-10-08T19:27:23.130244+0000","last_became_active":"2021-10-08T19:26:09.909724+0000","last_became_peered":"2021-10-08T19:26:09.909724+0000","last_unstale":"2021-10-08T19:27:23.130244+0000","last_undegraded":"2021-10-08T19:27:23.130244+0000","last_fullsized":"2021-10-08T19:27:23.130244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129373+0000","last_change":"2021-10-08T19:26:03.876588+0000","last_active":"2021-10-08T19:27:23.129373+0000","last_peered":"2021-10-08T19:27:23.129373+0000","last_clean":"2021-10-08T19:27:23.129373+0000","last_became_active":"2021-10-08T19:26:03.876291+0000","last_became_peered":"2021-10-08T19:26:03.876291+0000","last_unstale":"2021-10-08T19:27:23.129373+0000","last_undegraded":"2021-10-08T19:27:23.129373+0000","last_fullsized":"2021-10-08T19:27:23.129373+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136409+0000","last_change":"2021-10-08T19:26:03.887313+0000","last_active":"2021-10-08T19:27:23.136409+0000","last_peered":"2021-10-08T19:27:23.136409+0000","last_clean":"2021-10-08T19:27:23.136409+0000","last_became_active":"2021-10-08T19:26:03.886601+0000","last_became_peered":"2021-10-08T19:26:03.886601+0000","last_unstale":"2021-10-08T19:27:23.136409+0000","last_undegraded":"2021-10-08T19:27:23.136409+0000","last_fullsized":"2021-10-08T19:27:23.136409+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":36,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129410+0000","last_change":"2021-10-08T19:26:05.892611+0000","last_active":"2021-10-08T19:27:23.129410+0000","last_peered":"2021-10-08T19:27:23.129410+0000","last_clean":"2021-10-08T19:27:23.129410+0000","last_became_active":"2021-10-08T19:26:05.892316+0000","last_became_peered":"2021-10-08T19:26:05.892316+0000","last_unstale":"2021-10-08T19:27:23.129410+0000","last_undegraded":"2021-10-08T19:27:23.129410+0000","last_fullsized":"2021-10-08T19:27:23.129410+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133464+0000","last_change":"2021-10-08T19:26:07.895467+0000","last_active":"2021-10-08T19:27:23.133464+0000","last_peered":"2021-10-08T19:27:23.133464+0000","last_clean":"2021-10-08T19:27:23.133464+0000","last_became_active":"2021-10-08T19:26:07.895077+0000","last_became_peered":"2021-10-08T19:26:07.895077+0000","last_unstale":"2021-10-08T19:27:23.133464+0000","last_undegraded":"2021-10-08T19:27:23.133464+0000","last_fullsized":"2021-10-08T19:27:23.133464+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129102+0000","last_change":"2021-10-08T19:26:10.033095+0000","last_active":"2021-10-08T19:27:23.129102+0000","last_peered":"2021-10-08T19:27:23.129102+0000","last_clean":"2021-10-08T19:27:23.129102+0000","last_became_active":"2021-10-08T19:26:10.032695+0000","last_became_peered":"2021-10-08T19:26:10.032695+0000","last_unstale":"2021-10-08T19:27:23.129102+0000","last_undegraded":"2021-10-08T19:27:23.129102+0000","last_fullsized":"2021-10-08T19:27:23.129102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137066+0000","last_change":"2021-10-08T19:26:03.883144+0000","last_active":"2021-10-08T19:27:23.137066+0000","last_peered":"2021-10-08T19:27:23.137066+0000","last_clean":"2021-10-08T19:27:23.137066+0000","last_became_active":"2021-10-08T19:26:03.882646+0000","last_became_peered":"2021-10-08T19:26:03.882646+0000","last_unstale":"2021-10-08T19:27:23.137066+0000","last_undegraded":"2021-10-08T19:27:23.137066+0000","last_fullsized":"2021-10-08T19:27:23.137066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"66'19","reported_seq":54,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130683+0000","last_change":"2021-10-08T19:26:05.908572+0000","last_active":"2021-10-08T19:27:23.130683+0000","last_peered":"2021-10-08T19:27:23.130683+0000","last_clean":"2021-10-08T19:27:23.130683+0000","last_became_active":"2021-10-08T19:26:05.908134+0000","last_became_peered":"2021-10-08T19:26:05.908134+0000","last_unstale":"2021-10-08T19:27:23.130683+0000","last_undegraded":"2021-10-08T19:27:23.130683+0000","last_fullsized":"2021-10-08T19:27:23.130683+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137573+0000","last_change":"2021-10-08T19:26:07.896384+0000","last_active":"2021-10-08T19:27:23.137573+0000","last_peered":"2021-10-08T19:27:23.137573+0000","last_clean":"2021-10-08T19:27:23.137573+0000","last_became_active":"2021-10-08T19:26:07.896045+0000","last_became_peered":"2021-10-08T19:26:07.896045+0000","last_unstale":"2021-10-08T19:27:23.137573+0000","last_undegraded":"2021-10-08T19:27:23.137573+0000","last_fullsized":"2021-10-08T19:27:23.137573+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134911+0000","last_change":"2021-10-08T19:26:09.904441+0000","last_active":"2021-10-08T19:27:23.134911+0000","last_peered":"2021-10-08T19:27:23.134911+0000","last_clean":"2021-10-08T19:27:23.134911+0000","last_became_active":"2021-10-08T19:26:09.904174+0000","last_became_peered":"2021-10-08T19:26:09.904174+0000","last_unstale":"2021-10-08T19:27:23.134911+0000","last_undegraded":"2021-10-08T19:27:23.134911+0000","last_fullsized":"2021-10-08T19:27:23.134911+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.131916+0000","last_change":"2021-10-08T19:26:03.891688+0000","last_active":"2021-10-08T19:27:23.131916+0000","last_peered":"2021-10-08T19:27:23.131916+0000","last_clean":"2021-10-08T19:27:23.131916+0000","last_became_active":"2021-10-08T19:26:03.891405+0000","last_became_peered":"2021-10-08T19:26:03.891405+0000","last_unstale":"2021-10-08T19:27:23.131916+0000","last_undegraded":"2021-10-08T19:27:23.131916+0000","last_fullsized":"2021-10-08T19:27:23.131916+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134998+0000","last_change":"2021-10-08T19:26:05.911204+0000","last_active":"2021-10-08T19:27:23.134998+0000","last_peered":"2021-10-08T19:27:23.134998+0000","last_clean":"2021-10-08T19:27:23.134998+0000","last_became_active":"2021-10-08T19:26:05.910934+0000","last_became_peered":"2021-10-08T19:26:05.910934+0000","last_unstale":"2021-10-08T19:27:23.134998+0000","last_undegraded":"2021-10-08T19:27:23.134998+0000","last_fullsized":"2021-10-08T19:27:23.134998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134964+0000","last_change":"2021-10-08T19:26:07.898137+0000","last_active":"2021-10-08T19:27:23.134964+0000","last_peered":"2021-10-08T19:27:23.134964+0000","last_clean":"2021-10-08T19:27:23.134964+0000","last_became_active":"2021-10-08T19:26:07.897845+0000","last_became_peered":"2021-10-08T19:26:07.897845+0000","last_unstale":"2021-10-08T19:27:23.134964+0000","last_undegraded":"2021-10-08T19:27:23.134964+0000","last_fullsized":"2021-10-08T19:27:23.134964+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137645+0000","last_change":"2021-10-08T19:26:10.034430+0000","last_active":"2021-10-08T19:27:23.137645+0000","last_peered":"2021-10-08T19:27:23.137645+0000","last_clean":"2021-10-08T19:27:23.137645+0000","last_became_active":"2021-10-08T19:26:10.034144+0000","last_became_peered":"2021-10-08T19:26:10.034144+0000","last_unstale":"2021-10-08T19:27:23.137645+0000","last_undegraded":"2021-10-08T19:27:23.137645+0000","last_fullsized":"2021-10-08T19:27:23.137645+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.138352+0000","last_change":"2021-10-08T19:26:03.882923+0000","last_active":"2021-10-08T19:27:23.138352+0000","last_peered":"2021-10-08T19:27:23.138352+0000","last_clean":"2021-10-08T19:27:23.138352+0000","last_became_active":"2021-10-08T19:26:03.882221+0000","last_became_peered":"2021-10-08T19:26:03.882221+0000","last_unstale":"2021-10-08T19:27:23.138352+0000","last_undegraded":"2021-10-08T19:27:23.138352+0000","last_fullsized":"2021-10-08T19:27:23.138352+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":39,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134655+0000","last_change":"2021-10-08T19:26:05.885882+0000","last_active":"2021-10-08T19:27:23.134655+0000","last_peered":"2021-10-08T19:27:23.134655+0000","last_clean":"2021-10-08T19:27:23.134655+0000","last_became_active":"2021-10-08T19:26:05.885583+0000","last_became_peered":"2021-10-08T19:26:05.885583+0000","last_unstale":"2021-10-08T19:27:23.134655+0000","last_undegraded":"2021-10-08T19:27:23.134655+0000","last_fullsized":"2021-10-08T19:27:23.134655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961081+0000","last_change":"2021-10-08T19:26:07.894373+0000","last_active":"2021-10-08T19:27:51.961081+0000","last_peered":"2021-10-08T19:27:51.961081+0000","last_clean":"2021-10-08T19:27:51.961081+0000","last_became_active":"2021-10-08T19:26:07.894047+0000","last_became_peered":"2021-10-08T19:26:07.894047+0000","last_unstale":"2021-10-08T19:27:51.961081+0000","last_undegraded":"2021-10-08T19:27:51.961081+0000","last_fullsized":"2021-10-08T19:27:51.961081+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135969+0000","last_change":"2021-10-08T19:26:10.033163+0000","last_active":"2021-10-08T19:27:23.135969+0000","last_peered":"2021-10-08T19:27:23.135969+0000","last_clean":"2021-10-08T19:27:23.135969+0000","last_became_active":"2021-10-08T19:26:10.032824+0000","last_became_peered":"2021-10-08T19:26:10.032824+0000","last_unstale":"2021-10-08T19:27:23.135969+0000","last_undegraded":"2021-10-08T19:27:23.135969+0000","last_fullsized":"2021-10-08T19:27:23.135969+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133389+0000","last_change":"2021-10-08T19:26:07.896618+0000","last_active":"2021-10-08T19:27:23.133389+0000","last_peered":"2021-10-08T19:27:23.133389+0000","last_clean":"2021-10-08T19:27:23.133389+0000","last_became_active":"2021-10-08T19:26:07.896329+0000","last_became_peered":"2021-10-08T19:26:07.896329+0000","last_unstale":"2021-10-08T19:27:23.133389+0000","last_undegraded":"2021-10-08T19:27:23.133389+0000","last_fullsized":"2021-10-08T19:27:23.133389+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136502+0000","last_change":"2021-10-08T19:26:03.887482+0000","last_active":"2021-10-08T19:27:23.136502+0000","last_peered":"2021-10-08T19:27:23.136502+0000","last_clean":"2021-10-08T19:27:23.136502+0000","last_became_active":"2021-10-08T19:26:03.887016+0000","last_became_peered":"2021-10-08T19:26:03.887016+0000","last_unstale":"2021-10-08T19:27:23.136502+0000","last_undegraded":"2021-10-08T19:27:23.136502+0000","last_fullsized":"2021-10-08T19:27:23.136502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":37,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136645+0000","last_change":"2021-10-08T19:26:05.889574+0000","last_active":"2021-10-08T19:27:23.136645+0000","last_peered":"2021-10-08T19:27:23.136645+0000","last_clean":"2021-10-08T19:27:23.136645+0000","last_became_active":"2021-10-08T19:26:05.889299+0000","last_became_peered":"2021-10-08T19:26:05.889299+0000","last_unstale":"2021-10-08T19:27:23.136645+0000","last_undegraded":"2021-10-08T19:27:23.136645+0000","last_fullsized":"2021-10-08T19:27:23.136645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133009+0000","last_change":"2021-10-08T19:26:09.903740+0000","last_active":"2021-10-08T19:27:23.133009+0000","last_peered":"2021-10-08T19:27:23.133009+0000","last_clean":"2021-10-08T19:27:23.133009+0000","last_became_active":"2021-10-08T19:26:09.903457+0000","last_became_peered":"2021-10-08T19:26:09.903457+0000","last_unstale":"2021-10-08T19:27:23.133009+0000","last_undegraded":"2021-10-08T19:27:23.133009+0000","last_fullsized":"2021-10-08T19:27:23.133009+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961388+0000","last_change":"2021-10-08T19:26:07.899291+0000","last_active":"2021-10-08T19:27:51.961388+0000","last_peered":"2021-10-08T19:27:51.961388+0000","last_clean":"2021-10-08T19:27:51.961388+0000","last_became_active":"2021-10-08T19:26:07.899085+0000","last_became_peered":"2021-10-08T19:26:07.899085+0000","last_unstale":"2021-10-08T19:27:51.961388+0000","last_undegraded":"2021-10-08T19:27:51.961388+0000","last_fullsized":"2021-10-08T19:27:51.961388+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129317+0000","last_change":"2021-10-08T19:26:03.889083+0000","last_active":"2021-10-08T19:27:23.129317+0000","last_peered":"2021-10-08T19:27:23.129317+0000","last_clean":"2021-10-08T19:27:23.129317+0000","last_became_active":"2021-10-08T19:26:03.888824+0000","last_became_peered":"2021-10-08T19:26:03.888824+0000","last_unstale":"2021-10-08T19:27:23.129317+0000","last_undegraded":"2021-10-08T19:27:23.129317+0000","last_fullsized":"2021-10-08T19:27:23.129317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":43,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133778+0000","last_change":"2021-10-08T19:26:05.898794+0000","last_active":"2021-10-08T19:27:23.133778+0000","last_peered":"2021-10-08T19:27:23.133778+0000","last_clean":"2021-10-08T19:27:23.133778+0000","last_became_active":"2021-10-08T19:26:05.898538+0000","last_became_peered":"2021-10-08T19:26:05.898538+0000","last_unstale":"2021-10-08T19:27:23.133778+0000","last_undegraded":"2021-10-08T19:27:23.133778+0000","last_fullsized":"2021-10-08T19:27:23.133778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136349+0000","last_change":"2021-10-08T19:26:09.903613+0000","last_active":"2021-10-08T19:27:23.136349+0000","last_peered":"2021-10-08T19:27:23.136349+0000","last_clean":"2021-10-08T19:27:23.136349+0000","last_became_active":"2021-10-08T19:26:09.902327+0000","last_became_peered":"2021-10-08T19:26:09.902327+0000","last_unstale":"2021-10-08T19:27:23.136349+0000","last_undegraded":"2021-10-08T19:27:23.136349+0000","last_fullsized":"2021-10-08T19:27:23.136349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961020+0000","last_change":"2021-10-08T19:26:07.896361+0000","last_active":"2021-10-08T19:27:51.961020+0000","last_peered":"2021-10-08T19:27:51.961020+0000","last_clean":"2021-10-08T19:27:51.961020+0000","last_became_active":"2021-10-08T19:26:07.896125+0000","last_became_peered":"2021-10-08T19:26:07.896125+0000","last_unstale":"2021-10-08T19:27:51.961020+0000","last_undegraded":"2021-10-08T19:27:51.961020+0000","last_fullsized":"2021-10-08T19:27:51.961020+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129664+0000","last_change":"2021-10-08T19:26:03.884419+0000","last_active":"2021-10-08T19:27:23.129664+0000","last_peered":"2021-10-08T19:27:23.129664+0000","last_clean":"2021-10-08T19:27:23.129664+0000","last_became_active":"2021-10-08T19:26:03.884055+0000","last_became_peered":"2021-10-08T19:26:03.884055+0000","last_unstale":"2021-10-08T19:27:23.129664+0000","last_undegraded":"2021-10-08T19:27:23.129664+0000","last_fullsized":"2021-10-08T19:27:23.129664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135136+0000","last_change":"2021-10-08T19:26:05.898285+0000","last_active":"2021-10-08T19:27:23.135136+0000","last_peered":"2021-10-08T19:27:23.135136+0000","last_clean":"2021-10-08T19:27:23.135136+0000","last_became_active":"2021-10-08T19:26:05.897996+0000","last_became_peered":"2021-10-08T19:26:05.897996+0000","last_unstale":"2021-10-08T19:27:23.135136+0000","last_undegraded":"2021-10-08T19:27:23.135136+0000","last_fullsized":"2021-10-08T19:27:23.135136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133759+0000","last_change":"2021-10-08T19:26:09.910868+0000","last_active":"2021-10-08T19:27:23.133759+0000","last_peered":"2021-10-08T19:27:23.133759+0000","last_clean":"2021-10-08T19:27:23.133759+0000","last_became_active":"2021-10-08T19:26:09.910507+0000","last_became_peered":"2021-10-08T19:26:09.910507+0000","last_unstale":"2021-10-08T19:27:23.133759+0000","last_undegraded":"2021-10-08T19:27:23.133759+0000","last_fullsized":"2021-10-08T19:27:23.133759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130306+0000","last_change":"2021-10-08T19:26:07.891733+0000","last_active":"2021-10-08T19:27:23.130306+0000","last_peered":"2021-10-08T19:27:23.130306+0000","last_clean":"2021-10-08T19:27:23.130306+0000","last_became_active":"2021-10-08T19:26:07.891308+0000","last_became_peered":"2021-10-08T19:26:07.891308+0000","last_unstale":"2021-10-08T19:27:23.130306+0000","last_undegraded":"2021-10-08T19:27:23.130306+0000","last_fullsized":"2021-10-08T19:27:23.130306+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137322+0000","last_change":"2021-10-08T19:26:03.890209+0000","last_active":"2021-10-08T19:27:23.137322+0000","last_peered":"2021-10-08T19:27:23.137322+0000","last_clean":"2021-10-08T19:27:23.137322+0000","last_became_active":"2021-10-08T19:26:03.889891+0000","last_became_peered":"2021-10-08T19:26:03.889891+0000","last_unstale":"2021-10-08T19:27:23.137322+0000","last_undegraded":"2021-10-08T19:27:23.137322+0000","last_fullsized":"2021-10-08T19:27:23.137322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":46,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136353+0000","last_change":"2021-10-08T19:26:05.890530+0000","last_active":"2021-10-08T19:27:23.136353+0000","last_peered":"2021-10-08T19:27:23.136353+0000","last_clean":"2021-10-08T19:27:23.136353+0000","last_became_active":"2021-10-08T19:26:05.890265+0000","last_became_peered":"2021-10-08T19:26:05.890265+0000","last_unstale":"2021-10-08T19:27:23.136353+0000","last_undegraded":"2021-10-08T19:27:23.136353+0000","last_fullsized":"2021-10-08T19:27:23.136353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136360+0000","last_change":"2021-10-08T19:26:09.910294+0000","last_active":"2021-10-08T19:27:23.136360+0000","last_peered":"2021-10-08T19:27:23.136360+0000","last_clean":"2021-10-08T19:27:23.136360+0000","last_became_active":"2021-10-08T19:26:09.910012+0000","last_became_peered":"2021-10-08T19:26:09.910012+0000","last_unstale":"2021-10-08T19:27:23.136360+0000","last_undegraded":"2021-10-08T19:27:23.136360+0000","last_fullsized":"2021-10-08T19:27:23.136360+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133465+0000","last_change":"2021-10-08T19:26:07.896352+0000","last_active":"2021-10-08T19:27:23.133465+0000","last_peered":"2021-10-08T19:27:23.133465+0000","last_clean":"2021-10-08T19:27:23.133465+0000","last_became_active":"2021-10-08T19:26:07.896086+0000","last_became_peered":"2021-10-08T19:26:07.896086+0000","last_unstale":"2021-10-08T19:27:23.133465+0000","last_undegraded":"2021-10-08T19:27:23.133465+0000","last_fullsized":"2021-10-08T19:27:23.133465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132651+0000","last_change":"2021-10-08T19:26:03.887402+0000","last_active":"2021-10-08T19:27:23.132651+0000","last_peered":"2021-10-08T19:27:23.132651+0000","last_clean":"2021-10-08T19:27:23.132651+0000","last_became_active":"2021-10-08T19:26:03.887155+0000","last_became_peered":"2021-10-08T19:26:03.887155+0000","last_unstale":"2021-10-08T19:27:23.132651+0000","last_undegraded":"2021-10-08T19:27:23.132651+0000","last_fullsized":"2021-10-08T19:27:23.132651+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"66'19","reported_seq":49,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137471+0000","last_change":"2021-10-08T19:26:05.908446+0000","last_active":"2021-10-08T19:27:23.137471+0000","last_peered":"2021-10-08T19:27:23.137471+0000","last_clean":"2021-10-08T19:27:23.137471+0000","last_became_active":"2021-10-08T19:26:05.908133+0000","last_became_peered":"2021-10-08T19:26:05.908133+0000","last_unstale":"2021-10-08T19:27:23.137471+0000","last_undegraded":"2021-10-08T19:27:23.137471+0000","last_fullsized":"2021-10-08T19:27:23.137471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129074+0000","last_change":"2021-10-08T19:26:09.902749+0000","last_active":"2021-10-08T19:27:23.129074+0000","last_peered":"2021-10-08T19:27:23.129074+0000","last_clean":"2021-10-08T19:27:23.129074+0000","last_became_active":"2021-10-08T19:26:09.902347+0000","last_became_peered":"2021-10-08T19:26:09.902347+0000","last_unstale":"2021-10-08T19:27:23.129074+0000","last_undegraded":"2021-10-08T19:27:23.129074+0000","last_fullsized":"2021-10-08T19:27:23.129074+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133351+0000","last_change":"2021-10-08T19:26:07.898242+0000","last_active":"2021-10-08T19:27:23.133351+0000","last_peered":"2021-10-08T19:27:23.133351+0000","last_clean":"2021-10-08T19:27:23.133351+0000","last_became_active":"2021-10-08T19:26:07.897864+0000","last_became_peered":"2021-10-08T19:26:07.897864+0000","last_unstale":"2021-10-08T19:27:23.133351+0000","last_undegraded":"2021-10-08T19:27:23.133351+0000","last_fullsized":"2021-10-08T19:27:23.133351+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"58'1","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130986+0000","last_change":"2021-10-08T19:26:03.890444+0000","last_active":"2021-10-08T19:27:23.130986+0000","last_peered":"2021-10-08T19:27:23.130986+0000","last_clean":"2021-10-08T19:27:23.130986+0000","last_became_active":"2021-10-08T19:26:03.890110+0000","last_became_peered":"2021-10-08T19:26:03.890110+0000","last_unstale":"2021-10-08T19:27:23.130986+0000","last_undegraded":"2021-10-08T19:27:23.130986+0000","last_fullsized":"2021-10-08T19:27:23.130986+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130771+0000","last_change":"2021-10-08T19:26:05.891000+0000","last_active":"2021-10-08T19:27:23.130771+0000","last_peered":"2021-10-08T19:27:23.130771+0000","last_clean":"2021-10-08T19:27:23.130771+0000","last_became_active":"2021-10-08T19:26:05.890671+0000","last_became_peered":"2021-10-08T19:26:05.890671+0000","last_unstale":"2021-10-08T19:27:23.130771+0000","last_undegraded":"2021-10-08T19:27:23.130771+0000","last_fullsized":"2021-10-08T19:27:23.130771+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132681+0000","last_change":"2021-10-08T19:26:10.032969+0000","last_active":"2021-10-08T19:27:23.132681+0000","last_peered":"2021-10-08T19:27:23.132681+0000","last_clean":"2021-10-08T19:27:23.132681+0000","last_became_active":"2021-10-08T19:26:10.032604+0000","last_became_peered":"2021-10-08T19:26:10.032604+0000","last_unstale":"2021-10-08T19:27:23.132681+0000","last_undegraded":"2021-10-08T19:27:23.132681+0000","last_fullsized":"2021-10-08T19:27:23.132681+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"58'1","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133756+0000","last_change":"2021-10-08T19:26:03.884516+0000","last_active":"2021-10-08T19:27:23.133756+0000","last_peered":"2021-10-08T19:27:23.133756+0000","last_clean":"2021-10-08T19:27:23.133756+0000","last_became_active":"2021-10-08T19:26:03.884207+0000","last_became_peered":"2021-10-08T19:26:03.884207+0000","last_unstale":"2021-10-08T19:27:23.133756+0000","last_undegraded":"2021-10-08T19:27:23.133756+0000","last_fullsized":"2021-10-08T19:27:23.133756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":43,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132560+0000","last_change":"2021-10-08T19:26:05.908824+0000","last_active":"2021-10-08T19:27:23.132560+0000","last_peered":"2021-10-08T19:27:23.132560+0000","last_clean":"2021-10-08T19:27:23.132560+0000","last_became_active":"2021-10-08T19:26:05.908511+0000","last_became_peered":"2021-10-08T19:26:05.908511+0000","last_unstale":"2021-10-08T19:27:23.132560+0000","last_undegraded":"2021-10-08T19:27:23.132560+0000","last_fullsized":"2021-10-08T19:27:23.132560+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961419+0000","last_change":"2021-10-08T19:26:07.902561+0000","last_active":"2021-10-08T19:27:51.961419+0000","last_peered":"2021-10-08T19:27:51.961419+0000","last_clean":"2021-10-08T19:27:51.961419+0000","last_became_active":"2021-10-08T19:26:07.902230+0000","last_became_peered":"2021-10-08T19:26:07.902230+0000","last_unstale":"2021-10-08T19:27:51.961419+0000","last_undegraded":"2021-10-08T19:27:51.961419+0000","last_fullsized":"2021-10-08T19:27:51.961419+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":391,"ondisk_log_size":391,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299419,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6772,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738380,"statfs":{"total":95995035648,"available":95988101120,"internally_reserved":0,"allocated":1355776,"data_stored":910171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.629}]},{"osd":1,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.62},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.69099999999999995}]}]},{"osd":6,"up_from":45,"seq":193273528351,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6816,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738336,"statfs":{"total":95995035648,"available":95988056064,"internally_reserved":0,"allocated":1335296,"data_stored":909521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.629,"5min":1.145,"15min":1.145},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66900000000000004,"5min":1.071,"15min":1.071},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65500000000000003,"5min":1.175,"15min":1.175},"last":0.316},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66000000000000003,"5min":1.113,"15min":1.113},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63100000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.504},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59399999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.42399999999999999,"15min":0.42799999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.66000000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52800000000000002,"5min":0.996,"15min":0.996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.47599999999999998,"15min":0.48199999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.435}]},{"osd":7,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.47799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7116,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93738036,"statfs":{"total":95995035648,"available":95987748864,"internally_reserved":0,"allocated":790528,"data_stored":321226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:13 2021","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Oct 8 19:27:27 2021","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.376,"15min":0.376},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Oct 8 19:27:44 2021","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.42399999999999999,"15min":0.439},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.309}]},{"osd":4,"last update":"Fri Oct 8 19:27:07 2021","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.505}]},{"osd":5,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46899999999999997}]},{"osd":6,"last update":"Fri Oct 8 19:27:38 2021","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.43099999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7540,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93737612,"statfs":{"total":95995035648,"available":95987314688,"internally_reserved":0,"allocated":1355776,"data_stored":909833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:27:07 2021","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.378,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.54200000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:27:30 2021","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28100000000000003,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.40500000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.434,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.28100000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:27:47 2021","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48499999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.41299999999999998,"15min":0.435},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.52600000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.318}]},{"osd":4,"last update":"Fri Oct 8 19:26:59 2021","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.374,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:27:26 2021","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.45400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.68300000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65400000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.501}]},{"osd":6,"last update":"Fri Oct 8 19:27:42 2021","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66500000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68100000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:26:57 2021","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41199999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411373,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6832,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":6080,"kb_avail":93738320,"statfs":{"total":95995035648,"available":95988039680,"internally_reserved":0,"allocated":761856,"data_stored":320297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6225920},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:27 2021","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.39100000000000001,"15min":0.39500000000000002},"min":{"1min":0.253,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.58599999999999997,"5min":1.21,"15min":1.21},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:27:27 2021","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.37,"15min":0.376},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51500000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.58699999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34200000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:27:51 2021","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41599999999999998,"15min":0.432},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56299999999999994,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44800000000000001,"15min":0.47299999999999998},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.626,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:27:03 2021","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.71199999999999997,"15min":0.73199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2410000000000001,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:27:23 2021","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":1.226,"15min":1.226},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78900000000000003,"5min":1.204,"15min":1.204},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:27:40 2021","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79000000000000004,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86299999999999999,"5min":1.117,"15min":1.117},"last":0.497}]},{"osd":7,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60999999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149739,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6412,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738740,"statfs":{"total":95995035648,"available":95988469760,"internally_reserved":0,"allocated":790528,"data_stored":321195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:50 2021","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.38300000000000001,"15min":0.40500000000000003},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.309},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.40400000000000003,"15min":0.42799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.50700000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.22500000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:27:50 2021","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.42299999999999999},"min":{"1min":0.24399999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.47899999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:27:50 2021","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.434,"15min":0.45600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52100000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.498,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.25900000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:27:00 2021","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66200000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40200000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64500000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:27:42 2021","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.60799999999999998,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70099999999999996,"5min":1.869,"15min":1.869},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.60499999999999998,"15min":0.622},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.626,"5min":1.917,"15min":1.917},"last":0.36899999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:27:00 2021","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38800000000000001}]}]},{"osd":4,"up_from":31,"seq":133143986214,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6392,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738760,"statfs":{"total":95995035648,"available":95988490240,"internally_reserved":0,"allocated":770048,"data_stored":320492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.35499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90600000000000003,"5min":0.999,"15min":0.999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81000000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.55700000000000005,"15min":0.52100000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.6950000000000003,"5min":5.6950000000000003,"15min":5.6950000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0980000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.59999999999999998,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":7.3200000000000003,"5min":7.3200000000000003,"15min":7.3200000000000003},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 8 19:27:20 2021","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58099999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.501},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.432,"15min":0.40999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:27:44 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.437,"15min":0.437},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.46100000000000002},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.439}]}]},{"osd":5,"up_from":38,"seq":163208757282,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6244,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738908,"statfs":{"total":95995035648,"available":95988641792,"internally_reserved":0,"allocated":749568,"data_stored":319234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63700000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64900000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.436},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72199999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.41399999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35699999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.629,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:26:57 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.497}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:28:01.833 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph pg dump --format=json 2021-10-08T19:28:01.869 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-10-08T19:28:01.870 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-10-08T19:28:01.871 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-10-08T19:28:01.871 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-10-08T19:28:01.871 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-10-08T19:28:01.872 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:01 smithi142 ceph-mon[33432]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:01.873 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:01 smithi142 ceph-mon[33432]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:02.042 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:01 smithi112 ceph-mon[40655]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:02.043 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:01 smithi112 ceph-mon[40655]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:02.043 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:01 smithi112 systemd[1]: Stopping Ceph alertmanager.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:28:02.043 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:01 smithi112 bash[80525]: Error: no container with name or ID "ceph-c1559bde-286c-11ec-8c25-001a4aab830c-alertmanager.a" found: no such container 2021-10-08T19:28:02.044 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:01 smithi112 conmon[73761]: level=info ts=2021-10-08T19:28:01.929Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-10-08T19:28:02.044 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:01 smithi112 ceph-mon[31694]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:02.044 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:01 smithi112 ceph-mon[31694]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:02.130 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-10-08T19:28:02.130 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:01 smithi142 conmon[65044]: t=2021-10-08T19:28:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-10-08T19:28:02.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-10-08T19:28:02.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-10-08T19:28:02.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-10-08T19:28:02.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-10-08T19:28:02.131 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-10-08T19:28:02.132 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-10-08T19:28:02.415 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-10-08T19:28:02.415 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-10-08T19:28:02.416 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-10-08T19:28:02.416 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-10-08T19:28:02.416 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-10-08T19:28:02.416 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-10-08T19:28:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:02.683 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-10-08T19:28:02.683 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-10-08T19:28:02.683 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-10-08T19:28:02.732 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:02 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:28:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:02.732 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:02 smithi112 bash[80525]: ceph-c1559bde-286c-11ec-8c25-001a4aab830c-alertmanager-a 2021-10-08T19:28:02.733 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:02 smithi112 bash[80525]: Error: no container with name or ID "ceph-c1559bde-286c-11ec-8c25-001a4aab830c-alertmanager.a" found: no such container 2021-10-08T19:28:02.733 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:02 smithi112 systemd[1]: ceph-c1559bde-286c-11ec-8c25-001a4aab830c@alertmanager.a.service: Succeeded. 2021-10-08T19:28:02.733 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:02 smithi112 systemd[1]: Stopped Ceph alertmanager.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:28:02.733 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:02 smithi112 systemd[1]: Starting Ceph alertmanager.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:28:02.985 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-10-08T19:28:02.985 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-10-08T19:28:02.985 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-10-08T19:28:02.986 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-10-08T19:28:02.986 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-10-08T19:28:02.986 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-10-08T19:28:02.986 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-10-08T19:28:02.987 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:02 smithi142 conmon[65044]: t=2021-10-08T19:28:02+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-10-08T19:28:03.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:03.273 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-10-08T19:28:03.274 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-10-08T19:28:03.274 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-10-08T19:28:03.274 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-10-08T19:28:03.605 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-10-08T19:28:03.605 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-10-08T19:28:03.606 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-10-08T19:28:03.606 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-10-08T19:28:03.606 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-10-08T19:28:03.857 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-10-08T19:28:03.858 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-10-08T19:28:03.858 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-10-08T19:28:03.858 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-10-08T19:28:03.858 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-10-08T19:28:03.859 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-10-08T19:28:03.859 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-10-08T19:28:03.859 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-10-08T19:28:03.859 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-10-08T19:28:03.860 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-10-08T19:28:03.860 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:03 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:03.860 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:03 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:28:03.860 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:03 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:28:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:03.861 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:03 smithi142 ceph-mon[33432]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:04.022 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:03 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:04.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:03 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:28:04.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:03 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:28:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:04.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:03 smithi112 ceph-mon[31694]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:04.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:03 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:04.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:03 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:28:04.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:03 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:28:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:04.024 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:03 smithi112 ceph-mon[40655]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:04.159 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-10-08T19:28:04.160 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:03 smithi142 conmon[65044]: t=2021-10-08T19:28:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-10-08T19:28:04.160 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-10-08T19:28:04.160 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-10-08T19:28:04.160 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-10-08T19:28:04.256 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 -- 172.21.15.112:0/4177243154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 msgr2=0x7f28f81042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:04.257 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/4177243154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 0x7f28f81042b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009ab0 tx=0x7f28f0004c50 comp rx=0 tx=0).stop 2021-10-08T19:28:04.257 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 -- 172.21.15.112:0/4177243154 shutdown_connections 2021-10-08T19:28:04.257 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/4177243154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 0x7f28f81042b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.258 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/4177243154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80fd4b0 0x7f28f80fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.258 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/4177243154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f80fde50 0x7f28f80f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.258 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 -- 172.21.15.112:0/4177243154 >> 172.21.15.112:0/4177243154 conn(0x7f28f806e310 msgr2=0x7f28f806e710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:28:04.259 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 -- 172.21.15.112:0/4177243154 shutdown_connections 2021-10-08T19:28:04.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 -- 172.21.15.112:0/4177243154 wait complete. 2021-10-08T19:28:04.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 Processor -- start 2021-10-08T19:28:04.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.253+0000 7f28fc8b4700 1 -- start start 2021-10-08T19:28:04.260 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28fc8b4700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 0x7f28f810e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:04.261 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28fc8b4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80fd4b0 0x7f28f810eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:04.261 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28fc8b4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f80fde50 0x7f28f8108420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:04.261 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28fc8b4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81089f0 con 0x7f28f80fde50 2021-10-08T19:28:04.262 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28fc8b4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f8108b60 con 0x7f28f80fd4b0 2021-10-08T19:28:04.262 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28fc8b4700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f8108d20 con 0x7f28f80f7c80 2021-10-08T19:28:04.262 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 0x7f28f810e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:04.262 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f80fde50 0x7f28f8108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:04.263 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 0x7f28f810e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:56478/0 (socket says 172.21.15.112:56478) 2021-10-08T19:28:04.263 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f80fde50 0x7f28f8108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34522/0 (socket says 172.21.15.112:34522) 2021-10-08T19:28:04.263 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80fd4b0 0x7f28f810eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:04.263 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 -- 172.21.15.112:0/2524327619 learned_addr learned my addr 172.21.15.112:0/2524327619 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:28:04.264 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 -- 172.21.15.112:0/2524327619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80fd4b0 msgr2=0x7f28f810eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:04.264 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80fd4b0 0x7f28f810eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.264 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 -- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f80fde50 msgr2=0x7f28f8108420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:04.264 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f80fde50 0x7f28f8108420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.265 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 -- 172.21.15.112:0/2524327619 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec005040 con 0x7f28f80f7c80 2021-10-08T19:28:04.265 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28f77fe700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 0x7f28f810e560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28e8002780 tx=0x7f28e8009e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:28:04.265 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28dffff700 1 -- 172.21.15.112:0/2524327619 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80092e0 con 0x7f28f80f7c80 2021-10-08T19:28:04.265 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28dffff700 1 -- 172.21.15.112:0/2524327619 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f28e800f040 con 0x7f28f80f7c80 2021-10-08T19:28:04.266 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28dffff700 1 -- 172.21.15.112:0/2524327619 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8013700 con 0x7f28f80f7c80 2021-10-08T19:28:04.266 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.254+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f0009640 con 0x7f28f80f7c80 2021-10-08T19:28:04.268 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.255+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f8115360 con 0x7f28f80f7c80 2021-10-08T19:28:04.268 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.255+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f806fe30 con 0x7f28f80f7c80 2021-10-08T19:28:04.268 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.256+0000 7f28dffff700 1 -- 172.21.15.112:0/2524327619 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f28e801a030 con 0x7f28f80f7c80 2021-10-08T19:28:04.268 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.256+0000 7f28dffff700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f28e00635e0 0x7f28e0065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.256+0000 7f28dffff700 1 -- 172.21.15.112:0/2524327619 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7f28e807f520 con 0x7f28f80f7c80 2021-10-08T19:28:04.269 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.256+0000 7f28f6ffd700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f28e00635e0 0x7f28e0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:04.270 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.257+0000 7f28f6ffd700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f28e00635e0 0x7f28e0065a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28f8109e00 tx=0x7f28ec00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:28:04.271 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.260+0000 7f28dffff700 1 -- 172.21.15.112:0/2524327619 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f28e8047b00 con 0x7f28f80f7c80 2021-10-08T19:28:04.307 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:04.151Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-10-08T19:28:04.307 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:04.151Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-10-08T19:28:04.308 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:04.152Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.112 port=9094 2021-10-08T19:28:04.308 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:04.153Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-10-08T19:28:04.308 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:04.178Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:28:04.308 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:04.178Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-10-08T19:28:04.309 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:04.181Z caller=main.go:497 msg=Listening address=:9093 2021-10-08T19:28:04.309 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 bash[80953]: d8336f7c1087cfdfccf9736f952b60609acde06e989f41fe1ebb2a65d88f25da 2021-10-08T19:28:04.423 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.421+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 --> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28f8047360 con 0x7f28e00635e0 2021-10-08T19:28:04.427 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-10-08T19:28:04.427 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-10-08T19:28:04.428 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-10-08T19:28:04.428 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-10-08T19:28:04.428 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-10-08T19:28:04.434 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.432+0000 7f28dffff700 1 -- 172.21.15.112:0/2524327619 <== mgr.14532 v2:172.21.15.112:6800/471677461 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359452 (secure 0 0 0) 0x7f28f8047360 con 0x7f28e00635e0 2021-10-08T19:28:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:28:04.442 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f28e00635e0 msgr2=0x7f28e0065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:04.442 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f28e00635e0 0x7f28e0065a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28f8109e00 tx=0x7f28ec00b040 comp rx=0 tx=0).stop 2021-10-08T19:28:04.442 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 msgr2=0x7f28f810e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:04.442 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 0x7f28f810e560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28e8002780 tx=0x7f28e8009e00 comp rx=0 tx=0).stop 2021-10-08T19:28:04.443 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 shutdown_connections 2021-10-08T19:28:04.443 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f28e00635e0 0x7f28e0065a90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.443 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f80fde50 0x7f28f8108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.443 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28f80f7c80 0x7f28f810e560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 --2- 172.21.15.112:0/2524327619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80fd4b0 0x7f28f810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 >> 172.21.15.112:0/2524327619 conn(0x7f28f806e310 msgr2=0x7f28f8061960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:28:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.435+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 shutdown_connections 2021-10-08T19:28:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:04.436+0000 7f28fc8b4700 1 -- 172.21.15.112:0/2524327619 wait complete. 2021-10-08T19:28:04.444 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2021-10-08T19:28:04.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:04 smithi112 systemd[1]: Started Ceph alertmanager.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:28:04.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:04 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:28:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:04.756 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-10-08T19:28:04.756 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-10-08T19:28:04.757 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-10-08T19:28:04.757 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-10-08T19:28:05.017 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-10-08T19:28:05.017 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-10-08T19:28:05.017 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-10-08T19:28:05.018 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-10-08T19:28:05.018 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:04 smithi142 conmon[65044]: t=2021-10-08T19:28:04+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-10-08T19:28:05.018 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:05 smithi142 conmon[65044]: t=2021-10-08T19:28:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-10-08T19:28:05.275 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:05 smithi142 conmon[65044]: t=2021-10-08T19:28:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-10-08T19:28:05.275 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:05 smithi142 conmon[65044]: t=2021-10-08T19:28:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-10-08T19:28:05.275 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:05 smithi142 conmon[65044]: t=2021-10-08T19:28:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-10-08T19:28:05.353 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2021-10-08T19:28:02.642453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596164,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":1045,"num_read_kb":891,"num_write":607,"num_write_kb":2457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1771544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":594,"ondisk_log_size":594,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":54124,"kb_used_data":7724,"kb_used_omap":0,"kb_used_meta":46336,"kb_avail":749907092,"statfs":{"total":767960285184,"available":767904862208,"internally_reserved":0,"allocated":7909376,"data_stored":4331969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47448064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002931"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135124+0000","last_change":"2021-10-08T19:26:10.034848+0000","last_active":"2021-10-08T19:27:23.135124+0000","last_peered":"2021-10-08T19:27:23.135124+0000","last_clean":"2021-10-08T19:27:23.135124+0000","last_became_active":"2021-10-08T19:26:10.034531+0000","last_became_peered":"2021-10-08T19:26:10.034531+0000","last_unstale":"2021-10-08T19:27:23.135124+0000","last_undegraded":"2021-10-08T19:27:23.135124+0000","last_fullsized":"2021-10-08T19:27:23.135124+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134246+0000","last_change":"2021-10-08T19:26:07.901641+0000","last_active":"2021-10-08T19:27:23.134246+0000","last_peered":"2021-10-08T19:27:23.134246+0000","last_clean":"2021-10-08T19:27:23.134246+0000","last_became_active":"2021-10-08T19:26:07.901370+0000","last_became_peered":"2021-10-08T19:26:07.901370+0000","last_unstale":"2021-10-08T19:27:23.134246+0000","last_undegraded":"2021-10-08T19:27:23.134246+0000","last_fullsized":"2021-10-08T19:27:23.134246+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130341+0000","last_change":"2021-10-08T19:26:03.879023+0000","last_active":"2021-10-08T19:27:23.130341+0000","last_peered":"2021-10-08T19:27:23.130341+0000","last_clean":"2021-10-08T19:27:23.130341+0000","last_became_active":"2021-10-08T19:26:03.878733+0000","last_became_peered":"2021-10-08T19:26:03.878733+0000","last_unstale":"2021-10-08T19:27:23.130341+0000","last_undegraded":"2021-10-08T19:27:23.130341+0000","last_fullsized":"2021-10-08T19:27:23.130341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"66'15","reported_seq":43,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135759+0000","last_change":"2021-10-08T19:26:05.898230+0000","last_active":"2021-10-08T19:27:23.135759+0000","last_peered":"2021-10-08T19:27:23.135759+0000","last_clean":"2021-10-08T19:27:23.135759+0000","last_became_active":"2021-10-08T19:26:05.897279+0000","last_became_peered":"2021-10-08T19:26:05.897279+0000","last_unstale":"2021-10-08T19:27:23.135759+0000","last_undegraded":"2021-10-08T19:27:23.135759+0000","last_fullsized":"2021-10-08T19:27:23.135759+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134336+0000","last_change":"2021-10-08T19:26:09.904300+0000","last_active":"2021-10-08T19:27:23.134336+0000","last_peered":"2021-10-08T19:27:23.134336+0000","last_clean":"2021-10-08T19:27:23.134336+0000","last_became_active":"2021-10-08T19:26:09.903947+0000","last_became_peered":"2021-10-08T19:26:09.903947+0000","last_unstale":"2021-10-08T19:27:23.134336+0000","last_undegraded":"2021-10-08T19:27:23.134336+0000","last_fullsized":"2021-10-08T19:27:23.134336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129176+0000","last_change":"2021-10-08T19:26:07.897609+0000","last_active":"2021-10-08T19:27:23.129176+0000","last_peered":"2021-10-08T19:27:23.129176+0000","last_clean":"2021-10-08T19:27:23.129176+0000","last_became_active":"2021-10-08T19:26:07.897333+0000","last_became_peered":"2021-10-08T19:26:07.897333+0000","last_unstale":"2021-10-08T19:27:23.129176+0000","last_undegraded":"2021-10-08T19:27:23.129176+0000","last_fullsized":"2021-10-08T19:27:23.129176+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136276+0000","last_change":"2021-10-08T19:26:03.877871+0000","last_active":"2021-10-08T19:27:23.136276+0000","last_peered":"2021-10-08T19:27:23.136276+0000","last_clean":"2021-10-08T19:27:23.136276+0000","last_became_active":"2021-10-08T19:26:03.877577+0000","last_became_peered":"2021-10-08T19:26:03.877577+0000","last_unstale":"2021-10-08T19:27:23.136276+0000","last_undegraded":"2021-10-08T19:27:23.136276+0000","last_fullsized":"2021-10-08T19:27:23.136276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"66'9","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:24.485283+0000","last_change":"2021-10-08T19:27:24.485283+0000","last_active":"2021-10-08T19:27:24.485283+0000","last_peered":"2021-10-08T19:27:24.485283+0000","last_clean":"2021-10-08T19:27:24.485283+0000","last_became_active":"2021-10-08T19:27:24.138369+0000","last_became_peered":"2021-10-08T19:27:24.138369+0000","last_unstale":"2021-10-08T19:27:24.485283+0000","last_undegraded":"2021-10-08T19:27:24.485283+0000","last_fullsized":"2021-10-08T19:27:24.485283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"66'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132557+0000","last_change":"2021-10-08T19:26:09.909495+0000","last_active":"2021-10-08T19:27:23.132557+0000","last_peered":"2021-10-08T19:27:23.132557+0000","last_clean":"2021-10-08T19:27:23.132557+0000","last_became_active":"2021-10-08T19:26:09.909192+0000","last_became_peered":"2021-10-08T19:26:09.909192+0000","last_unstale":"2021-10-08T19:27:23.132557+0000","last_undegraded":"2021-10-08T19:27:23.132557+0000","last_fullsized":"2021-10-08T19:27:23.132557+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136982+0000","last_change":"2021-10-08T19:26:07.902637+0000","last_active":"2021-10-08T19:27:23.136982+0000","last_peered":"2021-10-08T19:27:23.136982+0000","last_clean":"2021-10-08T19:27:23.136982+0000","last_became_active":"2021-10-08T19:26:07.902328+0000","last_became_peered":"2021-10-08T19:26:07.902328+0000","last_unstale":"2021-10-08T19:27:23.136982+0000","last_undegraded":"2021-10-08T19:27:23.136982+0000","last_fullsized":"2021-10-08T19:27:23.136982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:24.138442+0000","last_change":"2021-10-08T19:27:24.138442+0000","last_active":"2021-10-08T19:27:24.138442+0000","last_peered":"2021-10-08T19:27:24.138442+0000","last_clean":"2021-10-08T19:27:24.138442+0000","last_became_active":"2021-10-08T19:27:24.138089+0000","last_became_peered":"2021-10-08T19:27:24.138089+0000","last_unstale":"2021-10-08T19:27:24.138442+0000","last_undegraded":"2021-10-08T19:27:24.138442+0000","last_fullsized":"2021-10-08T19:27:24.138442+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"66'5","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134496+0000","last_change":"2021-10-08T19:26:05.893169+0000","last_active":"2021-10-08T19:27:23.134496+0000","last_peered":"2021-10-08T19:27:23.134496+0000","last_clean":"2021-10-08T19:27:23.134496+0000","last_became_active":"2021-10-08T19:26:05.892899+0000","last_became_peered":"2021-10-08T19:26:05.892899+0000","last_unstale":"2021-10-08T19:27:23.134496+0000","last_undegraded":"2021-10-08T19:27:23.134496+0000","last_fullsized":"2021-10-08T19:27:23.134496+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129125+0000","last_change":"2021-10-08T19:26:09.907391+0000","last_active":"2021-10-08T19:27:23.129125+0000","last_peered":"2021-10-08T19:27:23.129125+0000","last_clean":"2021-10-08T19:27:23.129125+0000","last_became_active":"2021-10-08T19:26:09.907070+0000","last_became_peered":"2021-10-08T19:26:09.907070+0000","last_unstale":"2021-10-08T19:27:23.129125+0000","last_undegraded":"2021-10-08T19:27:23.129125+0000","last_fullsized":"2021-10-08T19:27:23.129125+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132794+0000","last_change":"2021-10-08T19:26:07.893185+0000","last_active":"2021-10-08T19:27:23.132794+0000","last_peered":"2021-10-08T19:27:23.132794+0000","last_clean":"2021-10-08T19:27:23.132794+0000","last_became_active":"2021-10-08T19:26:07.892961+0000","last_became_peered":"2021-10-08T19:26:07.892961+0000","last_unstale":"2021-10-08T19:27:23.132794+0000","last_undegraded":"2021-10-08T19:27:23.132794+0000","last_fullsized":"2021-10-08T19:27:23.132794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136752+0000","last_change":"2021-10-08T19:26:03.888590+0000","last_active":"2021-10-08T19:27:23.136752+0000","last_peered":"2021-10-08T19:27:23.136752+0000","last_clean":"2021-10-08T19:27:23.136752+0000","last_became_active":"2021-10-08T19:26:03.888171+0000","last_became_peered":"2021-10-08T19:26:03.888171+0000","last_unstale":"2021-10-08T19:27:23.136752+0000","last_undegraded":"2021-10-08T19:27:23.136752+0000","last_fullsized":"2021-10-08T19:27:23.136752+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134597+0000","last_change":"2021-10-08T19:26:05.898274+0000","last_active":"2021-10-08T19:27:23.134597+0000","last_peered":"2021-10-08T19:27:23.134597+0000","last_clean":"2021-10-08T19:27:23.134597+0000","last_became_active":"2021-10-08T19:26:05.897976+0000","last_became_peered":"2021-10-08T19:26:05.897976+0000","last_unstale":"2021-10-08T19:27:23.134597+0000","last_undegraded":"2021-10-08T19:27:23.134597+0000","last_fullsized":"2021-10-08T19:27:23.134597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136289+0000","last_change":"2021-10-08T19:26:10.033219+0000","last_active":"2021-10-08T19:27:23.136289+0000","last_peered":"2021-10-08T19:27:23.136289+0000","last_clean":"2021-10-08T19:27:23.136289+0000","last_became_active":"2021-10-08T19:26:10.032877+0000","last_became_peered":"2021-10-08T19:26:10.032877+0000","last_unstale":"2021-10-08T19:27:23.136289+0000","last_undegraded":"2021-10-08T19:27:23.136289+0000","last_fullsized":"2021-10-08T19:27:23.136289+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135274+0000","last_change":"2021-10-08T19:26:07.896829+0000","last_active":"2021-10-08T19:27:23.135274+0000","last_peered":"2021-10-08T19:27:23.135274+0000","last_clean":"2021-10-08T19:27:23.135274+0000","last_became_active":"2021-10-08T19:26:07.896524+0000","last_became_peered":"2021-10-08T19:26:07.896524+0000","last_unstale":"2021-10-08T19:27:23.135274+0000","last_undegraded":"2021-10-08T19:27:23.135274+0000","last_fullsized":"2021-10-08T19:27:23.135274+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135256+0000","last_change":"2021-10-08T19:26:03.882005+0000","last_active":"2021-10-08T19:27:23.135256+0000","last_peered":"2021-10-08T19:27:23.135256+0000","last_clean":"2021-10-08T19:27:23.135256+0000","last_became_active":"2021-10-08T19:26:03.881714+0000","last_became_peered":"2021-10-08T19:26:03.881714+0000","last_unstale":"2021-10-08T19:27:23.135256+0000","last_undegraded":"2021-10-08T19:27:23.135256+0000","last_fullsized":"2021-10-08T19:27:23.135256+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"66'12","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:24.568448+0000","last_change":"2021-10-08T19:27:24.568448+0000","last_active":"2021-10-08T19:27:24.568448+0000","last_peered":"2021-10-08T19:27:24.568448+0000","last_clean":"2021-10-08T19:27:24.568448+0000","last_became_active":"2021-10-08T19:27:24.137083+0000","last_became_peered":"2021-10-08T19:27:24.137083+0000","last_unstale":"2021-10-08T19:27:24.568448+0000","last_undegraded":"2021-10-08T19:27:24.568448+0000","last_fullsized":"2021-10-08T19:27:24.568448+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136561+0000","last_change":"2021-10-08T19:26:10.032782+0000","last_active":"2021-10-08T19:27:23.136561+0000","last_peered":"2021-10-08T19:27:23.136561+0000","last_clean":"2021-10-08T19:27:23.136561+0000","last_became_active":"2021-10-08T19:26:10.032533+0000","last_became_peered":"2021-10-08T19:26:10.032533+0000","last_unstale":"2021-10-08T19:27:23.136561+0000","last_undegraded":"2021-10-08T19:27:23.136561+0000","last_fullsized":"2021-10-08T19:27:23.136561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.131817+0000","last_change":"2021-10-08T19:26:07.891601+0000","last_active":"2021-10-08T19:27:23.131817+0000","last_peered":"2021-10-08T19:27:23.131817+0000","last_clean":"2021-10-08T19:27:23.131817+0000","last_became_active":"2021-10-08T19:26:07.891289+0000","last_became_peered":"2021-10-08T19:26:07.891289+0000","last_unstale":"2021-10-08T19:27:23.131817+0000","last_undegraded":"2021-10-08T19:27:23.131817+0000","last_fullsized":"2021-10-08T19:27:23.131817+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137976+0000","last_change":"2021-10-08T19:26:03.890877+0000","last_active":"2021-10-08T19:27:23.137976+0000","last_peered":"2021-10-08T19:27:23.137976+0000","last_clean":"2021-10-08T19:27:23.137976+0000","last_became_active":"2021-10-08T19:26:03.890602+0000","last_became_peered":"2021-10-08T19:26:03.890602+0000","last_unstale":"2021-10-08T19:27:23.137976+0000","last_undegraded":"2021-10-08T19:27:23.137976+0000","last_fullsized":"2021-10-08T19:27:23.137976+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"66'15","reported_seq":43,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132864+0000","last_change":"2021-10-08T19:26:05.898226+0000","last_active":"2021-10-08T19:27:23.132864+0000","last_peered":"2021-10-08T19:27:23.132864+0000","last_clean":"2021-10-08T19:27:23.132864+0000","last_became_active":"2021-10-08T19:26:05.897942+0000","last_became_peered":"2021-10-08T19:26:05.897942+0000","last_unstale":"2021-10-08T19:27:23.132864+0000","last_undegraded":"2021-10-08T19:27:23.132864+0000","last_fullsized":"2021-10-08T19:27:23.132864+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130670+0000","last_change":"2021-10-08T19:26:09.903686+0000","last_active":"2021-10-08T19:27:23.130670+0000","last_peered":"2021-10-08T19:27:23.130670+0000","last_clean":"2021-10-08T19:27:23.130670+0000","last_became_active":"2021-10-08T19:26:09.903368+0000","last_became_peered":"2021-10-08T19:26:09.903368+0000","last_unstale":"2021-10-08T19:27:23.130670+0000","last_undegraded":"2021-10-08T19:27:23.130670+0000","last_fullsized":"2021-10-08T19:27:23.130670+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129605+0000","last_change":"2021-10-08T19:26:07.895240+0000","last_active":"2021-10-08T19:27:23.129605+0000","last_peered":"2021-10-08T19:27:23.129605+0000","last_clean":"2021-10-08T19:27:23.129605+0000","last_became_active":"2021-10-08T19:26:07.894919+0000","last_became_peered":"2021-10-08T19:26:07.894919+0000","last_unstale":"2021-10-08T19:27:23.129605+0000","last_undegraded":"2021-10-08T19:27:23.129605+0000","last_fullsized":"2021-10-08T19:27:23.129605+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135354+0000","last_change":"2021-10-08T19:26:03.880568+0000","last_active":"2021-10-08T19:27:23.135354+0000","last_peered":"2021-10-08T19:27:23.135354+0000","last_clean":"2021-10-08T19:27:23.135354+0000","last_became_active":"2021-10-08T19:26:03.880315+0000","last_became_peered":"2021-10-08T19:26:03.880315+0000","last_unstale":"2021-10-08T19:27:23.135354+0000","last_undegraded":"2021-10-08T19:27:23.135354+0000","last_fullsized":"2021-10-08T19:27:23.135354+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"66'11","reported_seq":58,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:24.574076+0000","last_change":"2021-10-08T19:27:24.574076+0000","last_active":"2021-10-08T19:27:24.574076+0000","last_peered":"2021-10-08T19:27:24.574076+0000","last_clean":"2021-10-08T19:27:24.574076+0000","last_became_active":"2021-10-08T19:27:24.140145+0000","last_became_peered":"2021-10-08T19:27:24.140145+0000","last_unstale":"2021-10-08T19:27:24.574076+0000","last_undegraded":"2021-10-08T19:27:24.574076+0000","last_fullsized":"2021-10-08T19:27:24.574076+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137336+0000","last_change":"2021-10-08T19:26:09.902640+0000","last_active":"2021-10-08T19:27:23.137336+0000","last_peered":"2021-10-08T19:27:23.137336+0000","last_clean":"2021-10-08T19:27:23.137336+0000","last_became_active":"2021-10-08T19:26:09.902355+0000","last_became_peered":"2021-10-08T19:26:09.902355+0000","last_unstale":"2021-10-08T19:27:23.137336+0000","last_undegraded":"2021-10-08T19:27:23.137336+0000","last_fullsized":"2021-10-08T19:27:23.137336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"66'8","reported_seq":50,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961389+0000","last_change":"2021-10-08T19:26:07.900501+0000","last_active":"2021-10-08T19:27:51.961389+0000","last_peered":"2021-10-08T19:27:51.961389+0000","last_clean":"2021-10-08T19:27:51.961389+0000","last_became_active":"2021-10-08T19:26:07.899641+0000","last_became_peered":"2021-10-08T19:26:07.899641+0000","last_unstale":"2021-10-08T19:27:51.961389+0000","last_undegraded":"2021-10-08T19:27:51.961389+0000","last_fullsized":"2021-10-08T19:27:51.961389+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132495+0000","last_change":"2021-10-08T19:26:03.887011+0000","last_active":"2021-10-08T19:27:23.132495+0000","last_peered":"2021-10-08T19:27:23.132495+0000","last_clean":"2021-10-08T19:27:23.132495+0000","last_became_active":"2021-10-08T19:26:03.886613+0000","last_became_peered":"2021-10-08T19:26:03.886613+0000","last_unstale":"2021-10-08T19:27:23.132495+0000","last_undegraded":"2021-10-08T19:27:23.132495+0000","last_fullsized":"2021-10-08T19:27:23.132495+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"66'10","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129567+0000","last_change":"2021-10-08T19:26:05.910273+0000","last_active":"2021-10-08T19:27:23.129567+0000","last_peered":"2021-10-08T19:27:23.129567+0000","last_clean":"2021-10-08T19:27:23.129567+0000","last_became_active":"2021-10-08T19:26:05.910087+0000","last_became_peered":"2021-10-08T19:26:05.910087+0000","last_unstale":"2021-10-08T19:27:23.129567+0000","last_undegraded":"2021-10-08T19:27:23.129567+0000","last_fullsized":"2021-10-08T19:27:23.129567+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135446+0000","last_change":"2021-10-08T19:26:10.034836+0000","last_active":"2021-10-08T19:27:23.135446+0000","last_peered":"2021-10-08T19:27:23.135446+0000","last_clean":"2021-10-08T19:27:23.135446+0000","last_became_active":"2021-10-08T19:26:10.034534+0000","last_became_peered":"2021-10-08T19:26:10.034534+0000","last_unstale":"2021-10-08T19:27:23.135446+0000","last_undegraded":"2021-10-08T19:27:23.135446+0000","last_fullsized":"2021-10-08T19:27:23.135446+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136630+0000","last_change":"2021-10-08T19:26:07.902664+0000","last_active":"2021-10-08T19:27:23.136630+0000","last_peered":"2021-10-08T19:27:23.136630+0000","last_clean":"2021-10-08T19:27:23.136630+0000","last_became_active":"2021-10-08T19:26:07.902357+0000","last_became_peered":"2021-10-08T19:26:07.902357+0000","last_unstale":"2021-10-08T19:27:23.136630+0000","last_undegraded":"2021-10-08T19:27:23.136630+0000","last_fullsized":"2021-10-08T19:27:23.136630+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.138400+0000","last_change":"2021-10-08T19:26:03.887617+0000","last_active":"2021-10-08T19:27:23.138400+0000","last_peered":"2021-10-08T19:27:23.138400+0000","last_clean":"2021-10-08T19:27:23.138400+0000","last_became_active":"2021-10-08T19:26:03.887363+0000","last_became_peered":"2021-10-08T19:26:03.887363+0000","last_unstale":"2021-10-08T19:27:23.138400+0000","last_undegraded":"2021-10-08T19:27:23.138400+0000","last_fullsized":"2021-10-08T19:27:23.138400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"66'11","reported_seq":37,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135671+0000","last_change":"2021-10-08T19:26:05.911795+0000","last_active":"2021-10-08T19:27:23.135671+0000","last_peered":"2021-10-08T19:27:23.135671+0000","last_clean":"2021-10-08T19:27:23.135671+0000","last_became_active":"2021-10-08T19:26:05.911564+0000","last_became_peered":"2021-10-08T19:26:05.911564+0000","last_unstale":"2021-10-08T19:27:23.135671+0000","last_undegraded":"2021-10-08T19:27:23.135671+0000","last_fullsized":"2021-10-08T19:27:23.135671+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136726+0000","last_change":"2021-10-08T19:26:09.905671+0000","last_active":"2021-10-08T19:27:23.136726+0000","last_peered":"2021-10-08T19:27:23.136726+0000","last_clean":"2021-10-08T19:27:23.136726+0000","last_became_active":"2021-10-08T19:26:09.905343+0000","last_became_peered":"2021-10-08T19:26:09.905343+0000","last_unstale":"2021-10-08T19:27:23.136726+0000","last_undegraded":"2021-10-08T19:27:23.136726+0000","last_fullsized":"2021-10-08T19:27:23.136726+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135223+0000","last_change":"2021-10-08T19:26:07.899987+0000","last_active":"2021-10-08T19:27:23.135223+0000","last_peered":"2021-10-08T19:27:23.135223+0000","last_clean":"2021-10-08T19:27:23.135223+0000","last_became_active":"2021-10-08T19:26:07.899615+0000","last_became_peered":"2021-10-08T19:26:07.899615+0000","last_unstale":"2021-10-08T19:27:23.135223+0000","last_undegraded":"2021-10-08T19:27:23.135223+0000","last_fullsized":"2021-10-08T19:27:23.135223+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133208+0000","last_change":"2021-10-08T19:26:03.887303+0000","last_active":"2021-10-08T19:27:23.133208+0000","last_peered":"2021-10-08T19:27:23.133208+0000","last_clean":"2021-10-08T19:27:23.133208+0000","last_became_active":"2021-10-08T19:26:03.887040+0000","last_became_peered":"2021-10-08T19:26:03.887040+0000","last_unstale":"2021-10-08T19:27:23.133208+0000","last_undegraded":"2021-10-08T19:27:23.133208+0000","last_fullsized":"2021-10-08T19:27:23.133208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"66'4","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135076+0000","last_change":"2021-10-08T19:26:05.901072+0000","last_active":"2021-10-08T19:27:23.135076+0000","last_peered":"2021-10-08T19:27:23.135076+0000","last_clean":"2021-10-08T19:27:23.135076+0000","last_became_active":"2021-10-08T19:26:05.900863+0000","last_became_peered":"2021-10-08T19:26:05.900863+0000","last_unstale":"2021-10-08T19:27:23.135076+0000","last_undegraded":"2021-10-08T19:27:23.135076+0000","last_fullsized":"2021-10-08T19:27:23.135076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135211+0000","last_change":"2021-10-08T19:26:09.908606+0000","last_active":"2021-10-08T19:27:23.135211+0000","last_peered":"2021-10-08T19:27:23.135211+0000","last_clean":"2021-10-08T19:27:23.135211+0000","last_became_active":"2021-10-08T19:26:09.908280+0000","last_became_peered":"2021-10-08T19:26:09.908280+0000","last_unstale":"2021-10-08T19:27:23.135211+0000","last_undegraded":"2021-10-08T19:27:23.135211+0000","last_fullsized":"2021-10-08T19:27:23.135211+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129884+0000","last_change":"2021-10-08T19:26:07.897604+0000","last_active":"2021-10-08T19:27:23.129884+0000","last_peered":"2021-10-08T19:27:23.129884+0000","last_clean":"2021-10-08T19:27:23.129884+0000","last_became_active":"2021-10-08T19:26:07.897291+0000","last_became_peered":"2021-10-08T19:26:07.897291+0000","last_unstale":"2021-10-08T19:27:23.129884+0000","last_undegraded":"2021-10-08T19:27:23.129884+0000","last_fullsized":"2021-10-08T19:27:23.129884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130790+0000","last_change":"2021-10-08T19:26:03.894683+0000","last_active":"2021-10-08T19:27:23.130790+0000","last_peered":"2021-10-08T19:27:23.130790+0000","last_clean":"2021-10-08T19:27:23.130790+0000","last_became_active":"2021-10-08T19:26:03.894352+0000","last_became_peered":"2021-10-08T19:26:03.894352+0000","last_unstale":"2021-10-08T19:27:23.130790+0000","last_undegraded":"2021-10-08T19:27:23.130790+0000","last_fullsized":"2021-10-08T19:27:23.130790+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'11","reported_seq":37,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135432+0000","last_change":"2021-10-08T19:26:05.887262+0000","last_active":"2021-10-08T19:27:23.135432+0000","last_peered":"2021-10-08T19:27:23.135432+0000","last_clean":"2021-10-08T19:27:23.135432+0000","last_became_active":"2021-10-08T19:26:05.886913+0000","last_became_peered":"2021-10-08T19:26:05.886913+0000","last_unstale":"2021-10-08T19:27:23.135432+0000","last_undegraded":"2021-10-08T19:27:23.135432+0000","last_fullsized":"2021-10-08T19:27:23.135432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.128647+0000","last_change":"2021-10-08T19:26:09.903712+0000","last_active":"2021-10-08T19:27:23.128647+0000","last_peered":"2021-10-08T19:27:23.128647+0000","last_clean":"2021-10-08T19:27:23.128647+0000","last_became_active":"2021-10-08T19:26:09.903130+0000","last_became_peered":"2021-10-08T19:26:09.903130+0000","last_unstale":"2021-10-08T19:27:23.128647+0000","last_undegraded":"2021-10-08T19:27:23.128647+0000","last_fullsized":"2021-10-08T19:27:23.128647+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135335+0000","last_change":"2021-10-08T19:26:07.890038+0000","last_active":"2021-10-08T19:27:23.135335+0000","last_peered":"2021-10-08T19:27:23.135335+0000","last_clean":"2021-10-08T19:27:23.135335+0000","last_became_active":"2021-10-08T19:26:07.889789+0000","last_became_peered":"2021-10-08T19:26:07.889789+0000","last_unstale":"2021-10-08T19:27:23.135335+0000","last_undegraded":"2021-10-08T19:27:23.135335+0000","last_fullsized":"2021-10-08T19:27:23.135335+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135661+0000","last_change":"2021-10-08T19:26:03.887558+0000","last_active":"2021-10-08T19:27:23.135661+0000","last_peered":"2021-10-08T19:27:23.135661+0000","last_clean":"2021-10-08T19:27:23.135661+0000","last_became_active":"2021-10-08T19:26:03.887234+0000","last_became_peered":"2021-10-08T19:26:03.887234+0000","last_unstale":"2021-10-08T19:27:23.135661+0000","last_undegraded":"2021-10-08T19:27:23.135661+0000","last_fullsized":"2021-10-08T19:27:23.135661+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129741+0000","last_change":"2021-10-08T19:26:05.890793+0000","last_active":"2021-10-08T19:27:23.129741+0000","last_peered":"2021-10-08T19:27:23.129741+0000","last_clean":"2021-10-08T19:27:23.129741+0000","last_became_active":"2021-10-08T19:26:05.890457+0000","last_became_peered":"2021-10-08T19:26:05.890457+0000","last_unstale":"2021-10-08T19:27:23.129741+0000","last_undegraded":"2021-10-08T19:27:23.129741+0000","last_fullsized":"2021-10-08T19:27:23.129741+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136077+0000","last_change":"2021-10-08T19:26:09.903811+0000","last_active":"2021-10-08T19:27:23.136077+0000","last_peered":"2021-10-08T19:27:23.136077+0000","last_clean":"2021-10-08T19:27:23.136077+0000","last_became_active":"2021-10-08T19:26:09.902730+0000","last_became_peered":"2021-10-08T19:26:09.902730+0000","last_unstale":"2021-10-08T19:27:23.136077+0000","last_undegraded":"2021-10-08T19:27:23.136077+0000","last_fullsized":"2021-10-08T19:27:23.136077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961103+0000","last_change":"2021-10-08T19:26:07.894331+0000","last_active":"2021-10-08T19:27:51.961103+0000","last_peered":"2021-10-08T19:27:51.961103+0000","last_clean":"2021-10-08T19:27:51.961103+0000","last_became_active":"2021-10-08T19:26:07.894034+0000","last_became_peered":"2021-10-08T19:26:07.894034+0000","last_unstale":"2021-10-08T19:27:51.961103+0000","last_undegraded":"2021-10-08T19:27:51.961103+0000","last_fullsized":"2021-10-08T19:27:51.961103+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130728+0000","last_change":"2021-10-08T19:26:03.878269+0000","last_active":"2021-10-08T19:27:23.130728+0000","last_peered":"2021-10-08T19:27:23.130728+0000","last_clean":"2021-10-08T19:27:23.130728+0000","last_became_active":"2021-10-08T19:26:03.878002+0000","last_became_peered":"2021-10-08T19:26:03.878002+0000","last_unstale":"2021-10-08T19:27:23.130728+0000","last_undegraded":"2021-10-08T19:27:23.130728+0000","last_fullsized":"2021-10-08T19:27:23.130728+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133126+0000","last_change":"2021-10-08T19:26:05.908668+0000","last_active":"2021-10-08T19:27:23.133126+0000","last_peered":"2021-10-08T19:27:23.133126+0000","last_clean":"2021-10-08T19:27:23.133126+0000","last_became_active":"2021-10-08T19:26:05.908363+0000","last_became_peered":"2021-10-08T19:26:05.908363+0000","last_unstale":"2021-10-08T19:27:23.133126+0000","last_undegraded":"2021-10-08T19:27:23.133126+0000","last_fullsized":"2021-10-08T19:27:23.133126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129330+0000","last_change":"2021-10-08T19:26:09.906423+0000","last_active":"2021-10-08T19:27:23.129330+0000","last_peered":"2021-10-08T19:27:23.129330+0000","last_clean":"2021-10-08T19:27:23.129330+0000","last_became_active":"2021-10-08T19:26:09.906117+0000","last_became_peered":"2021-10-08T19:26:09.906117+0000","last_unstale":"2021-10-08T19:27:23.129330+0000","last_undegraded":"2021-10-08T19:27:23.129330+0000","last_fullsized":"2021-10-08T19:27:23.129330+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961485+0000","last_change":"2021-10-08T19:26:07.895413+0000","last_active":"2021-10-08T19:27:51.961485+0000","last_peered":"2021-10-08T19:27:51.961485+0000","last_clean":"2021-10-08T19:27:51.961485+0000","last_became_active":"2021-10-08T19:26:07.894969+0000","last_became_peered":"2021-10-08T19:26:07.894969+0000","last_unstale":"2021-10-08T19:27:51.961485+0000","last_undegraded":"2021-10-08T19:27:51.961485+0000","last_fullsized":"2021-10-08T19:27:51.961485+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132692+0000","last_change":"2021-10-08T19:26:03.885303+0000","last_active":"2021-10-08T19:27:23.132692+0000","last_peered":"2021-10-08T19:27:23.132692+0000","last_clean":"2021-10-08T19:27:23.132692+0000","last_became_active":"2021-10-08T19:26:03.884768+0000","last_became_peered":"2021-10-08T19:26:03.884768+0000","last_unstale":"2021-10-08T19:27:23.132692+0000","last_undegraded":"2021-10-08T19:27:23.132692+0000","last_fullsized":"2021-10-08T19:27:23.132692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"66'10","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136058+0000","last_change":"2021-10-08T19:26:05.911070+0000","last_active":"2021-10-08T19:27:23.136058+0000","last_peered":"2021-10-08T19:27:23.136058+0000","last_clean":"2021-10-08T19:27:23.136058+0000","last_became_active":"2021-10-08T19:26:05.910852+0000","last_became_peered":"2021-10-08T19:26:05.910852+0000","last_unstale":"2021-10-08T19:27:23.136058+0000","last_undegraded":"2021-10-08T19:27:23.136058+0000","last_fullsized":"2021-10-08T19:27:23.136058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136951+0000","last_change":"2021-10-08T19:26:10.034573+0000","last_active":"2021-10-08T19:27:23.136951+0000","last_peered":"2021-10-08T19:27:23.136951+0000","last_clean":"2021-10-08T19:27:23.136951+0000","last_became_active":"2021-10-08T19:26:10.034291+0000","last_became_peered":"2021-10-08T19:26:10.034291+0000","last_unstale":"2021-10-08T19:27:23.136951+0000","last_undegraded":"2021-10-08T19:27:23.136951+0000","last_fullsized":"2021-10-08T19:27:23.136951+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133166+0000","last_change":"2021-10-08T19:26:07.895711+0000","last_active":"2021-10-08T19:27:23.133166+0000","last_peered":"2021-10-08T19:27:23.133166+0000","last_clean":"2021-10-08T19:27:23.133166+0000","last_became_active":"2021-10-08T19:26:07.895160+0000","last_became_peered":"2021-10-08T19:26:07.895160+0000","last_unstale":"2021-10-08T19:27:23.133166+0000","last_undegraded":"2021-10-08T19:27:23.133166+0000","last_fullsized":"2021-10-08T19:27:23.133166+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135308+0000","last_change":"2021-10-08T19:26:03.891822+0000","last_active":"2021-10-08T19:27:23.135308+0000","last_peered":"2021-10-08T19:27:23.135308+0000","last_clean":"2021-10-08T19:27:23.135308+0000","last_became_active":"2021-10-08T19:26:03.891524+0000","last_became_peered":"2021-10-08T19:26:03.891524+0000","last_unstale":"2021-10-08T19:27:23.135308+0000","last_undegraded":"2021-10-08T19:27:23.135308+0000","last_fullsized":"2021-10-08T19:27:23.135308+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"66'6","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136239+0000","last_change":"2021-10-08T19:26:05.911264+0000","last_active":"2021-10-08T19:27:23.136239+0000","last_peered":"2021-10-08T19:27:23.136239+0000","last_clean":"2021-10-08T19:27:23.136239+0000","last_became_active":"2021-10-08T19:26:05.910975+0000","last_became_peered":"2021-10-08T19:26:05.910975+0000","last_unstale":"2021-10-08T19:27:23.136239+0000","last_undegraded":"2021-10-08T19:27:23.136239+0000","last_fullsized":"2021-10-08T19:27:23.136239+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132390+0000","last_change":"2021-10-08T19:26:09.906398+0000","last_active":"2021-10-08T19:27:23.132390+0000","last_peered":"2021-10-08T19:27:23.132390+0000","last_clean":"2021-10-08T19:27:23.132390+0000","last_became_active":"2021-10-08T19:26:09.904737+0000","last_became_peered":"2021-10-08T19:26:09.904737+0000","last_unstale":"2021-10-08T19:27:23.132390+0000","last_undegraded":"2021-10-08T19:27:23.132390+0000","last_fullsized":"2021-10-08T19:27:23.132390+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136333+0000","last_change":"2021-10-08T19:26:07.891864+0000","last_active":"2021-10-08T19:27:23.136333+0000","last_peered":"2021-10-08T19:27:23.136333+0000","last_clean":"2021-10-08T19:27:23.136333+0000","last_became_active":"2021-10-08T19:26:07.891533+0000","last_became_peered":"2021-10-08T19:26:07.891533+0000","last_unstale":"2021-10-08T19:27:23.136333+0000","last_undegraded":"2021-10-08T19:27:23.136333+0000","last_fullsized":"2021-10-08T19:27:23.136333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133109+0000","last_change":"2021-10-08T19:26:03.884069+0000","last_active":"2021-10-08T19:27:23.133109+0000","last_peered":"2021-10-08T19:27:23.133109+0000","last_clean":"2021-10-08T19:27:23.133109+0000","last_became_active":"2021-10-08T19:26:03.883753+0000","last_became_peered":"2021-10-08T19:26:03.883753+0000","last_unstale":"2021-10-08T19:27:23.133109+0000","last_undegraded":"2021-10-08T19:27:23.133109+0000","last_fullsized":"2021-10-08T19:27:23.133109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129464+0000","last_change":"2021-10-08T19:26:05.910425+0000","last_active":"2021-10-08T19:27:23.129464+0000","last_peered":"2021-10-08T19:27:23.129464+0000","last_clean":"2021-10-08T19:27:23.129464+0000","last_became_active":"2021-10-08T19:26:05.910134+0000","last_became_peered":"2021-10-08T19:26:05.910134+0000","last_unstale":"2021-10-08T19:27:23.129464+0000","last_undegraded":"2021-10-08T19:27:23.129464+0000","last_fullsized":"2021-10-08T19:27:23.129464+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135398+0000","last_change":"2021-10-08T19:26:09.908294+0000","last_active":"2021-10-08T19:27:23.135398+0000","last_peered":"2021-10-08T19:27:23.135398+0000","last_clean":"2021-10-08T19:27:23.135398+0000","last_became_active":"2021-10-08T19:26:09.907996+0000","last_became_peered":"2021-10-08T19:26:09.907996+0000","last_unstale":"2021-10-08T19:27:23.135398+0000","last_undegraded":"2021-10-08T19:27:23.135398+0000","last_fullsized":"2021-10-08T19:27:23.135398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"58'2","reported_seq":36,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135882+0000","last_change":"2021-10-08T19:26:03.879079+0000","last_active":"2021-10-08T19:27:23.135882+0000","last_peered":"2021-10-08T19:27:23.135882+0000","last_clean":"2021-10-08T19:27:23.135882+0000","last_became_active":"2021-10-08T19:26:03.878782+0000","last_became_peered":"2021-10-08T19:26:03.878782+0000","last_unstale":"2021-10-08T19:27:23.135882+0000","last_undegraded":"2021-10-08T19:27:23.135882+0000","last_fullsized":"2021-10-08T19:27:23.135882+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"66'12","reported_seq":41,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134876+0000","last_change":"2021-10-08T19:26:05.898379+0000","last_active":"2021-10-08T19:27:23.134876+0000","last_peered":"2021-10-08T19:27:23.134876+0000","last_clean":"2021-10-08T19:27:23.134876+0000","last_became_active":"2021-10-08T19:26:05.898072+0000","last_became_peered":"2021-10-08T19:26:05.898072+0000","last_unstale":"2021-10-08T19:27:23.134876+0000","last_undegraded":"2021-10-08T19:27:23.134876+0000","last_fullsized":"2021-10-08T19:27:23.134876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133065+0000","last_change":"2021-10-08T19:26:07.896897+0000","last_active":"2021-10-08T19:27:23.133065+0000","last_peered":"2021-10-08T19:27:23.133065+0000","last_clean":"2021-10-08T19:27:23.133065+0000","last_became_active":"2021-10-08T19:26:07.896676+0000","last_became_peered":"2021-10-08T19:26:07.896676+0000","last_unstale":"2021-10-08T19:27:23.133065+0000","last_undegraded":"2021-10-08T19:27:23.133065+0000","last_fullsized":"2021-10-08T19:27:23.133065+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.128747+0000","last_change":"2021-10-08T19:26:09.908725+0000","last_active":"2021-10-08T19:27:23.128747+0000","last_peered":"2021-10-08T19:27:23.128747+0000","last_clean":"2021-10-08T19:27:23.128747+0000","last_became_active":"2021-10-08T19:26:09.908405+0000","last_became_peered":"2021-10-08T19:26:09.908405+0000","last_unstale":"2021-10-08T19:27:23.128747+0000","last_undegraded":"2021-10-08T19:27:23.128747+0000","last_fullsized":"2021-10-08T19:27:23.128747+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130466+0000","last_change":"2021-10-08T19:26:03.888663+0000","last_active":"2021-10-08T19:27:23.130466+0000","last_peered":"2021-10-08T19:27:23.130466+0000","last_clean":"2021-10-08T19:27:23.130466+0000","last_became_active":"2021-10-08T19:26:03.888376+0000","last_became_peered":"2021-10-08T19:26:03.888376+0000","last_unstale":"2021-10-08T19:27:23.130466+0000","last_undegraded":"2021-10-08T19:27:23.130466+0000","last_fullsized":"2021-10-08T19:27:23.130466+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"66'10","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129816+0000","last_change":"2021-10-08T19:26:05.889724+0000","last_active":"2021-10-08T19:27:23.129816+0000","last_peered":"2021-10-08T19:27:23.129816+0000","last_clean":"2021-10-08T19:27:23.129816+0000","last_became_active":"2021-10-08T19:26:05.889320+0000","last_became_peered":"2021-10-08T19:26:05.889320+0000","last_unstale":"2021-10-08T19:27:23.129816+0000","last_undegraded":"2021-10-08T19:27:23.129816+0000","last_fullsized":"2021-10-08T19:27:23.129816+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"66'8","reported_seq":50,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961017+0000","last_change":"2021-10-08T19:26:07.892150+0000","last_active":"2021-10-08T19:27:51.961017+0000","last_peered":"2021-10-08T19:27:51.961017+0000","last_clean":"2021-10-08T19:27:51.961017+0000","last_became_active":"2021-10-08T19:26:07.891650+0000","last_became_peered":"2021-10-08T19:26:07.891650+0000","last_unstale":"2021-10-08T19:27:51.961017+0000","last_undegraded":"2021-10-08T19:27:51.961017+0000","last_fullsized":"2021-10-08T19:27:51.961017+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136364+0000","last_change":"2021-10-08T19:26:09.907036+0000","last_active":"2021-10-08T19:27:23.136364+0000","last_peered":"2021-10-08T19:27:23.136364+0000","last_clean":"2021-10-08T19:27:23.136364+0000","last_became_active":"2021-10-08T19:26:09.906695+0000","last_became_peered":"2021-10-08T19:26:09.906695+0000","last_unstale":"2021-10-08T19:27:23.136364+0000","last_undegraded":"2021-10-08T19:27:23.136364+0000","last_fullsized":"2021-10-08T19:27:23.136364+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132786+0000","last_change":"2021-10-08T19:26:03.885188+0000","last_active":"2021-10-08T19:27:23.132786+0000","last_peered":"2021-10-08T19:27:23.132786+0000","last_clean":"2021-10-08T19:27:23.132786+0000","last_became_active":"2021-10-08T19:26:03.883778+0000","last_became_peered":"2021-10-08T19:26:03.883778+0000","last_unstale":"2021-10-08T19:27:23.132786+0000","last_undegraded":"2021-10-08T19:27:23.132786+0000","last_fullsized":"2021-10-08T19:27:23.132786+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"66'28","reported_seq":89,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961045+0000","last_change":"2021-10-08T19:26:05.899759+0000","last_active":"2021-10-08T19:27:51.961045+0000","last_peered":"2021-10-08T19:27:51.961045+0000","last_clean":"2021-10-08T19:27:51.961045+0000","last_became_active":"2021-10-08T19:26:05.899269+0000","last_became_peered":"2021-10-08T19:26:05.899269+0000","last_unstale":"2021-10-08T19:27:51.961045+0000","last_undegraded":"2021-10-08T19:27:51.961045+0000","last_fullsized":"2021-10-08T19:27:51.961045+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130294+0000","last_change":"2021-10-08T19:26:07.899304+0000","last_active":"2021-10-08T19:27:23.130294+0000","last_peered":"2021-10-08T19:27:23.130294+0000","last_clean":"2021-10-08T19:27:23.130294+0000","last_became_active":"2021-10-08T19:26:07.899003+0000","last_became_peered":"2021-10-08T19:26:07.899003+0000","last_unstale":"2021-10-08T19:27:23.130294+0000","last_undegraded":"2021-10-08T19:27:23.130294+0000","last_fullsized":"2021-10-08T19:27:23.130294+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137048+0000","last_change":"2021-10-08T19:26:10.034569+0000","last_active":"2021-10-08T19:27:23.137048+0000","last_peered":"2021-10-08T19:27:23.137048+0000","last_clean":"2021-10-08T19:27:23.137048+0000","last_became_active":"2021-10-08T19:26:10.034137+0000","last_became_peered":"2021-10-08T19:26:10.034137+0000","last_unstale":"2021-10-08T19:27:23.137048+0000","last_undegraded":"2021-10-08T19:27:23.137048+0000","last_fullsized":"2021-10-08T19:27:23.137048+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"66'5","reported_seq":131,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:57.306458+0000","last_change":"2021-10-08T19:26:03.886440+0000","last_active":"2021-10-08T19:27:57.306458+0000","last_peered":"2021-10-08T19:27:57.306458+0000","last_clean":"2021-10-08T19:27:57.306458+0000","last_became_active":"2021-10-08T19:26:03.886152+0000","last_became_peered":"2021-10-08T19:26:03.886152+0000","last_unstale":"2021-10-08T19:27:57.306458+0000","last_undegraded":"2021-10-08T19:27:57.306458+0000","last_fullsized":"2021-10-08T19:27:57.306458+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":103,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132722+0000","last_change":"2021-10-08T19:26:03.876728+0000","last_active":"2021-10-08T19:27:23.132722+0000","last_peered":"2021-10-08T19:27:23.132722+0000","last_clean":"2021-10-08T19:27:23.132722+0000","last_became_active":"2021-10-08T19:26:03.876378+0000","last_became_peered":"2021-10-08T19:26:03.876378+0000","last_unstale":"2021-10-08T19:27:23.132722+0000","last_undegraded":"2021-10-08T19:27:23.132722+0000","last_fullsized":"2021-10-08T19:27:23.132722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"66'13","reported_seq":45,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133620+0000","last_change":"2021-10-08T19:26:05.890969+0000","last_active":"2021-10-08T19:27:23.133620+0000","last_peered":"2021-10-08T19:27:23.133620+0000","last_clean":"2021-10-08T19:27:23.133620+0000","last_became_active":"2021-10-08T19:26:05.890656+0000","last_became_peered":"2021-10-08T19:26:05.890656+0000","last_unstale":"2021-10-08T19:27:23.133620+0000","last_undegraded":"2021-10-08T19:27:23.133620+0000","last_fullsized":"2021-10-08T19:27:23.133620+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133660+0000","last_change":"2021-10-08T19:26:07.897148+0000","last_active":"2021-10-08T19:27:23.133660+0000","last_peered":"2021-10-08T19:27:23.133660+0000","last_clean":"2021-10-08T19:27:23.133660+0000","last_became_active":"2021-10-08T19:26:07.896843+0000","last_became_peered":"2021-10-08T19:26:07.896843+0000","last_unstale":"2021-10-08T19:27:23.133660+0000","last_undegraded":"2021-10-08T19:27:23.133660+0000","last_fullsized":"2021-10-08T19:27:23.133660+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133542+0000","last_change":"2021-10-08T19:26:09.909550+0000","last_active":"2021-10-08T19:27:23.133542+0000","last_peered":"2021-10-08T19:27:23.133542+0000","last_clean":"2021-10-08T19:27:23.133542+0000","last_became_active":"2021-10-08T19:26:09.909241+0000","last_became_peered":"2021-10-08T19:26:09.909241+0000","last_unstale":"2021-10-08T19:27:23.133542+0000","last_undegraded":"2021-10-08T19:27:23.133542+0000","last_fullsized":"2021-10-08T19:27:23.133542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135903+0000","last_change":"2021-10-08T19:26:03.880862+0000","last_active":"2021-10-08T19:27:23.135903+0000","last_peered":"2021-10-08T19:27:23.135903+0000","last_clean":"2021-10-08T19:27:23.135903+0000","last_became_active":"2021-10-08T19:26:03.880338+0000","last_became_peered":"2021-10-08T19:26:03.880338+0000","last_unstale":"2021-10-08T19:27:23.135903+0000","last_undegraded":"2021-10-08T19:27:23.135903+0000","last_fullsized":"2021-10-08T19:27:23.135903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132926+0000","last_change":"2021-10-08T19:26:03.886658+0000","last_active":"2021-10-08T19:27:23.132926+0000","last_peered":"2021-10-08T19:27:23.132926+0000","last_clean":"2021-10-08T19:27:23.132926+0000","last_became_active":"2021-10-08T19:26:03.886359+0000","last_became_peered":"2021-10-08T19:26:03.886359+0000","last_unstale":"2021-10-08T19:27:23.132926+0000","last_undegraded":"2021-10-08T19:27:23.132926+0000","last_fullsized":"2021-10-08T19:27:23.132926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"67'128","reported_seq":268,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136466+0000","last_change":"2021-10-08T19:25:59.227631+0000","last_active":"2021-10-08T19:27:23.136466+0000","last_peered":"2021-10-08T19:27:23.136466+0000","last_clean":"2021-10-08T19:27:23.136466+0000","last_became_active":"2021-10-08T19:25:59.227199+0000","last_became_peered":"2021-10-08T19:25:59.227199+0000","last_unstale":"2021-10-08T19:27:23.136466+0000","last_undegraded":"2021-10-08T19:27:23.136466+0000","last_fullsized":"2021-10-08T19:27:23.136466+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:24:25.035234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:24:25.035234+0000","last_clean_scrub_stamp":"2021-10-08T19:24:25.035234+0000","log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"66'14","reported_seq":40,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137503+0000","last_change":"2021-10-08T19:26:05.909813+0000","last_active":"2021-10-08T19:27:23.137503+0000","last_peered":"2021-10-08T19:27:23.137503+0000","last_clean":"2021-10-08T19:27:23.137503+0000","last_became_active":"2021-10-08T19:26:05.909567+0000","last_became_peered":"2021-10-08T19:26:05.909567+0000","last_unstale":"2021-10-08T19:27:23.137503+0000","last_undegraded":"2021-10-08T19:27:23.137503+0000","last_fullsized":"2021-10-08T19:27:23.137503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137164+0000","last_change":"2021-10-08T19:26:07.897122+0000","last_active":"2021-10-08T19:27:23.137164+0000","last_peered":"2021-10-08T19:27:23.137164+0000","last_clean":"2021-10-08T19:27:23.137164+0000","last_became_active":"2021-10-08T19:26:07.896817+0000","last_became_peered":"2021-10-08T19:26:07.896817+0000","last_unstale":"2021-10-08T19:27:23.137164+0000","last_undegraded":"2021-10-08T19:27:23.137164+0000","last_fullsized":"2021-10-08T19:27:23.137164+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130244+0000","last_change":"2021-10-08T19:26:09.910118+0000","last_active":"2021-10-08T19:27:23.130244+0000","last_peered":"2021-10-08T19:27:23.130244+0000","last_clean":"2021-10-08T19:27:23.130244+0000","last_became_active":"2021-10-08T19:26:09.909724+0000","last_became_peered":"2021-10-08T19:26:09.909724+0000","last_unstale":"2021-10-08T19:27:23.130244+0000","last_undegraded":"2021-10-08T19:27:23.130244+0000","last_fullsized":"2021-10-08T19:27:23.130244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129373+0000","last_change":"2021-10-08T19:26:03.876588+0000","last_active":"2021-10-08T19:27:23.129373+0000","last_peered":"2021-10-08T19:27:23.129373+0000","last_clean":"2021-10-08T19:27:23.129373+0000","last_became_active":"2021-10-08T19:26:03.876291+0000","last_became_peered":"2021-10-08T19:26:03.876291+0000","last_unstale":"2021-10-08T19:27:23.129373+0000","last_undegraded":"2021-10-08T19:27:23.129373+0000","last_fullsized":"2021-10-08T19:27:23.129373+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136409+0000","last_change":"2021-10-08T19:26:03.887313+0000","last_active":"2021-10-08T19:27:23.136409+0000","last_peered":"2021-10-08T19:27:23.136409+0000","last_clean":"2021-10-08T19:27:23.136409+0000","last_became_active":"2021-10-08T19:26:03.886601+0000","last_became_peered":"2021-10-08T19:26:03.886601+0000","last_unstale":"2021-10-08T19:27:23.136409+0000","last_undegraded":"2021-10-08T19:27:23.136409+0000","last_fullsized":"2021-10-08T19:27:23.136409+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"66'12","reported_seq":36,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129410+0000","last_change":"2021-10-08T19:26:05.892611+0000","last_active":"2021-10-08T19:27:23.129410+0000","last_peered":"2021-10-08T19:27:23.129410+0000","last_clean":"2021-10-08T19:27:23.129410+0000","last_became_active":"2021-10-08T19:26:05.892316+0000","last_became_peered":"2021-10-08T19:26:05.892316+0000","last_unstale":"2021-10-08T19:27:23.129410+0000","last_undegraded":"2021-10-08T19:27:23.129410+0000","last_fullsized":"2021-10-08T19:27:23.129410+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133464+0000","last_change":"2021-10-08T19:26:07.895467+0000","last_active":"2021-10-08T19:27:23.133464+0000","last_peered":"2021-10-08T19:27:23.133464+0000","last_clean":"2021-10-08T19:27:23.133464+0000","last_became_active":"2021-10-08T19:26:07.895077+0000","last_became_peered":"2021-10-08T19:26:07.895077+0000","last_unstale":"2021-10-08T19:27:23.133464+0000","last_undegraded":"2021-10-08T19:27:23.133464+0000","last_fullsized":"2021-10-08T19:27:23.133464+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129102+0000","last_change":"2021-10-08T19:26:10.033095+0000","last_active":"2021-10-08T19:27:23.129102+0000","last_peered":"2021-10-08T19:27:23.129102+0000","last_clean":"2021-10-08T19:27:23.129102+0000","last_became_active":"2021-10-08T19:26:10.032695+0000","last_became_peered":"2021-10-08T19:26:10.032695+0000","last_unstale":"2021-10-08T19:27:23.129102+0000","last_undegraded":"2021-10-08T19:27:23.129102+0000","last_fullsized":"2021-10-08T19:27:23.129102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137066+0000","last_change":"2021-10-08T19:26:03.883144+0000","last_active":"2021-10-08T19:27:23.137066+0000","last_peered":"2021-10-08T19:27:23.137066+0000","last_clean":"2021-10-08T19:27:23.137066+0000","last_became_active":"2021-10-08T19:26:03.882646+0000","last_became_peered":"2021-10-08T19:26:03.882646+0000","last_unstale":"2021-10-08T19:27:23.137066+0000","last_undegraded":"2021-10-08T19:27:23.137066+0000","last_fullsized":"2021-10-08T19:27:23.137066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"66'19","reported_seq":54,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130683+0000","last_change":"2021-10-08T19:26:05.908572+0000","last_active":"2021-10-08T19:27:23.130683+0000","last_peered":"2021-10-08T19:27:23.130683+0000","last_clean":"2021-10-08T19:27:23.130683+0000","last_became_active":"2021-10-08T19:26:05.908134+0000","last_became_peered":"2021-10-08T19:26:05.908134+0000","last_unstale":"2021-10-08T19:27:23.130683+0000","last_undegraded":"2021-10-08T19:27:23.130683+0000","last_fullsized":"2021-10-08T19:27:23.130683+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137573+0000","last_change":"2021-10-08T19:26:07.896384+0000","last_active":"2021-10-08T19:27:23.137573+0000","last_peered":"2021-10-08T19:27:23.137573+0000","last_clean":"2021-10-08T19:27:23.137573+0000","last_became_active":"2021-10-08T19:26:07.896045+0000","last_became_peered":"2021-10-08T19:26:07.896045+0000","last_unstale":"2021-10-08T19:27:23.137573+0000","last_undegraded":"2021-10-08T19:27:23.137573+0000","last_fullsized":"2021-10-08T19:27:23.137573+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134911+0000","last_change":"2021-10-08T19:26:09.904441+0000","last_active":"2021-10-08T19:27:23.134911+0000","last_peered":"2021-10-08T19:27:23.134911+0000","last_clean":"2021-10-08T19:27:23.134911+0000","last_became_active":"2021-10-08T19:26:09.904174+0000","last_became_peered":"2021-10-08T19:26:09.904174+0000","last_unstale":"2021-10-08T19:27:23.134911+0000","last_undegraded":"2021-10-08T19:27:23.134911+0000","last_fullsized":"2021-10-08T19:27:23.134911+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.131916+0000","last_change":"2021-10-08T19:26:03.891688+0000","last_active":"2021-10-08T19:27:23.131916+0000","last_peered":"2021-10-08T19:27:23.131916+0000","last_clean":"2021-10-08T19:27:23.131916+0000","last_became_active":"2021-10-08T19:26:03.891405+0000","last_became_peered":"2021-10-08T19:26:03.891405+0000","last_unstale":"2021-10-08T19:27:23.131916+0000","last_undegraded":"2021-10-08T19:27:23.131916+0000","last_fullsized":"2021-10-08T19:27:23.131916+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"66'18","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134998+0000","last_change":"2021-10-08T19:26:05.911204+0000","last_active":"2021-10-08T19:27:23.134998+0000","last_peered":"2021-10-08T19:27:23.134998+0000","last_clean":"2021-10-08T19:27:23.134998+0000","last_became_active":"2021-10-08T19:26:05.910934+0000","last_became_peered":"2021-10-08T19:26:05.910934+0000","last_unstale":"2021-10-08T19:27:23.134998+0000","last_undegraded":"2021-10-08T19:27:23.134998+0000","last_fullsized":"2021-10-08T19:27:23.134998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134964+0000","last_change":"2021-10-08T19:26:07.898137+0000","last_active":"2021-10-08T19:27:23.134964+0000","last_peered":"2021-10-08T19:27:23.134964+0000","last_clean":"2021-10-08T19:27:23.134964+0000","last_became_active":"2021-10-08T19:26:07.897845+0000","last_became_peered":"2021-10-08T19:26:07.897845+0000","last_unstale":"2021-10-08T19:27:23.134964+0000","last_undegraded":"2021-10-08T19:27:23.134964+0000","last_fullsized":"2021-10-08T19:27:23.134964+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137645+0000","last_change":"2021-10-08T19:26:10.034430+0000","last_active":"2021-10-08T19:27:23.137645+0000","last_peered":"2021-10-08T19:27:23.137645+0000","last_clean":"2021-10-08T19:27:23.137645+0000","last_became_active":"2021-10-08T19:26:10.034144+0000","last_became_peered":"2021-10-08T19:26:10.034144+0000","last_unstale":"2021-10-08T19:27:23.137645+0000","last_undegraded":"2021-10-08T19:27:23.137645+0000","last_fullsized":"2021-10-08T19:27:23.137645+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.138352+0000","last_change":"2021-10-08T19:26:03.882923+0000","last_active":"2021-10-08T19:27:23.138352+0000","last_peered":"2021-10-08T19:27:23.138352+0000","last_clean":"2021-10-08T19:27:23.138352+0000","last_became_active":"2021-10-08T19:26:03.882221+0000","last_became_peered":"2021-10-08T19:26:03.882221+0000","last_unstale":"2021-10-08T19:27:23.138352+0000","last_undegraded":"2021-10-08T19:27:23.138352+0000","last_fullsized":"2021-10-08T19:27:23.138352+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"66'14","reported_seq":39,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.134655+0000","last_change":"2021-10-08T19:26:05.885882+0000","last_active":"2021-10-08T19:27:23.134655+0000","last_peered":"2021-10-08T19:27:23.134655+0000","last_clean":"2021-10-08T19:27:23.134655+0000","last_became_active":"2021-10-08T19:26:05.885583+0000","last_became_peered":"2021-10-08T19:26:05.885583+0000","last_unstale":"2021-10-08T19:27:23.134655+0000","last_undegraded":"2021-10-08T19:27:23.134655+0000","last_fullsized":"2021-10-08T19:27:23.134655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961081+0000","last_change":"2021-10-08T19:26:07.894373+0000","last_active":"2021-10-08T19:27:51.961081+0000","last_peered":"2021-10-08T19:27:51.961081+0000","last_clean":"2021-10-08T19:27:51.961081+0000","last_became_active":"2021-10-08T19:26:07.894047+0000","last_became_peered":"2021-10-08T19:26:07.894047+0000","last_unstale":"2021-10-08T19:27:51.961081+0000","last_undegraded":"2021-10-08T19:27:51.961081+0000","last_fullsized":"2021-10-08T19:27:51.961081+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135969+0000","last_change":"2021-10-08T19:26:10.033163+0000","last_active":"2021-10-08T19:27:23.135969+0000","last_peered":"2021-10-08T19:27:23.135969+0000","last_clean":"2021-10-08T19:27:23.135969+0000","last_became_active":"2021-10-08T19:26:10.032824+0000","last_became_peered":"2021-10-08T19:26:10.032824+0000","last_unstale":"2021-10-08T19:27:23.135969+0000","last_undegraded":"2021-10-08T19:27:23.135969+0000","last_fullsized":"2021-10-08T19:27:23.135969+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133389+0000","last_change":"2021-10-08T19:26:07.896618+0000","last_active":"2021-10-08T19:27:23.133389+0000","last_peered":"2021-10-08T19:27:23.133389+0000","last_clean":"2021-10-08T19:27:23.133389+0000","last_became_active":"2021-10-08T19:26:07.896329+0000","last_became_peered":"2021-10-08T19:26:07.896329+0000","last_unstale":"2021-10-08T19:27:23.133389+0000","last_undegraded":"2021-10-08T19:27:23.133389+0000","last_fullsized":"2021-10-08T19:27:23.133389+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136502+0000","last_change":"2021-10-08T19:26:03.887482+0000","last_active":"2021-10-08T19:27:23.136502+0000","last_peered":"2021-10-08T19:27:23.136502+0000","last_clean":"2021-10-08T19:27:23.136502+0000","last_became_active":"2021-10-08T19:26:03.887016+0000","last_became_peered":"2021-10-08T19:26:03.887016+0000","last_unstale":"2021-10-08T19:27:23.136502+0000","last_undegraded":"2021-10-08T19:27:23.136502+0000","last_fullsized":"2021-10-08T19:27:23.136502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"66'11","reported_seq":37,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136645+0000","last_change":"2021-10-08T19:26:05.889574+0000","last_active":"2021-10-08T19:27:23.136645+0000","last_peered":"2021-10-08T19:27:23.136645+0000","last_clean":"2021-10-08T19:27:23.136645+0000","last_became_active":"2021-10-08T19:26:05.889299+0000","last_became_peered":"2021-10-08T19:26:05.889299+0000","last_unstale":"2021-10-08T19:27:23.136645+0000","last_undegraded":"2021-10-08T19:27:23.136645+0000","last_fullsized":"2021-10-08T19:27:23.136645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133009+0000","last_change":"2021-10-08T19:26:09.903740+0000","last_active":"2021-10-08T19:27:23.133009+0000","last_peered":"2021-10-08T19:27:23.133009+0000","last_clean":"2021-10-08T19:27:23.133009+0000","last_became_active":"2021-10-08T19:26:09.903457+0000","last_became_peered":"2021-10-08T19:26:09.903457+0000","last_unstale":"2021-10-08T19:27:23.133009+0000","last_undegraded":"2021-10-08T19:27:23.133009+0000","last_fullsized":"2021-10-08T19:27:23.133009+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961388+0000","last_change":"2021-10-08T19:26:07.899291+0000","last_active":"2021-10-08T19:27:51.961388+0000","last_peered":"2021-10-08T19:27:51.961388+0000","last_clean":"2021-10-08T19:27:51.961388+0000","last_became_active":"2021-10-08T19:26:07.899085+0000","last_became_peered":"2021-10-08T19:26:07.899085+0000","last_unstale":"2021-10-08T19:27:51.961388+0000","last_undegraded":"2021-10-08T19:27:51.961388+0000","last_fullsized":"2021-10-08T19:27:51.961388+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129317+0000","last_change":"2021-10-08T19:26:03.889083+0000","last_active":"2021-10-08T19:27:23.129317+0000","last_peered":"2021-10-08T19:27:23.129317+0000","last_clean":"2021-10-08T19:27:23.129317+0000","last_became_active":"2021-10-08T19:26:03.888824+0000","last_became_peered":"2021-10-08T19:26:03.888824+0000","last_unstale":"2021-10-08T19:27:23.129317+0000","last_undegraded":"2021-10-08T19:27:23.129317+0000","last_fullsized":"2021-10-08T19:27:23.129317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'15","reported_seq":43,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133778+0000","last_change":"2021-10-08T19:26:05.898794+0000","last_active":"2021-10-08T19:27:23.133778+0000","last_peered":"2021-10-08T19:27:23.133778+0000","last_clean":"2021-10-08T19:27:23.133778+0000","last_became_active":"2021-10-08T19:26:05.898538+0000","last_became_peered":"2021-10-08T19:26:05.898538+0000","last_unstale":"2021-10-08T19:27:23.133778+0000","last_undegraded":"2021-10-08T19:27:23.133778+0000","last_fullsized":"2021-10-08T19:27:23.133778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136349+0000","last_change":"2021-10-08T19:26:09.903613+0000","last_active":"2021-10-08T19:27:23.136349+0000","last_peered":"2021-10-08T19:27:23.136349+0000","last_clean":"2021-10-08T19:27:23.136349+0000","last_became_active":"2021-10-08T19:26:09.902327+0000","last_became_peered":"2021-10-08T19:26:09.902327+0000","last_unstale":"2021-10-08T19:27:23.136349+0000","last_undegraded":"2021-10-08T19:27:23.136349+0000","last_fullsized":"2021-10-08T19:27:23.136349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961020+0000","last_change":"2021-10-08T19:26:07.896361+0000","last_active":"2021-10-08T19:27:51.961020+0000","last_peered":"2021-10-08T19:27:51.961020+0000","last_clean":"2021-10-08T19:27:51.961020+0000","last_became_active":"2021-10-08T19:26:07.896125+0000","last_became_peered":"2021-10-08T19:26:07.896125+0000","last_unstale":"2021-10-08T19:27:51.961020+0000","last_undegraded":"2021-10-08T19:27:51.961020+0000","last_fullsized":"2021-10-08T19:27:51.961020+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129664+0000","last_change":"2021-10-08T19:26:03.884419+0000","last_active":"2021-10-08T19:27:23.129664+0000","last_peered":"2021-10-08T19:27:23.129664+0000","last_clean":"2021-10-08T19:27:23.129664+0000","last_became_active":"2021-10-08T19:26:03.884055+0000","last_became_peered":"2021-10-08T19:26:03.884055+0000","last_unstale":"2021-10-08T19:27:23.129664+0000","last_undegraded":"2021-10-08T19:27:23.129664+0000","last_fullsized":"2021-10-08T19:27:23.129664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"66'10","reported_seq":33,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.135136+0000","last_change":"2021-10-08T19:26:05.898285+0000","last_active":"2021-10-08T19:27:23.135136+0000","last_peered":"2021-10-08T19:27:23.135136+0000","last_clean":"2021-10-08T19:27:23.135136+0000","last_became_active":"2021-10-08T19:26:05.897996+0000","last_became_peered":"2021-10-08T19:26:05.897996+0000","last_unstale":"2021-10-08T19:27:23.135136+0000","last_undegraded":"2021-10-08T19:27:23.135136+0000","last_fullsized":"2021-10-08T19:27:23.135136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133759+0000","last_change":"2021-10-08T19:26:09.910868+0000","last_active":"2021-10-08T19:27:23.133759+0000","last_peered":"2021-10-08T19:27:23.133759+0000","last_clean":"2021-10-08T19:27:23.133759+0000","last_became_active":"2021-10-08T19:26:09.910507+0000","last_became_peered":"2021-10-08T19:26:09.910507+0000","last_unstale":"2021-10-08T19:27:23.133759+0000","last_undegraded":"2021-10-08T19:27:23.133759+0000","last_fullsized":"2021-10-08T19:27:23.133759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130306+0000","last_change":"2021-10-08T19:26:07.891733+0000","last_active":"2021-10-08T19:27:23.130306+0000","last_peered":"2021-10-08T19:27:23.130306+0000","last_clean":"2021-10-08T19:27:23.130306+0000","last_became_active":"2021-10-08T19:26:07.891308+0000","last_became_peered":"2021-10-08T19:26:07.891308+0000","last_unstale":"2021-10-08T19:27:23.130306+0000","last_undegraded":"2021-10-08T19:27:23.130306+0000","last_fullsized":"2021-10-08T19:27:23.130306+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137322+0000","last_change":"2021-10-08T19:26:03.890209+0000","last_active":"2021-10-08T19:27:23.137322+0000","last_peered":"2021-10-08T19:27:23.137322+0000","last_clean":"2021-10-08T19:27:23.137322+0000","last_became_active":"2021-10-08T19:26:03.889891+0000","last_became_peered":"2021-10-08T19:26:03.889891+0000","last_unstale":"2021-10-08T19:27:23.137322+0000","last_undegraded":"2021-10-08T19:27:23.137322+0000","last_fullsized":"2021-10-08T19:27:23.137322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"66'17","reported_seq":46,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136353+0000","last_change":"2021-10-08T19:26:05.890530+0000","last_active":"2021-10-08T19:27:23.136353+0000","last_peered":"2021-10-08T19:27:23.136353+0000","last_clean":"2021-10-08T19:27:23.136353+0000","last_became_active":"2021-10-08T19:26:05.890265+0000","last_became_peered":"2021-10-08T19:26:05.890265+0000","last_unstale":"2021-10-08T19:27:23.136353+0000","last_undegraded":"2021-10-08T19:27:23.136353+0000","last_fullsized":"2021-10-08T19:27:23.136353+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.136360+0000","last_change":"2021-10-08T19:26:09.910294+0000","last_active":"2021-10-08T19:27:23.136360+0000","last_peered":"2021-10-08T19:27:23.136360+0000","last_clean":"2021-10-08T19:27:23.136360+0000","last_became_active":"2021-10-08T19:26:09.910012+0000","last_became_peered":"2021-10-08T19:26:09.910012+0000","last_unstale":"2021-10-08T19:27:23.136360+0000","last_undegraded":"2021-10-08T19:27:23.136360+0000","last_fullsized":"2021-10-08T19:27:23.136360+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133465+0000","last_change":"2021-10-08T19:26:07.896352+0000","last_active":"2021-10-08T19:27:23.133465+0000","last_peered":"2021-10-08T19:27:23.133465+0000","last_clean":"2021-10-08T19:27:23.133465+0000","last_became_active":"2021-10-08T19:26:07.896086+0000","last_became_peered":"2021-10-08T19:26:07.896086+0000","last_unstale":"2021-10-08T19:27:23.133465+0000","last_undegraded":"2021-10-08T19:27:23.133465+0000","last_fullsized":"2021-10-08T19:27:23.133465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132651+0000","last_change":"2021-10-08T19:26:03.887402+0000","last_active":"2021-10-08T19:27:23.132651+0000","last_peered":"2021-10-08T19:27:23.132651+0000","last_clean":"2021-10-08T19:27:23.132651+0000","last_became_active":"2021-10-08T19:26:03.887155+0000","last_became_peered":"2021-10-08T19:26:03.887155+0000","last_unstale":"2021-10-08T19:27:23.132651+0000","last_undegraded":"2021-10-08T19:27:23.132651+0000","last_fullsized":"2021-10-08T19:27:23.132651+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"66'19","reported_seq":49,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.137471+0000","last_change":"2021-10-08T19:26:05.908446+0000","last_active":"2021-10-08T19:27:23.137471+0000","last_peered":"2021-10-08T19:27:23.137471+0000","last_clean":"2021-10-08T19:27:23.137471+0000","last_became_active":"2021-10-08T19:26:05.908133+0000","last_became_peered":"2021-10-08T19:26:05.908133+0000","last_unstale":"2021-10-08T19:27:23.137471+0000","last_undegraded":"2021-10-08T19:27:23.137471+0000","last_fullsized":"2021-10-08T19:27:23.137471+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.129074+0000","last_change":"2021-10-08T19:26:09.902749+0000","last_active":"2021-10-08T19:27:23.129074+0000","last_peered":"2021-10-08T19:27:23.129074+0000","last_clean":"2021-10-08T19:27:23.129074+0000","last_became_active":"2021-10-08T19:26:09.902347+0000","last_became_peered":"2021-10-08T19:26:09.902347+0000","last_unstale":"2021-10-08T19:27:23.129074+0000","last_undegraded":"2021-10-08T19:27:23.129074+0000","last_fullsized":"2021-10-08T19:27:23.129074+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133351+0000","last_change":"2021-10-08T19:26:07.898242+0000","last_active":"2021-10-08T19:27:23.133351+0000","last_peered":"2021-10-08T19:27:23.133351+0000","last_clean":"2021-10-08T19:27:23.133351+0000","last_became_active":"2021-10-08T19:26:07.897864+0000","last_became_peered":"2021-10-08T19:26:07.897864+0000","last_unstale":"2021-10-08T19:27:23.133351+0000","last_undegraded":"2021-10-08T19:27:23.133351+0000","last_fullsized":"2021-10-08T19:27:23.133351+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"58'1","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130986+0000","last_change":"2021-10-08T19:26:03.890444+0000","last_active":"2021-10-08T19:27:23.130986+0000","last_peered":"2021-10-08T19:27:23.130986+0000","last_clean":"2021-10-08T19:27:23.130986+0000","last_became_active":"2021-10-08T19:26:03.890110+0000","last_became_peered":"2021-10-08T19:26:03.890110+0000","last_unstale":"2021-10-08T19:27:23.130986+0000","last_undegraded":"2021-10-08T19:27:23.130986+0000","last_fullsized":"2021-10-08T19:27:23.130986+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"66'9","reported_seq":34,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.130771+0000","last_change":"2021-10-08T19:26:05.891000+0000","last_active":"2021-10-08T19:27:23.130771+0000","last_peered":"2021-10-08T19:27:23.130771+0000","last_clean":"2021-10-08T19:27:23.130771+0000","last_became_active":"2021-10-08T19:26:05.890671+0000","last_became_peered":"2021-10-08T19:26:05.890671+0000","last_unstale":"2021-10-08T19:27:23.130771+0000","last_undegraded":"2021-10-08T19:27:23.130771+0000","last_fullsized":"2021-10-08T19:27:23.130771+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132681+0000","last_change":"2021-10-08T19:26:10.032969+0000","last_active":"2021-10-08T19:27:23.132681+0000","last_peered":"2021-10-08T19:27:23.132681+0000","last_clean":"2021-10-08T19:27:23.132681+0000","last_became_active":"2021-10-08T19:26:10.032604+0000","last_became_peered":"2021-10-08T19:26:10.032604+0000","last_unstale":"2021-10-08T19:27:23.132681+0000","last_undegraded":"2021-10-08T19:27:23.132681+0000","last_fullsized":"2021-10-08T19:27:23.132681+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:08.880913+0000","last_clean_scrub_stamp":"2021-10-08T19:26:08.880913+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"58'1","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.133756+0000","last_change":"2021-10-08T19:26:03.884516+0000","last_active":"2021-10-08T19:27:23.133756+0000","last_peered":"2021-10-08T19:27:23.133756+0000","last_clean":"2021-10-08T19:27:23.133756+0000","last_became_active":"2021-10-08T19:26:03.884207+0000","last_became_peered":"2021-10-08T19:26:03.884207+0000","last_unstale":"2021-10-08T19:27:23.133756+0000","last_undegraded":"2021-10-08T19:27:23.133756+0000","last_fullsized":"2021-10-08T19:27:23.133756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:02.863917+0000","last_clean_scrub_stamp":"2021-10-08T19:26:02.863917+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"66'15","reported_seq":43,"reported_epoch":68,"state":"active+clean","last_fresh":"2021-10-08T19:27:23.132560+0000","last_change":"2021-10-08T19:26:05.908824+0000","last_active":"2021-10-08T19:27:23.132560+0000","last_peered":"2021-10-08T19:27:23.132560+0000","last_clean":"2021-10-08T19:27:23.132560+0000","last_became_active":"2021-10-08T19:26:05.908511+0000","last_became_peered":"2021-10-08T19:26:05.908511+0000","last_unstale":"2021-10-08T19:27:23.132560+0000","last_undegraded":"2021-10-08T19:27:23.132560+0000","last_fullsized":"2021-10-08T19:27:23.132560+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:04.869283+0000","last_clean_scrub_stamp":"2021-10-08T19:26:04.869283+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"66'8","reported_seq":47,"reported_epoch":69,"state":"active+clean","last_fresh":"2021-10-08T19:27:51.961419+0000","last_change":"2021-10-08T19:26:07.902561+0000","last_active":"2021-10-08T19:27:51.961419+0000","last_peered":"2021-10-08T19:27:51.961419+0000","last_clean":"2021-10-08T19:27:51.961419+0000","last_became_active":"2021-10-08T19:26:07.902230+0000","last_became_peered":"2021-10-08T19:26:07.902230+0000","last_unstale":"2021-10-08T19:27:51.961419+0000","last_undegraded":"2021-10-08T19:27:51.961419+0000","last_fullsized":"2021-10-08T19:27:51.961419+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-08T19:26:06.877135+0000","last_clean_scrub_stamp":"2021-10-08T19:26:06.877135+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"scrub_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":391,"ondisk_log_size":391,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":103,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":52,"seq":223338299419,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6772,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738380,"statfs":{"total":95995035648,"available":95988101120,"internally_reserved":0,"allocated":1355776,"data_stored":910171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.629}]},{"osd":1,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Oct 8 19:26:55 2021","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.62},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.69099999999999995}]}]},{"osd":6,"up_from":45,"seq":193273528351,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6816,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738336,"statfs":{"total":95995035648,"available":95988056064,"internally_reserved":0,"allocated":1335296,"data_stored":909521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.629,"5min":1.145,"15min":1.145},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66900000000000004,"5min":1.071,"15min":1.071},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65500000000000003,"5min":1.175,"15min":1.175},"last":0.316},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66000000000000003,"5min":1.113,"15min":1.113},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63100000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63100000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.504},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59399999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.42399999999999999,"15min":0.42799999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.66000000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52800000000000002,"5min":0.996,"15min":0.996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.47599999999999998,"15min":0.48199999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.435}]},{"osd":7,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.47799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7116,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93738036,"statfs":{"total":95995035648,"available":95987748864,"internally_reserved":0,"allocated":790528,"data_stored":321226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:13 2021","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.32600000000000001},"min":{"1min":0.24299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:27:27 2021","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.376,"15min":0.376},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.374}]},{"osd":3,"last update":"Fri Oct 8 19:27:44 2021","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.42399999999999999,"15min":0.439},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:27:07 2021","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80900000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46800000000000003}]},{"osd":6,"last update":"Fri Oct 8 19:27:38 2021","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 8 19:27:55 2021","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85699999999999998,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70599999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.498}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7540,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93737612,"statfs":{"total":95995035648,"available":95987314688,"internally_reserved":0,"allocated":1355776,"data_stored":909833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 8 19:27:07 2021","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.23999999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.378,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.54200000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Oct 8 19:27:30 2021","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.28100000000000003,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.40500000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.434,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.28100000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:27:47 2021","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48499999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.41299999999999998,"15min":0.435},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.52600000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.318}]},{"osd":4,"last update":"Fri Oct 8 19:26:59 2021","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.374,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:27:26 2021","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.45400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.68300000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65400000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.501}]},{"osd":6,"last update":"Fri Oct 8 19:27:42 2021","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66500000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68100000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Oct 8 19:26:57 2021","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41199999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411373,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6832,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":6080,"kb_avail":93738320,"statfs":{"total":95995035648,"available":95988039680,"internally_reserved":0,"allocated":761856,"data_stored":320297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6225920},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:27 2021","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.39100000000000001,"15min":0.39500000000000002},"min":{"1min":0.253,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.58599999999999997,"5min":1.21,"15min":1.21},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:27:27 2021","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.37,"15min":0.376},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51500000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.255,"5min":0.253,"15min":0.253},"max":{"1min":0.58699999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34200000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:27:51 2021","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41599999999999998,"15min":0.432},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56299999999999994,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44800000000000001,"15min":0.47299999999999998},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.626,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:27:03 2021","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.71199999999999997,"15min":0.73199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2410000000000001,"5min":4.2169999999999996,"15min":4.2169999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 8 19:27:23 2021","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":1.226,"15min":1.226},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78900000000000003,"5min":1.204,"15min":1.204},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:27:40 2021","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79000000000000004,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86299999999999999,"5min":1.117,"15min":1.117},"last":0.497}]},{"osd":7,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60999999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149739,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6412,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738740,"statfs":{"total":95995035648,"available":95988469760,"internally_reserved":0,"allocated":790528,"data_stored":321195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:50 2021","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.38300000000000001,"15min":0.40500000000000003},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.309},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.40400000000000003,"15min":0.42799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.50700000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.22500000000000001}]},{"osd":1,"last update":"Fri Oct 8 19:27:50 2021","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.40300000000000002,"15min":0.42299999999999999},"min":{"1min":0.24399999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.46600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.47899999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 8 19:27:50 2021","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.434,"15min":0.45600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52100000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.498,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.25900000000000001}]},{"osd":4,"last update":"Fri Oct 8 19:27:00 2021","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66200000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40200000000000002}]},{"osd":5,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64500000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:27:42 2021","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.60799999999999998,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70099999999999996,"5min":1.869,"15min":1.869},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.60499999999999998,"15min":0.622},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.626,"5min":1.917,"15min":1.917},"last":0.36899999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:27:00 2021","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38800000000000001}]}]},{"osd":4,"up_from":31,"seq":133143986214,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6392,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738760,"statfs":{"total":95995035648,"available":95988490240,"internally_reserved":0,"allocated":770048,"data_stored":320492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.35499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90600000000000003,"5min":0.999,"15min":0.999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81000000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.55700000000000005,"15min":0.52100000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.6950000000000003,"5min":5.6950000000000003,"15min":5.6950000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0980000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.59999999999999998,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":7.3200000000000003,"5min":7.3200000000000003,"15min":7.3200000000000003},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 8 19:27:20 2021","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58099999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.501},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.432,"15min":0.40999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 8 19:27:44 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.437,"15min":0.437},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.46100000000000002},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Oct 8 19:26:58 2021","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.439}]}]},{"osd":5,"up_from":38,"seq":163208757282,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6244,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738908,"statfs":{"total":95995035648,"available":95988641792,"internally_reserved":0,"allocated":749568,"data_stored":319234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63700000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.64900000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.436},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72199999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Oct 8 19:27:22 2021","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.41399999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35699999999999998}]},{"osd":6,"last update":"Fri Oct 8 19:27:41 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.629,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39600000000000002}]},{"osd":7,"last update":"Fri Oct 8 19:26:57 2021","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.497}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-10-08T19:28:05.363 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-10-08T19:28:05.363 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-10-08T19:28:05.363 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-10-08T19:28:05.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:103b6cc3554193fcd0852d9c647cef19e99920cf shell --fsid c1559bde-286c-11ec-8c25-001a4aab830c -- ceph health --format=json 2021-10-08T19:28:05.389 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:05] "GET /metrics HTTP/1.1" 200 153748 "" "Prometheus/2.18.1" 2021-10-08T19:28:05.390 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: poll took 6523.824 ms: 1 events 2021-10-08T19:28:05.390 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:05.390 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: Reconfiguring prometheus.a (dependencies changed)... 2021-10-08T19:28:05.391 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: Reconfiguring daemon prometheus.a on smithi142 2021-10-08T19:28:05.391 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:05.391 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:28:05.391 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:05.392 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:28:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:05.392 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[40655]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:05.392 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: poll took 6523.824 ms: 1 events 2021-10-08T19:28:05.393 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:05.393 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: Reconfiguring prometheus.a (dependencies changed)... 2021-10-08T19:28:05.393 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: Reconfiguring daemon prometheus.a on smithi142 2021-10-08T19:28:05.393 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:05.394 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:28:05.394 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:05.394 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:28:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:05.394 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:05 smithi112 ceph-mon[31694]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:05.708 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:05 smithi142 conmon[65044]: t=2021-10-08T19:28:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-10-08T19:28:05.709 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: poll took 6523.824 ms: 1 events 2021-10-08T19:28:05.709 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:05.709 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: Reconfiguring prometheus.a (dependencies changed)... 2021-10-08T19:28:05.709 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: Reconfiguring daemon prometheus.a on smithi142 2021-10-08T19:28:05.710 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-10-08T19:28:05.710 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: Received old metadata from agent on host smithi142. Requested up-to-date metadata. 2021-10-08T19:28:05.710 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:05.710 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:28:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:05.711 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:05 smithi142 ceph-mon[33432]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:05.805 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/c1559bde-286c-11ec-8c25-001a4aab830c/mon.a/config 2021-10-08T19:28:05.968 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:05 smithi142 conmon[65044]: t=2021-10-08T19:28:05+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-10-08T19:28:05.969 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:05 smithi142 conmon[65044]: t=2021-10-08T19:28:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-10-08T19:28:06.219 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:05 smithi142 conmon[65044]: t=2021-10-08T19:28:05+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-10-08T19:28:06.220 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-10-08T19:28:06.220 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-10-08T19:28:06.221 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-10-08T19:28:06.308 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:06 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:06.153Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000080973s 2021-10-08T19:28:06.518 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:28:06.519 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-10-08T19:28:06.519 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-10-08T19:28:06.519 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-10-08T19:28:06.519 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-10-08T19:28:06.519 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-10-08T19:28:06.520 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-10-08T19:28:06.773 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-10-08T19:28:07.141 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-10-08T19:28:07.142 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:06 smithi142 conmon[65044]: t=2021-10-08T19:28:06+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-10-08T19:28:07.142 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-10-08T19:28:07.382 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1939115540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340f7de0 msgr2=0x7fbd34104430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:07.382 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1939115540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340f7de0 0x7fbd34104430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0046e0 tx=0x7fbd2c009b30 comp rx=0 tx=0).stop 2021-10-08T19:28:07.382 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1939115540 shutdown_connections 2021-10-08T19:28:07.383 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1939115540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340f7de0 0x7fbd34104430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.383 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1939115540 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd340fd610 0x7fbd340fd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.383 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1939115540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd340fdfb0 0x7fbd340f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.383 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1939115540 >> 172.21.15.112:0/1939115540 conn(0x7fbd3406f600 msgr2=0x7fbd3406fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:28:07.384 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1939115540 shutdown_connections 2021-10-08T19:28:07.384 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.378+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1939115540 wait complete. 2021-10-08T19:28:07.384 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3b7f1700 1 Processor -- start 2021-10-08T19:28:07.384 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3b7f1700 1 -- start start 2021-10-08T19:28:07.385 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3b7f1700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd340f7de0 0x7fbd3410e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:07.385 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3b7f1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340fd610 0x7fbd3410eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:07.385 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3b7f1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd340fdfb0 0x7fbd341086e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:07.385 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3b7f1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd34108d30 con 0x7fbd340fd610 2021-10-08T19:28:07.385 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3b7f1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd34108ea0 con 0x7fbd340fdfb0 2021-10-08T19:28:07.386 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3b7f1700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd34109060 con 0x7fbd340f7de0 2021-10-08T19:28:07.386 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd3958d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd340f7de0 0x7fbd3410e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:07.386 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd38d8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340fd610 0x7fbd3410eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:07.386 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd38d8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340fd610 0x7fbd3410eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34530/0 (socket says 172.21.15.112:34530) 2021-10-08T19:28:07.386 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd38d8c700 1 -- 172.21.15.112:0/1855179345 learned_addr learned my addr 172.21.15.112:0/1855179345 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:28:07.387 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.379+0000 7fbd39d8e700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd340fdfb0 0x7fbd341086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:07.387 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd3958d700 1 -- 172.21.15.112:0/1855179345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd340fdfb0 msgr2=0x7fbd341086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:07.387 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd3958d700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd340fdfb0 0x7fbd341086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.387 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd3958d700 1 -- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340fd610 msgr2=0x7fbd3410eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:07.387 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd3958d700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340fd610 0x7fbd3410eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.388 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd3958d700 1 -- 172.21.15.112:0/1855179345 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009640 con 0x7fbd340f7de0 2021-10-08T19:28:07.388 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd38d8c700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340fd610 0x7fbd3410eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:28:07.388 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd3958d700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd340f7de0 0x7fbd3410e610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd30001d00 tx=0x7fbd30004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:28:07.388 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd29ffb700 1 -- 172.21.15.112:0/1855179345 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30001e00 con 0x7fbd340f7de0 2021-10-08T19:28:07.389 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd29ffb700 1 -- 172.21.15.112:0/1855179345 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbd3000fd70 con 0x7fbd340f7de0 2021-10-08T19:28:07.390 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c005040 con 0x7fbd340f7de0 2021-10-08T19:28:07.390 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd29ffb700 1 -- 172.21.15.112:0/1855179345 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300079e0 con 0x7fbd340f7de0 2021-10-08T19:28:07.390 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.380+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd34115410 con 0x7fbd340f7de0 2021-10-08T19:28:07.390 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.381+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd34047b50 con 0x7fbd340f7de0 2021-10-08T19:28:07.391 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.381+0000 7fbd29ffb700 1 -- 172.21.15.112:0/1855179345 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fbd3001c030 con 0x7fbd340f7de0 2021-10-08T19:28:07.391 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.382+0000 7fbd29ffb700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbd200635e0 0x7fbd20065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:07.391 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.382+0000 7fbd38d8c700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbd200635e0 0x7fbd20065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:28:07.391 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.382+0000 7fbd29ffb700 1 -- 172.21.15.112:0/1855179345 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7530+0+0 (secure 0 0 0) 0x7fbd30080140 con 0x7fbd340f7de0 2021-10-08T19:28:07.392 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.382+0000 7fbd38d8c700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbd200635e0 0x7fbd20065a90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd34109eb0 tx=0x7fbd2400b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:28:07.392 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.386+0000 7fbd29ffb700 1 -- 172.21.15.112:0/1855179345 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fbd30049b00 con 0x7fbd340f7de0 2021-10-08T19:28:07.423 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-10-08T19:28:07.424 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-10-08T19:28:07.424 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-10-08T19:28:07.425 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-10-08T19:28:07.425 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-10-08T19:28:07.425 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-10-08T19:28:07.611 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.608+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbd34109bf0 con 0x7fbd340f7de0 2021-10-08T19:28:07.612 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.608+0000 7fbd29ffb700 1 -- 172.21.15.112:0/1855179345 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbd300527d0 con 0x7fbd340f7de0 2021-10-08T19:28:07.612 INFO:teuthology.orchestra.run.smithi112.stdout: 2021-10-08T19:28:07.612 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-10-08T19:28:07.614 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbd200635e0 msgr2=0x7fbd20065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:07.614 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbd200635e0 0x7fbd20065a90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd34109eb0 tx=0x7fbd2400b040 comp rx=0 tx=0).stop 2021-10-08T19:28:07.614 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd340f7de0 msgr2=0x7fbd3410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:28:07.614 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd340f7de0 0x7fbd3410e610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd30001d00 tx=0x7fbd30004c50 comp rx=0 tx=0).stop 2021-10-08T19:28:07.615 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 shutdown_connections 2021-10-08T19:28:07.615 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fbd200635e0 0x7fbd20065a90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.615 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd340fdfb0 0x7fbd341086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.615 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd340f7de0 0x7fbd3410e610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.615 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 --2- 172.21.15.112:0/1855179345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd340fd610 0x7fbd3410eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:07.616 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 >> 172.21.15.112:0/1855179345 conn(0x7fbd3406f600 msgr2=0x7fbd340f6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:28:07.616 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 shutdown_connections 2021-10-08T19:28:07.616 INFO:teuthology.orchestra.run.smithi112.stderr:2021-10-08T19:28:07.610+0000 7fbd3b7f1700 1 -- 172.21.15.112:0/1855179345 wait complete. 2021-10-08T19:28:07.675 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-10-08T19:28:07.675 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-10-08T19:28:07.675 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-10-08T19:28:07.944 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-10-08T19:28:07.944 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-10-08T19:28:07.945 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-10-08T19:28:07.945 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-10-08T19:28:07.945 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:07.945 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:07 smithi142 ceph-mon[33432]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:07.946 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1855179345' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:28:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:07 smithi112 ceph-mon[40655]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1855179345' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:28:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:07 smithi112 ceph-mon[31694]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1855179345' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-10-08T19:28:08.272 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:07 smithi142 conmon[65044]: t=2021-10-08T19:28:07+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-10-08T19:28:08.273 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-10-08T19:28:08.273 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-10-08T19:28:08.418 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-10-08T19:28:08.419 INFO:tasks.cephadm:Setup complete, yielding 2021-10-08T19:28:08.419 INFO:teuthology.run_tasks:Running task workunit... 2021-10-08T19:28:08.434 INFO:tasks.workunit:Pulling workunits from ref 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 2021-10-08T19:28:08.436 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-10-08T19:28:08.437 DEBUG:teuthology.orchestra.run.smithi112:> stat -- /home/ubuntu/cephtest/mnt.0 2021-10-08T19:28:08.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-08T19:28:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-08T19:28:08.475 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-10-08T19:28:08.531 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-10-08T19:28:08.531 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-10-08T19:28:08.585 INFO:tasks.workunit:timeout=3h 2021-10-08T19:28:08.585 INFO:tasks.workunit:cleanup=True 2021-10-08T19:28:08.586 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/liewegas/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 2021-10-08T19:28:08.641 INFO:tasks.workunit.client.0.smithi112.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-10-08T19:28:08.654 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-10-08T19:28:08.655 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-10-08T19:28:08.920 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-10-08T19:28:08.920 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-10-08T19:28:08.920 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-10-08T19:28:08.921 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-10-08T19:28:08.921 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-10-08T19:28:08.921 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-10-08T19:28:08.921 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:08 smithi142 systemd[1]: Stopping Ceph prometheus.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:28:09.273 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:08 smithi142 conmon[65044]: t=2021-10-08T19:28:08+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-10-08T19:28:09.273 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-10-08T19:28:09.273 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-10-08T19:28:09.273 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-10-08T19:28:09.274 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-10-08T19:28:09.274 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:08 smithi142 bash[66688]: Error: no container with name or ID "ceph-c1559bde-286c-11ec-8c25-001a4aab830c-prometheus.a" found: no such container 2021-10-08T19:28:09.274 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=warn ts=2021-10-08T19:28:09.031Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-10-08T19:28:09.275 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-10-08T19:28:09.275 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-10-08T19:28:09.275 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=main.go:583 msg="Stopping scrape manager..." 2021-10-08T19:28:09.275 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-10-08T19:28:09.276 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-10-08T19:28:09.276 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-10-08T19:28:09.276 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=main.go:577 msg="Scrape manager stopped" 2021-10-08T19:28:09.276 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-10-08T19:28:09.276 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-10-08T19:28:09.277 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=main.go:749 msg="Notifier manager stopped" 2021-10-08T19:28:09.277 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[62065]: level=info ts=2021-10-08T19:28:09.031Z caller=main.go:761 msg="See you next time!" 2021-10-08T19:28:09.697 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:09 smithi142 ceph-mon[33432]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:09.698 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-10-08T19:28:09.698 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-10-08T19:28:09.699 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-10-08T19:28:09.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:09 smithi112 ceph-mon[31694]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:09 smithi112 ceph-mon[40655]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:09.963 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-10-08T19:28:09.963 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-10-08T19:28:09.963 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-10-08T19:28:09.963 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-10-08T19:28:09.964 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-10-08T19:28:09.964 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-10-08T19:28:09.964 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-10-08T19:28:09.964 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:09 smithi142 conmon[65044]: t=2021-10-08T19:28:09+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-10-08T19:28:09.965 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 bash[66688]: ceph-c1559bde-286c-11ec-8c25-001a4aab830c-prometheus-a 2021-10-08T19:28:09.965 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 bash[66688]: Error: no container with name or ID "ceph-c1559bde-286c-11ec-8c25-001a4aab830c-prometheus.a" found: no such container 2021-10-08T19:28:09.965 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 systemd[1]: ceph-c1559bde-286c-11ec-8c25-001a4aab830c@prometheus.a.service: Succeeded. 2021-10-08T19:28:09.965 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 systemd[1]: Stopped Ceph prometheus.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:28:09.966 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:09 smithi142 systemd[1]: Starting Ceph prometheus.a for c1559bde-286c-11ec-8c25-001a4aab830c... 2021-10-08T19:28:10.232 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-10-08T19:28:10.232 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-10-08T19:28:10.233 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-10-08T19:28:10.484 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-10-08T19:28:10.485 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-10-08T19:28:10.485 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-10-08T19:28:10.485 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-10-08T19:28:10.486 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-10-08T19:28:10.486 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-10-08T19:28:10.486 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.480Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-10-08T19:28:10.487 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.480Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-10-08T19:28:10.487 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.480Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-10-08T19:28:10.487 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.480Z caller=main.go:339 host_details="(Linux 4.18.0-305.el8.x86_64 #1 SMP Thu Apr 29 08:54:30 EDT 2021 x86_64 smithi142 (none))" 2021-10-08T19:28:10.487 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.480Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-10-08T19:28:10.488 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.480Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-10-08T19:28:10.488 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.481Z caller=main.go:678 msg="Starting TSDB ..." 2021-10-08T19:28:10.488 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.481Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-10-08T19:28:10.488 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.483Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-10-08T19:28:10.740 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.495Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-10-08T19:28:10.741 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.496Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-10-08T19:28:10.741 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.496Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=12.488374ms 2021-10-08T19:28:10.742 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 bash[66856]: 7d5984928c15fb2a5e6b038758ed8ad481e1330d52689792a312ba7f68089801 2021-10-08T19:28:10.742 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.499Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-10-08T19:28:10.742 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.499Z caller=main.go:695 msg="TSDB started" 2021-10-08T19:28:10.743 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.499Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:28:10.743 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.503Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-10-08T19:28:10.744 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[67044]: level=info ts=2021-10-08T19:28:10.503Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-10-08T19:28:10.744 INFO:journalctl@ceph.prometheus.a.smithi142.stdout:Oct 08 19:28:10 smithi142 systemd[1]: Started Ceph prometheus.a for c1559bde-286c-11ec-8c25-001a4aab830c. 2021-10-08T19:28:10.745 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-10-08T19:28:10.745 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-10-08T19:28:10.746 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-10-08T19:28:10.747 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-10-08T19:28:10.747 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-10-08T19:28:10.747 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-10-08T19:28:10.748 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-10-08T19:28:10.748 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-10-08T19:28:10.749 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-10-08T19:28:11.023 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-10-08T19:28:11.023 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing HooksService" logger=server 2021-10-08T19:28:11.023 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-10-08T19:28:11.023 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-10-08T19:28:11.024 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-10-08T19:28:11.024 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-10-08T19:28:11.024 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-10-08T19:28:11.024 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-10-08T19:28:11.025 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-10-08T19:28:11.025 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-10-08T19:28:11.025 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-10-08T19:28:11.025 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing LoginService" logger=server 2021-10-08T19:28:11.025 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing SearchService" logger=server 2021-10-08T19:28:11.026 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing TracingService" logger=server 2021-10-08T19:28:11.026 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-10-08T19:28:11.026 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-10-08T19:28:11.026 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-10-08T19:28:11.027 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-10-08T19:28:11.027 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-10-08T19:28:11.027 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-10-08T19:28:11.027 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-10-08T19:28:11.028 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-10-08T19:28:11.028 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="Initializing Stream Manager" 2021-10-08T19:28:11.028 INFO:journalctl@ceph.grafana.a.smithi142.stdout:Oct 08 19:28:10 smithi142 conmon[65044]: t=2021-10-08T19:28:10+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-10-08T19:28:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: poll took 5824.110 ms: 1 events 2021-10-08T19:28:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:28:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:28:11.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.112:9093"}]: dispatch 2021-10-08T19:28:11.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.112:9093"}]: dispatch 2021-10-08T19:28:11.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:28:11.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:28:11.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.142:9095"}]: dispatch 2021-10-08T19:28:11.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.142:9095"}]: dispatch 2021-10-08T19:28:11.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:28:11.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:28:11.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.142:3000"}]: dispatch 2021-10-08T19:28:11.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.142:3000"}]: dispatch 2021-10-08T19:28:11.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:11.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:11.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:11.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:28:11.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:11.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:11.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:11.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:28:11.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[40655]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: poll took 5824.110 ms: 1 events 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:28:11.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.112:9093"}]: dispatch 2021-10-08T19:28:11.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.112:9093"}]: dispatch 2021-10-08T19:28:11.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:28:11.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.142:9095"}]: dispatch 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.142:9095"}]: dispatch 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:28:11.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:28:11.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.142:3000"}]: dispatch 2021-10-08T19:28:11.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.142:3000"}]: dispatch 2021-10-08T19:28:11.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:11.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:11.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:11.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:28:11.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:11.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:11.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:11.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:28:11.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:11 smithi112 ceph-mon[31694]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:11.883 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: poll took 5824.110 ms: 1 events 2021-10-08T19:28:11.883 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.884 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:28:11.884 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-10-08T19:28:11.884 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.112:9093"}]: dispatch 2021-10-08T19:28:11.884 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.112:9093"}]: dispatch 2021-10-08T19:28:11.884 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.885 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:28:11.885 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-10-08T19:28:11.885 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.142:9095"}]: dispatch 2021-10-08T19:28:11.885 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.142:9095"}]: dispatch 2021-10-08T19:28:11.886 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.886 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:28:11.886 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-10-08T19:28:11.886 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.142:3000"}]: dispatch 2021-10-08T19:28:11.887 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.142:3000"}]: dispatch 2021-10-08T19:28:11.887 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.887 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:11.887 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:11.887 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:11.888 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.888 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:28:11.888 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:11.888 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:11.888 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:11.889 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:11.890 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: Metadata not up to date on all hosts. Skipping non agent specs 2021-10-08T19:28:11.891 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:11 smithi142 ceph-mon[33432]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:14.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:13 smithi142 ceph-mon[33432]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:14.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:13 smithi112 ceph-mon[40655]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:14.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:13 smithi112 ceph-mon[31694]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:14.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:14 smithi112 conmon[81261]: level=info ts=2021-10-08T19:28:14.154Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001080969s 2021-10-08T19:28:16.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:15 smithi142 ceph-mon[33432]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:16.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:15 smithi112 ceph-mon[40655]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:16.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:15 smithi112 ceph-mon[31694]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:16.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:28:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:28:17.320 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:16 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:28:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:18.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:18.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:18.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:18.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:28:18.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:28:18.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:18.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:28:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:18.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:18.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:18.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:17 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:18.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:18.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:18.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:28:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:28:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:28:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:18.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:18.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:18.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:18.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: New metadata from agent has made all hosts up to date. Kicking serve loop 2021-10-08T19:28:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:28:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:28:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:28:16] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:28:18.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:28:18.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:17 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:19 smithi142 ceph-mon[33432]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:19.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:19 smithi112 ceph-mon[40655]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:19.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:19 smithi112 ceph-mon[31694]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:22.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:21 smithi142 ceph-mon[33432]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:22.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:21 smithi112 ceph-mon[40655]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:22.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:21 smithi112 ceph-mon[31694]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:23.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:23.019 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:23.019 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:23.020 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:23.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:23.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:28:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:28:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:23 smithi142 ceph-mon[33432]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:24.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:23 smithi112 ceph-mon[40655]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:24.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:24.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:24.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:23 smithi112 ceph-mon[31694]: pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:24.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:24.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:28:25.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:25] "GET /metrics HTTP/1.1" 200 153761 "" "Prometheus/2.18.1" 2021-10-08T19:28:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:25 smithi142 ceph-mon[33432]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:25 smithi112 ceph-mon[40655]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:26.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:25 smithi112 ceph-mon[31694]: pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:26.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:28:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:28:28.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:27 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:28.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:27 smithi142 ceph-mon[33432]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:28.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:27 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:28.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:27 smithi112 ceph-mon[31694]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:28.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:27 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:28.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:27 smithi112 ceph-mon[40655]: pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:29 smithi142 ceph-mon[33432]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:29.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:29 smithi112 ceph-mon[40655]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:29.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:29 smithi112 ceph-mon[31694]: pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:31.967 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:31 smithi112 ceph-mon[40655]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:31.968 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:31 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:28:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:31.968 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:31 smithi112 ceph-mon[31694]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:32.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:31 smithi142 ceph-mon[33432]: pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:33.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:28:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:33.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:32 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:33.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:32 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:28:33.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:32 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:28:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:33.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:32 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:33.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:32 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:28:33.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:32 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:28:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:33.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:32 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:33.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:32 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:28:33.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:32 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:28:31] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:34.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:33 smithi142 ceph-mon[33432]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:34.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:33 smithi112 ceph-mon[40655]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:34.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:33 smithi112 ceph-mon[31694]: pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:35] "GET /metrics HTTP/1.1" 200 153761 "" "Prometheus/2.18.1" 2021-10-08T19:28:36.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:35 smithi142 ceph-mon[33432]: pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:35 smithi112 ceph-mon[40655]: pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:36.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:35 smithi112 ceph-mon[31694]: pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:36.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:28:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:28:38.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:37 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:38.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:37 smithi142 ceph-mon[33432]: pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:38.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:37 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:37 smithi112 ceph-mon[40655]: pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:38.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:37 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:38.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:37 smithi112 ceph-mon[31694]: pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:39.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:39 smithi142 ceph-mon[33432]: pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:39.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:39 smithi112 ceph-mon[40655]: pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:39.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:39 smithi112 ceph-mon[31694]: pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:42.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:41 smithi142 ceph-mon[33432]: pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:42.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:41 smithi112 ceph-mon[31694]: pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:42.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:41 smithi112 ceph-mon[40655]: pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:43.514 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:28:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:43.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:43 smithi142 ceph-mon[33432]: pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:44.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:43 smithi112 ceph-mon[40655]: pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:44.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:43 smithi112 ceph-mon[31694]: pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:44.072 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:43 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:28:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:45.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:44 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:45.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:44 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:28:45.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:44 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:28:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:45.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:44 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:45.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:44 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:28:45.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:44 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:28:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:45.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:44 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:28:45.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:44 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:28:45.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:44 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:28:43] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:28:45.376 INFO:tasks.workunit.client.0.smithi112.stderr:Note: switching to '6d1d7181c8e91145ded12e11fc2a9c8ce31671f6'. 2021-10-08T19:28:45.376 INFO:tasks.workunit.client.0.smithi112.stderr: 2021-10-08T19:28:45.376 INFO:tasks.workunit.client.0.smithi112.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-10-08T19:28:45.377 INFO:tasks.workunit.client.0.smithi112.stderr:changes and commit them, and you can discard any commits you make in this 2021-10-08T19:28:45.377 INFO:tasks.workunit.client.0.smithi112.stderr:state without impacting any branches by switching back to a branch. 2021-10-08T19:28:45.377 INFO:tasks.workunit.client.0.smithi112.stderr: 2021-10-08T19:28:45.377 INFO:tasks.workunit.client.0.smithi112.stderr:If you want to create a new branch to retain commits you create, you may 2021-10-08T19:28:45.377 INFO:tasks.workunit.client.0.smithi112.stderr:do so (now or later) by using -c with the switch command. Example: 2021-10-08T19:28:45.378 INFO:tasks.workunit.client.0.smithi112.stderr: 2021-10-08T19:28:45.378 INFO:tasks.workunit.client.0.smithi112.stderr: git switch -c 2021-10-08T19:28:45.378 INFO:tasks.workunit.client.0.smithi112.stderr: 2021-10-08T19:28:45.378 INFO:tasks.workunit.client.0.smithi112.stderr:Or undo this operation with: 2021-10-08T19:28:45.379 INFO:tasks.workunit.client.0.smithi112.stderr: 2021-10-08T19:28:45.379 INFO:tasks.workunit.client.0.smithi112.stderr: git switch - 2021-10-08T19:28:45.379 INFO:tasks.workunit.client.0.smithi112.stderr: 2021-10-08T19:28:45.380 INFO:tasks.workunit.client.0.smithi112.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-10-08T19:28:45.380 INFO:tasks.workunit.client.0.smithi112.stderr: 2021-10-08T19:28:45.380 INFO:tasks.workunit.client.0.smithi112.stderr:HEAD is now at 6d1d7181c8e qa/tasks/nvme_loop: loop until 'nvme list' shows new devs 2021-10-08T19:28:45.382 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-10-08T19:28:45.449 INFO:tasks.workunit.client.0.smithi112.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-10-08T19:28:45.451 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-10-08T19:28:45.452 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-10-08T19:28:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:45] "GET /metrics HTTP/1.1" 200 153762 "" "Prometheus/2.18.1" 2021-10-08T19:28:45.902 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-10-08T19:28:45.967 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-10-08T19:28:46.004 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-10-08T19:28:46.005 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-10-08T19:28:46.005 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-10-08T19:28:46.040 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-10-08T19:28:46.044 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2021-10-08T19:28:46.045 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-10-08T19:28:46.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:45 smithi112 ceph-mon[40655]: pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:46.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:45 smithi112 ceph-mon[31694]: pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:46.086 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2021-10-08T19:28:46.088 INFO:tasks.workunit:Running workunit rados/test.sh... 2021-10-08T19:28:46.088 DEBUG:teuthology.orchestra.run.smithi112:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2021-10-08T19:28:46.151 INFO:tasks.workunit.client.0.smithi112.stderr:+ parallel=1 2021-10-08T19:28:46.151 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' '' = --serial ']' 2021-10-08T19:28:46.151 INFO:tasks.workunit.client.0.smithi112.stderr:+ color= 2021-10-08T19:28:46.152 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' -t 1 ']' 2021-10-08T19:28:46.152 INFO:tasks.workunit.client.0.smithi112.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2021-10-08T19:28:46.152 INFO:tasks.workunit.client.0.smithi112.stderr:+ declare -A pids 2021-10-08T19:28:46.152 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.153 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.153 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_aio 2021-10-08T19:28:46.153 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_aio' 2021-10-08T19:28:46.153 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_aio 2021-10-08T19:28:46.154 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.155 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_aio 2021-10-08T19:28:46.155 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83028 2021-10-08T19:28:46.156 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_aio on pid 83028' 2021-10-08T19:28:46.156 INFO:tasks.workunit.client.0.smithi112.stdout:test api_aio on pid 83028 2021-10-08T19:28:46.159 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83028 2021-10-08T19:28:46.159 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2021-10-08T19:28:46.159 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.160 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.160 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_aio_pp 2021-10-08T19:28:46.160 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_aio_pp' 2021-10-08T19:28:46.160 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_aio_pp 2021-10-08T19:28:46.161 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.161 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_aio 2021-10-08T19:28:46.161 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_aio.log 2021-10-08T19:28:46.161 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_aio: /' 2021-10-08T19:28:46.162 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_aio_pp 2021-10-08T19:28:46.162 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83036 2021-10-08T19:28:46.162 INFO:tasks.workunit.client.0.smithi112.stdout:test api_aio_pp on pid 83036 2021-10-08T19:28:46.164 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_aio_pp on pid 83036' 2021-10-08T19:28:46.165 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83036 2021-10-08T19:28:46.165 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.165 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.165 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2021-10-08T19:28:46.166 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_io 2021-10-08T19:28:46.166 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_io' 2021-10-08T19:28:46.166 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_io 2021-10-08T19:28:46.167 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.167 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_aio_pp 2021-10-08T19:28:46.167 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_aio_pp.log 2021-10-08T19:28:46.167 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_aio_pp: /' 2021-10-08T19:28:46.168 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_io 2021-10-08T19:28:46.168 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83044 2021-10-08T19:28:46.168 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_io on pid 83044' 2021-10-08T19:28:46.169 INFO:tasks.workunit.client.0.smithi112.stdout:test api_io on pid 83044 2021-10-08T19:28:46.170 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83044 2021-10-08T19:28:46.171 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.171 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.171 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2021-10-08T19:28:46.171 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_io_pp 2021-10-08T19:28:46.172 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_io_pp' 2021-10-08T19:28:46.172 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_io_pp 2021-10-08T19:28:46.172 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.172 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_io 2021-10-08T19:28:46.173 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_io.log 2021-10-08T19:28:46.173 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_io: /' 2021-10-08T19:28:46.173 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_io_pp 2021-10-08T19:28:46.173 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83052 2021-10-08T19:28:46.174 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_io_pp on pid 83052' 2021-10-08T19:28:46.174 INFO:tasks.workunit.client.0.smithi112.stdout:test api_io_pp on pid 83052 2021-10-08T19:28:46.176 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83052 2021-10-08T19:28:46.177 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.177 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2021-10-08T19:28:46.177 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.177 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_asio 2021-10-08T19:28:46.178 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_asio' 2021-10-08T19:28:46.178 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_asio 2021-10-08T19:28:46.178 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.178 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_io_pp 2021-10-08T19:28:46.179 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_io_pp.log 2021-10-08T19:28:46.179 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_io_pp: /' 2021-10-08T19:28:46.179 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_asio 2021-10-08T19:28:46.179 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83060 2021-10-08T19:28:46.179 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_asio on pid 83060' 2021-10-08T19:28:46.180 INFO:tasks.workunit.client.0.smithi112.stdout:test api_asio on pid 83060 2021-10-08T19:28:46.181 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83060 2021-10-08T19:28:46.181 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.182 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.182 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2021-10-08T19:28:46.182 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_list 2021-10-08T19:28:46.183 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_list' 2021-10-08T19:28:46.183 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_list 2021-10-08T19:28:46.183 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.183 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_asio 2021-10-08T19:28:46.183 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_asio.log 2021-10-08T19:28:46.184 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_list 2021-10-08T19:28:46.184 INFO:tasks.workunit.client.0.smithi112.stdout:test api_list on pid 83068 2021-10-08T19:28:46.186 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_asio: /' 2021-10-08T19:28:46.186 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83068 2021-10-08T19:28:46.186 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_list on pid 83068' 2021-10-08T19:28:46.187 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83068 2021-10-08T19:28:46.187 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.187 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.188 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2021-10-08T19:28:46.188 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_lock 2021-10-08T19:28:46.188 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_list 2021-10-08T19:28:46.188 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_lock' 2021-10-08T19:28:46.189 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_lock 2021-10-08T19:28:46.189 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.189 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_list.log 2021-10-08T19:28:46.189 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_list: /' 2021-10-08T19:28:46.189 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_lock 2021-10-08T19:28:46.190 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83076 2021-10-08T19:28:46.190 INFO:tasks.workunit.client.0.smithi112.stdout:test api_lock on pid 83076 2021-10-08T19:28:46.192 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_lock on pid 83076' 2021-10-08T19:28:46.192 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83076 2021-10-08T19:28:46.192 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.193 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.193 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_lock_pp 2021-10-08T19:28:46.193 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_lock_pp' 2021-10-08T19:28:46.194 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_lock_pp 2021-10-08T19:28:46.194 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2021-10-08T19:28:46.194 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.194 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_lock_pp 2021-10-08T19:28:46.195 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83084 2021-10-08T19:28:46.195 INFO:tasks.workunit.client.0.smithi112.stdout:test api_lock_pp on pid 83084 2021-10-08T19:28:46.197 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_lock_pp on pid 83084' 2021-10-08T19:28:46.197 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83084 2021-10-08T19:28:46.198 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.198 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.198 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_lock 2021-10-08T19:28:46.198 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_lock: /' 2021-10-08T19:28:46.199 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_misc 2021-10-08T19:28:46.199 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_misc' 2021-10-08T19:28:46.199 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_misc 2021-10-08T19:28:46.199 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2021-10-08T19:28:46.200 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_lock_pp.log 2021-10-08T19:28:46.200 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_lock_pp: /' 2021-10-08T19:28:46.200 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_lock.log 2021-10-08T19:28:46.200 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.200 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_misc 2021-10-08T19:28:46.201 INFO:tasks.workunit.client.0.smithi112.stdout:test api_misc on pid 83147 2021-10-08T19:28:46.202 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83147 2021-10-08T19:28:46.203 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_misc on pid 83147' 2021-10-08T19:28:46.203 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83147 2021-10-08T19:28:46.203 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.204 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2021-10-08T19:28:46.204 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.204 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_misc_pp 2021-10-08T19:28:46.204 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_misc_pp' 2021-10-08T19:28:46.205 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.205 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_misc 2021-10-08T19:28:46.205 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_lock_pp 2021-10-08T19:28:46.205 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_misc_pp 2021-10-08T19:28:46.206 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_misc: /' 2021-10-08T19:28:46.206 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_misc.log 2021-10-08T19:28:46.206 INFO:tasks.workunit.client.0.smithi112.stdout:test api_misc_pp on pid 83167 2021-10-08T19:28:46.207 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_misc_pp 2021-10-08T19:28:46.208 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83167 2021-10-08T19:28:46.208 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_misc_pp on pid 83167' 2021-10-08T19:28:46.208 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83167 2021-10-08T19:28:46.208 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.209 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.209 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2021-10-08T19:28:46.209 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_misc_pp 2021-10-08T19:28:46.209 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_misc_pp.log 2021-10-08T19:28:46.210 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_tier_pp 2021-10-08T19:28:46.210 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_tier_pp' 2021-10-08T19:28:46.210 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_misc_pp: /' 2021-10-08T19:28:46.211 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_tier_pp 2021-10-08T19:28:46.211 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.219 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_tier_pp 2021-10-08T19:28:46.220 INFO:tasks.workunit.client.0.smithi112.stdout:test api_tier_pp on pid 83217 2021-10-08T19:28:46.221 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83217 2021-10-08T19:28:46.221 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_tier_pp on pid 83217' 2021-10-08T19:28:46.221 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83217 2021-10-08T19:28:46.222 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.222 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2021-10-08T19:28:46.222 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.222 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_tier_pp 2021-10-08T19:28:46.224 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_tier_pp: /' 2021-10-08T19:28:46.226 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_tier_pp.log 2021-10-08T19:28:46.227 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_pool 2021-10-08T19:28:46.227 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_pool' 2021-10-08T19:28:46.228 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_pool 2021-10-08T19:28:46.231 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.233 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_pool 2021-10-08T19:28:46.233 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83246 2021-10-08T19:28:46.234 INFO:tasks.workunit.client.0.smithi112.stdout:test api_pool on pid 83246 2021-10-08T19:28:46.236 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_pool on pid 83246' 2021-10-08T19:28:46.236 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2021-10-08T19:28:46.236 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83246 2021-10-08T19:28:46.236 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.237 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.237 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_snapshots 2021-10-08T19:28:46.237 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_snapshots' 2021-10-08T19:28:46.238 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_snapshots 2021-10-08T19:28:46.238 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_pool 2021-10-08T19:28:46.238 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_pool.log 2021-10-08T19:28:46.238 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_pool: /' 2021-10-08T19:28:46.239 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.241 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [==========] Running 11 tests from 4 test suites. 2021-10-08T19:28:46.242 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] Global test environment set-up. 2021-10-08T19:28:46.242 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2021-10-08T19:28:46.242 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2021-10-08T19:28:46.242 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2021-10-08T19:28:46.243 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-10-08T19:28:46.243 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.243 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure 2021-10-08T19:28:46.243 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2021-10-08T19:28:46.244 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 0 2021-10-08T19:28:46.244 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.235+0000 7f796ca9b540 10 monclient: get_monmap_and_config 2021-10-08T19:28:46.244 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.235+0000 7f796ca9b540 10 monclient: build_initial_monmap 2021-10-08T19:28:46.244 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.235+0000 7f796ca9b540 10 monclient: monmap: 2021-10-08T19:28:46.245 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: epoch 0 2021-10-08T19:28:46.245 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: fsid c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:28:46.245 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: last_changed 2021-10-08T19:28:46.236084+0000 2021-10-08T19:28:46.245 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: created 2021-10-08T19:28:46.236084+0000 2021-10-08T19:28:46.246 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: min_mon_release 0 (unknown) 2021-10-08T19:28:46.246 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: election_strategy: 1 2021-10-08T19:28:46.246 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.noname-a 2021-10-08T19:28:46.246 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-b 2021-10-08T19:28:46.247 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.noname-c 2021-10-08T19:28:46.247 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.247 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 Processor -- start 2021-10-08T19:28:46.247 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 -- start start 2021-10-08T19:28:46.248 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.248 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.248 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient: _add_conns ranks=[2,1,0] 2021-10-08T19:28:46.249 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 0x562de5ab7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.249 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5ab8ae0 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.249 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.249 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5ab7d60 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.250 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 0x562de5ac6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.250 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ac4350 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.250 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.250 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ac4350 2021-10-08T19:28:46.251 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.251 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5ab7d60 2021-10-08T19:28:46.251 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.251 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5ab8ae0 2021-10-08T19:28:46.252 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.252 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.758488s 2021-10-08T19:28:46.252 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.252 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.253 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.253 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 msgr2=0x562de5ab7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.253 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 0x562de5ab7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.253 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 msgr2=0x562de5ab8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.254 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.254 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 msgr2=0x562de5ac6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.254 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 0x562de5ac6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.254 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.255 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.255 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.236+0000 7f796ca9b540 10 monclient: _add_conns ranks=[0,1,2] 2021-10-08T19:28:46.255 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 0x562de5ac6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.255 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ac4350 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.255 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.256 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5ab7d60 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.256 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 0x562de5ab7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.256 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5ab8ae0 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.256 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.257 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ac4350 2021-10-08T19:28:46.257 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.257 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5ab7d60 2021-10-08T19:28:46.258 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.258 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5ab8ae0 2021-10-08T19:28:46.258 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.259 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.759078s 2021-10-08T19:28:46.259 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.259 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.259 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.260 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 msgr2=0x562de5ab7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.260 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 0x562de5ab7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.260 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 msgr2=0x562de5ab8130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:28:46.260 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.260 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 msgr2=0x562de5ac6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.261 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 0x562de5ac6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.261 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.261 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.261 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient: _add_conns ranks=[2,1,0] 2021-10-08T19:28:46.262 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 0x562de5ab7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.262 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5ab8ae0 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.262 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.262 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5ab7d60 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.263 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 0x562de5ac6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.263 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ac4350 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.263 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.263 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ac4350 2021-10-08T19:28:46.264 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.264 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5ab7d60 2021-10-08T19:28:46.264 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.264 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5ab8ae0 2021-10-08T19:28:46.265 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.265 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.759500s 2021-10-08T19:28:46.265 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.265 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.266 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.266 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 msgr2=0x562de5ab7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.266 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ab8ae0 0x562de5ab7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.267 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 msgr2=0x562de5ab8130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:28:46.267 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.267 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 msgr2=0x562de5ac6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.267 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 0x562de5ac6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.268 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.268 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.268 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient: _add_conns ranks=[0,2,1] 2021-10-08T19:28:46.268 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 0x562de5ac6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.269 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ac4350 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.269 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac71c0 0x562de5ac7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.269 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5ac71c0 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.269 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.270 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5ab7d60 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.270 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.270 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ac4350 2021-10-08T19:28:46.270 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.271 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5ab7d60 2021-10-08T19:28:46.271 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.271 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5ac71c0 2021-10-08T19:28:46.271 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.759806s 2021-10-08T19:28:46.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac71c0 msgr2=0x562de5ac7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.273 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac71c0 0x562de5ac7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.273 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 msgr2=0x562de5ab8130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:28:46.273 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.273 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 msgr2=0x562de5ac6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac4350 0x562de5ac6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.237+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: _add_conns ranks=[2,0,1] 2021-10-08T19:28:46.275 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac71c0 0x562de5ac7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.275 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5ac71c0 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.275 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 0x562de5a215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.275 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ac7ad0 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.276 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.276 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5ab7d60 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.276 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ac7ad0 2021-10-08T19:28:46.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5ab7d60 2021-10-08T19:28:46.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.278 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5ac71c0 2021-10-08T19:28:46.278 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.278 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.760155s 2021-10-08T19:28:46.278 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.279 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.279 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.279 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac71c0 msgr2=0x562de5ac7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.279 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac71c0 0x562de5ac7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.280 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 msgr2=0x562de5ab8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.280 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.280 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 msgr2=0x562de5a215f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.280 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 0x562de5a215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.281 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.281 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.281 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: _add_conns ranks=[1,0,2] 2021-10-08T19:28:46.281 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.282 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5ab7d60 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.282 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 0x562de5aca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.282 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ac7ad0 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.282 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 0x562de5acb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.282 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5acaee0 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.283 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.283 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ac7ad0 2021-10-08T19:28:46.283 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.283 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5ab7d60 2021-10-08T19:28:46.284 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.284 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5acaee0 2021-10-08T19:28:46.284 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.284 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.760491s 2021-10-08T19:28:46.285 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.285 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.285 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.286 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 msgr2=0x562de5acb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.286 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 0x562de5acb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.286 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 msgr2=0x562de5ab8130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:28:46.286 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ab7d60 0x562de5ab8130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.287 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 msgr2=0x562de5aca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.287 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 0x562de5aca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.287 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.287 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.288 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: _add_conns ranks=[0,2,1] 2021-10-08T19:28:46.288 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 0x562de5ac7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.288 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ac7ad0 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.288 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 0x562de5ac6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.289 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5acaee0 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.289 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 0x562de5a215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.289 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5acb2b0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.289 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.290 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ac7ad0 2021-10-08T19:28:46.290 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.290 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5acb2b0 2021-10-08T19:28:46.290 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5acaee0 2021-10-08T19:28:46.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.760796s 2021-10-08T19:28:46.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.292 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.292 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 msgr2=0x562de5ac6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.292 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 0x562de5ac6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.292 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 msgr2=0x562de5a215f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.293 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 0x562de5a215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.293 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 msgr2=0x562de5ac7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.294 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ac7ad0 0x562de5ac7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.294 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.238+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.295 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.295 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: _add_conns ranks=[2,1,0] 2021-10-08T19:28:46.295 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 0x562de5ac6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.295 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5acaee0 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.296 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 0x562de5acb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.296 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5acb2b0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.296 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 0x562de5acbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.296 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ab81a0 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.296 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.297 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ab81a0 2021-10-08T19:28:46.297 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.297 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5acb2b0 2021-10-08T19:28:46.298 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.298 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5acaee0 2021-10-08T19:28:46.298 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.298 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.761166s 2021-10-08T19:28:46.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 msgr2=0x562de5ac6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5acaee0 0x562de5ac6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.300 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 msgr2=0x562de5acb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.300 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 0x562de5acb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.300 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 msgr2=0x562de5acbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.300 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 0x562de5acbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: _add_conns ranks=[1,0,2] 2021-10-08T19:28:46.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 0x562de5acb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5acb2b0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.302 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 0x562de5aca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.302 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ab81a0 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.302 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac3f70 0x562de5acbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.302 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5ac3f70 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.303 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.303 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ab81a0 2021-10-08T19:28:46.303 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5acb2b0 2021-10-08T19:28:46.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5ac3f70 2021-10-08T19:28:46.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.305 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.761493s 2021-10-08T19:28:46.305 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.305 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.305 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.306 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac3f70 msgr2=0x562de5acbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.306 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac3f70 0x562de5acbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.306 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 msgr2=0x562de5acb900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:28:46.306 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5acb2b0 0x562de5acb900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.307 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 msgr2=0x562de5aca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.307 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 0x562de5aca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.307 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: init 2021-10-08T19:28:46.307 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: _reopen_session rank -1 2021-10-08T19:28:46.308 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: _add_conns ranks=[0,1,2] 2021-10-08T19:28:46.308 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 0x562de5aca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.308 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-a con 0x562de5ab81a0 addr [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2021-10-08T19:28:46.308 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ac7630 0x562de5acc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.309 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-b con 0x562de5ac7630 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2021-10-08T19:28:46.309 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac6740 0x562de5a215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:28:46.309 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): picked mon.noname-c con 0x562de5ac6740 addr [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] 2021-10-08T19:28:46.309 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.310 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de5973940 con 0x562de5ab81a0 2021-10-08T19:28:46.310 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.310 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de59150c0 con 0x562de5ac7630 2021-10-08T19:28:46.310 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): start opening mon connection 2021-10-08T19:28:46.311 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x562de5ac6ed0 con 0x562de5ac6740 2021-10-08T19:28:46.311 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): _renew_subs 2021-10-08T19:28:46.311 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): authenticate will time out at 1699.761793s 2021-10-08T19:28:46.312 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 0 monclient(hunting): authenticate timed out after 1e-09 2021-10-08T19:28:46.312 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient(hunting): shutdown 2021-10-08T19:28:46.312 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-10-08T19:28:46.312 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac6740 msgr2=0x562de5a215f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.313 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac6740 0x562de5a215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.313 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ac7630 msgr2=0x562de5acc380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-10-08T19:28:46.314 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ac7630 0x562de5acc380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.314 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 msgr2=0x562de5aca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-08T19:28:46.314 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 0x562de5aca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.314 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 10 monclient: shutdown 2021-10-08T19:28:46.314 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.239+0000 7f796ca9b540 20 monclient: shutdown discarding 0 pending message(s) 2021-10-08T19:28:46.315 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b540 1 -- shutdown_connections 2021-10-08T19:28:46.315 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562de5ac6740 0x562de5a215f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.315 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562de5ac7630 0x562de5acc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.315 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b540 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562de5ab81a0 0x562de5aca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:28:46.316 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b540 1 -- >> conn(0x562de5ab2a50 msgr2=0x562de5ab4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:28:46.316 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b540 1 -- shutdown_connections 2021-10-08T19:28:46.316 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_snapshots 2021-10-08T19:28:46.317 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b5test api_snapshots on pid 83279 2021-10-08T19:28:46.318 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83279 2021-10-08T19:28:46.319 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_snapshots on pid 83279' 2021-10-08T19:28:46.319 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83279 2021-10-08T19:28:46.319 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2021-10-08T19:28:46.320 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.320 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.320 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_snapshots_pp 2021-10-08T19:28:46.320 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_snapshots_pp' 2021-10-08T19:28:46.321 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_snapshots 2021-10-08T19:28:46.321 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_snapshots.log 2021-10-08T19:28:46.321 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_snapshots: /' 2021-10-08T19:28:46.322 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_snapshots_pp 2021-10-08T19:28:46.322 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.322 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_snapshots_pp 2021-10-08T19:28:46.322 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83294 2021-10-08T19:28:46.323 INFO:tasks.workunit.client.0.smithi112.stdout:test api_snapshots_pp on pid 83294 2021-10-08T19:28:46.324 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:45 smithi142 ceph-mon[33432]: pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:46.325 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_snapshots_pp on pid 83294' 2021-10-08T19:28:46.325 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83294 2021-10-08T19:28:46.326 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.326 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2021-10-08T19:28:46.326 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.327 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_stat 2021-10-08T19:28:46.327 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_stat' 2021-10-08T19:28:46.327 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_stat 2021-10-08T19:28:46.327 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_snapshots_pp 2021-10-08T19:28:46.328 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2021-10-08T19:28:46.328 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_snapshots_pp: /' 2021-10-08T19:28:46.328 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.329 INFO:tasks.workunit.client.0.smithi112.stdout:test api_stat on pid 83309 2021-10-08T19:28:46.330 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_stat 2021-10-08T19:28:46.330 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83309 2021-10-08T19:28:46.331 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_stat on pid 83309' 2021-10-08T19:28:46.331 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83309 2021-10-08T19:28:46.331 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.332 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.332 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2021-10-08T19:28:46.332 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_stat.log 2021-10-08T19:28:46.332 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_stat 2021-10-08T19:28:46.333 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_stat: /' 2021-10-08T19:28:46.333 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_stat_pp 2021-10-08T19:28:46.333 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_stat_pp' 2021-10-08T19:28:46.333 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.333 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_stat_pp 2021-10-08T19:28:46.334 INFO:tasks.workunit.client.0.smithi112.stdout:test api_stat_pp on pid 83339 2021-10-08T19:28:46.335 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_stat_pp 2021-10-08T19:28:46.335 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83339 2021-10-08T19:28:46.335 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_stat_pp on pid 83339' 2021-10-08T19:28:46.336 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83339 2021-10-08T19:28:46.336 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.336 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.336 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_watch_notify 2021-10-08T19:28:46.337 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_watch_notify' 2021-10-08T19:28:46.337 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2021-10-08T19:28:46.337 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_stat_pp 2021-10-08T19:28:46.337 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_stat_pp: /' 2021-10-08T19:28:46.338 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_watch_notify 2021-10-08T19:28:46.338 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.338 INFO:tasks.workunit.client.0.smithi112.stdout:test api_watch_notify on pid 83363 2021-10-08T19:28:46.340 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_watch_notify 2021-10-08T19:28:46.340 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83363 2021-10-08T19:28:46.341 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_watch_notify on pid 83363' 2021-10-08T19:28:46.341 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83363 2021-10-08T19:28:46.341 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.342 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.342 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2021-10-08T19:28:46.342 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_watch_notify_pp 2021-10-08T19:28:46.342 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_watch_notify_pp' 2021-10-08T19:28:46.343 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_stat_pp.log 2021-10-08T19:28:46.343 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_watch_notify 2021-10-08T19:28:46.343 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_watch_notify.log 2021-10-08T19:28:46.343 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_watch_notify: /' 2021-10-08T19:28:46.343 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_watch_notify_pp 2021-10-08T19:28:46.344 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.344 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_watch_notify_pp 2021-10-08T19:28:46.344 INFO:tasks.workunit.client.0.smithi112.stdout:test api_watch_notify_pp on pid 83395 2021-10-08T19:28:46.345 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83395 2021-10-08T19:28:46.346 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_watch_notify_pp on pid 83395' 2021-10-08T19:28:46.346 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83395 2021-10-08T19:28:46.346 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.347 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.347 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2021-10-08T19:28:46.347 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_cmd 2021-10-08T19:28:46.347 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_cmd' 2021-10-08T19:28:46.348 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_cmd 2021-10-08T19:28:46.348 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2021-10-08T19:28:46.348 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.348 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_cmd 2021-10-08T19:28:46.349 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83407 2021-10-08T19:28:46.349 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_cmd on pid 83407' 2021-10-08T19:28:46.350 INFO:tasks.workunit.client.0.smithi112.stdout:test api_cmd on pid 83407 2021-10-08T19:28:46.351 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83407 2021-10-08T19:28:46.351 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.351 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2021-10-08T19:28:46.352 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.352 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_watch_notify_pp 2021-10-08T19:28:46.352 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_cmd 2021-10-08T19:28:46.352 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_cmd_pp 2021-10-08T19:28:46.353 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_cmd_pp' 2021-10-08T19:28:46.353 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_cmd_pp 2021-10-08T19:28:46.353 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.353 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2021-10-08T19:28:46.354 INFO:tasks.workunit.client.0.smithi112.stdout:test api_cmd_pp on pid 83429 2021-10-08T19:28:46.355 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_cmd_pp 2021-10-08T19:28:46.356 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83429 2021-10-08T19:28:46.356 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_cmd_pp on pid 83429' 2021-10-08T19:28:46.356 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83429 2021-10-08T19:28:46.356 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.357 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.357 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_cmd.log 2021-10-08T19:28:46.357 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2021-10-08T19:28:46.358 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_cmd_pp 2021-10-08T19:28:46.358 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_service 2021-10-08T19:28:46.358 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_cmd: /' 2021-10-08T19:28:46.358 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_service' 2021-10-08T19:28:46.359 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2021-10-08T19:28:46.359 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_cmd_pp: /' 2021-10-08T19:28:46.359 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.359 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_service 2021-10-08T19:28:46.360 INFO:tasks.workunit.client.0.smithi112.stdout:test api_service on pid 83474 2021-10-08T19:28:46.361 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_service 2021-10-08T19:28:46.361 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83474 2021-10-08T19:28:46.362 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_service on pid 83474' 2021-10-08T19:28:46.362 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2021-10-08T19:28:46.362 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83474 2021-10-08T19:28:46.363 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.363 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.363 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_service_pp 2021-10-08T19:28:46.363 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_service_pp' 2021-10-08T19:28:46.363 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_service 2021-10-08T19:28:46.364 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_service.log 2021-10-08T19:28:46.364 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_service_pp 2021-10-08T19:28:46.364 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.364 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_service_pp 2021-10-08T19:28:46.365 INFO:tasks.workunit.client.0.smithi112.stdout:test api_service_pp on pid 83505 2021-10-08T19:28:46.366 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_service: /' 2021-10-08T19:28:46.367 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83505 2021-10-08T19:28:46.367 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_service_pp on pid 83505' 2021-10-08T19:28:46.367 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83505 2021-10-08T19:28:46.368 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.368 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.368 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2021-10-08T19:28:46.368 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_c_write_operations 2021-10-08T19:28:46.369 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_c_write_operations' 2021-10-08T19:28:46.369 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_c_write_operations 2021-10-08T19:28:46.369 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_service_pp 2021-10-08T19:28:46.369 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.370 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_service_pp.log 2021-10-08T19:28:46.370 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_service_pp: /' 2021-10-08T19:28:46.370 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_c_write_operations 2021-10-08T19:28:46.370 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83517 2021-10-08T19:28:46.371 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_c_write_operations on pid 83517' 2021-10-08T19:28:46.371 INFO:tasks.workunit.client.0.smithi112.stdout:test api_c_write_operations on pid 83517 2021-10-08T19:28:46.372 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83517 2021-10-08T19:28:46.373 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.373 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.373 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2021-10-08T19:28:46.373 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_c_read_operations 2021-10-08T19:28:46.374 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_c_read_operations' 2021-10-08T19:28:46.374 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.374 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2021-10-08T19:28:46.374 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_c_read_operations 2021-10-08T19:28:46.375 INFO:tasks.workunit.client.0.smithi112.stdout:test api_c_read_operations on pid 83535 2021-10-08T19:28:46.377 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_c_read_operations 2021-10-08T19:28:46.377 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83535 2021-10-08T19:28:46.377 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_c_read_operations on pid 83535' 2021-10-08T19:28:46.377 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83535 2021-10-08T19:28:46.378 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.378 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.378 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2021-10-08T19:28:46.378 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s api_cls_remote_reads 2021-10-08T19:28:46.379 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' api_cls_remote_reads' 2021-10-08T19:28:46.379 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo api_cls_remote_reads 2021-10-08T19:28:46.379 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.379 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_c_write_operations 2021-10-08T19:28:46.379 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_c_read_operations 2021-10-08T19:28:46.380 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2021-10-08T19:28:46.380 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=api_cls_remote_reads 2021-10-08T19:28:46.380 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83543 2021-10-08T19:28:46.380 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test api_cls_remote_reads on pid 83543' 2021-10-08T19:28:46.381 INFO:tasks.workunit.client.0.smithi112.stdout:test api_cls_remote_reads on pid 83543 2021-10-08T19:28:46.382 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83543 2021-10-08T19:28:46.383 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.383 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.383 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2021-10-08T19:28:46.383 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s list_parallel 2021-10-08T19:28:46.384 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' list_parallel' 2021-10-08T19:28:46.384 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.384 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_api_cls_remote_reads 2021-10-08T19:28:46.384 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_c_read_operations: /' 2021-10-08T19:28:46.385 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_c_write_operations: /' 2021-10-08T19:28:46.385 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo list_parallel 2021-10-08T19:28:46.386 INFO:tasks.workunit.client.0.smithi112.stdout:test list_parallel on pid 83562 2021-10-08T19:28:46.387 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=list_parallel 2021-10-08T19:28:46.388 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83562 2021-10-08T19:28:46.388 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test list_parallel on pid 83562' 2021-10-08T19:28:46.388 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83562 2021-10-08T19:28:46.388 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.389 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.389 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2021-10-08T19:28:46.389 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s open_pools_parallel 2021-10-08T19:28:46.389 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' open_pools_parallel' 2021-10-08T19:28:46.390 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_list_parallel 2021-10-08T19:28:46.390 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo open_pools_parallel 2021-10-08T19:28:46.390 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_list_parallel.log 2021-10-08T19:28:46.390 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ list_parallel: /' 2021-10-08T19:28:46.391 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.391 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2021-10-08T19:28:46.391 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2021-10-08T19:28:46.392 INFO:tasks.workunit.client.0.smithi112.stdout:test open_pools_parallel on pid 83597 2021-10-08T19:28:46.393 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=open_pools_parallel 2021-10-08T19:28:46.393 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83597 2021-10-08T19:28:46.393 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test open_pools_parallel on pid 83597' 2021-10-08T19:28:46.393 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83597 2021-10-08T19:28:46.394 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2021-10-08T19:28:46.394 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.394 INFO:tasks.workunit.client.0.smithi112.stderr:++ printf %25s delete_pools_parallel 2021-10-08T19:28:46.395 INFO:tasks.workunit.client.0.smithi112.stderr:+ r=' delete_pools_parallel' 2021-10-08T19:28:46.395 INFO:tasks.workunit.client.0.smithi112.stderr:++ echo delete_pools_parallel 2021-10-08T19:28:46.395 INFO:tasks.workunit.client.0.smithi112.stderr:++ awk '{print $1}' 2021-10-08T19:28:46.395 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2021-10-08T19:28:46.396 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2021-10-08T19:28:46.396 INFO:tasks.workunit.client.0.smithi112.stdout:test delete_pools_parallel on pid 83618 2021-10-08T19:28:46.397 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ open_pools_parallel: /' 2021-10-08T19:28:46.397 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_open_pools_parallel 2021-10-08T19:28:46.398 INFO:tasks.workunit.client.0.smithi112.stderr:+ ff=delete_pools_parallel 2021-10-08T19:28:46.398 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83618 2021-10-08T19:28:46.398 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'test delete_pools_parallel on pid 83618' 2021-10-08T19:28:46.398 INFO:tasks.workunit.client.0.smithi112.stderr:+ pids[$f]=83618 2021-10-08T19:28:46.399 INFO:tasks.workunit.client.0.smithi112.stderr:+ ret=0 2021-10-08T19:28:46.399 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 1 -eq 1 ']' 2021-10-08T19:28:46.399 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:28:46.399 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83279 2021-10-08T19:28:46.399 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83279 2021-10-08T19:28:46.400 INFO:tasks.workunit.client.0.smithi112.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2021-10-08T19:28:46.400 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph_test_rados_delete_pools_parallel 2021-10-08T19:28:46.400 INFO:tasks.workunit.client.0.smithi112.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2021-10-08T19:28:46.400 INFO:tasks.workunit.client.0.smithi112.stderr:+ sed 's/^/ delete_pools_parallel: /' 2021-10-08T19:28:46.772 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:28:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:28:47.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:46 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2491413264' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-10-08T19:28:47.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:46 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2491413264' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-10-08T19:28:47.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:46 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2491413264' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-10-08T19:28:50.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:50.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2745630173' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:50.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1638053304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:50.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:49 smithi142 ceph-mon[33432]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:28:50.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:50.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2745630173' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:50.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1638053304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:50.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:49 smithi112 ceph-mon[40655]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:28:50.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:50.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2745630173' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:50.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1638053304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:50.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:49 smithi112 ceph-mon[31694]: osdmap e70: 8 total, 8 up, 8 in 2021-10-08T19:28:52.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:52.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1322106858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1566344189' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:51 smithi142 ceph-mon[33432]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:28:52.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/980983345' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83049-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83404-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:52.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:52.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1322106858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1566344189' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[40655]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:28:52.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/980983345' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83049-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83404-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:52.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:52.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1322106858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1566344189' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[31694]: osdmap e71: 8 total, 8 up, 8 in 2021-10-08T19:28:52.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/980983345' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83049-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:52.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83404-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:52.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:53.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:53.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: pgmap v80: 388 pgs: 230 creating+peering, 132 active+clean, 26 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:53.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/369336026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1882839993' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: pgmap v82: 612 pgs: 230 creating+peering, 132 active+clean, 250 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:53.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:28:53.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4162286952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/721886468' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2855995392' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83366-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/980983345' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83049-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83404-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:53.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/653681115' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3317420835' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3317980450' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3746657843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3502643217' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:28:53.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:53.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3418189570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83556-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1088669457' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:28:53.059 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2021-10-08T19:28:53.059 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [----------] Global test environment set-up. 2021-10-08T19:28:53.059 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [----------] 12 tests from AsioRados 2021-10-08T19:28:53.060 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2021-10-08T19:28:53.060 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (2 ms) 2021-10-08T19:28:53.060 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2021-10-08T19:28:53.060 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1 ms) 2021-10-08T19:28:53.061 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2021-10-08T19:28:53.061 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (2 ms) 2021-10-08T19:28:53.061 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2021-10-08T19:28:53.061 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (25 ms) 2021-10-08T19:28:53.061 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2021-10-08T19:28:53.062 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (12 ms) 2021-10-08T19:28:53.062 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2021-10-08T19:28:53.062 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (4 ms) 2021-10-08T19:28:53.062 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2021-10-08T19:28:53.063 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2021-10-08T19:28:53.063 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2021-10-08T19:28:53.063 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (2 ms) 2021-10-08T19:28:53.063 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2021-10-08T19:28:53.063 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2021-10-08T19:28:53.064 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2021-10-08T19:28:53.064 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (2 ms) 2021-10-08T19:28:53.064 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2021-10-08T19:28:53.064 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (3 ms) 2021-10-08T19:28:53.065 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2021-10-08T19:28:53.065 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (3 ms) 2021-10-08T19:28:53.065 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [----------] 12 tests from AsioRados (57 ms total) 2021-10-08T19:28:53.065 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: 2021-10-08T19:28:53.065 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [----------] Global test environment tear-down 2021-10-08T19:28:53.066 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (6858 ms total) 2021-10-08T19:28:53.066 INFO:tasks.workunit.client.0.smithi112.stdout: api_asio: [ PASSED ] 12 tests. 2021-10-08T19:28:53.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:53.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:53.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: pgmap v80: 388 pgs: 230 creating+peering, 132 active+clean, 26 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:53.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/369336026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1882839993' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: pgmap v82: 612 pgs: 230 creating+peering, 132 active+clean, 250 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:53.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:28:53.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4162286952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/721886468' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2855995392' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83366-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/980983345' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83049-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83404-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:53.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/653681115' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3317420835' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3317980450' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3746657843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3502643217' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:28:53.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:53.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3418189570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83556-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.079 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.079 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1088669457' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:28:53.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:53.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:53.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: pgmap v80: 388 pgs: 230 creating+peering, 132 active+clean, 26 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:28:53.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/369336026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1882839993' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: pgmap v82: 612 pgs: 230 creating+peering, 132 active+clean, 250 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:28:53.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: osdmap e72: 8 total, 8 up, 8 in 2021-10-08T19:28:53.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4162286952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83126-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/721886468' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2855995392' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83366-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/980983345' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83049-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.084 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83404-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:53.084 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.084 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83311-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.084 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/653681115' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.085 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3317420835' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.085 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3317980450' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.085 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3746657843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.085 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3502643217' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.085 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: osdmap e73: 8 total, 8 up, 8 in 2021-10-08T19:28:53.086 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.086 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:53.086 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.086 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3418189570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83556-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.087 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.087 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.087 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:53.087 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1088669457' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:28:53.364 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2021-10-08T19:28:53.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [----------] Global test environment set-up. 2021-10-08T19:28:53.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [----------] 7 tests from LibRadosList 2021-10-08T19:28:53.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2021-10-08T19:28:53.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosList.ListObjects (275 ms) 2021-10-08T19:28:53.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2021-10-08T19:28:53.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (26 ms) 2021-10-08T19:28:53.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2021-10-08T19:28:53.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: myset foo1,foo2,foo3 2021-10-08T19:28:53.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo1 2021-10-08T19:28:53.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo2 2021-10-08T19:28:53.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo3 2021-10-08T19:28:53.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: myset foo1,foo4,foo5 2021-10-08T19:28:53.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo4 2021-10-08T19:28:53.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo5 2021-10-08T19:28:53.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo1 2021-10-08T19:28:53.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: myset foo6,foo7 2021-10-08T19:28:53.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo7 2021-10-08T19:28:53.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo6 2021-10-08T19:28:53.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-10-08T19:28:53.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns1:foo4 2021-10-08T19:28:53.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns1:foo5 2021-10-08T19:28:53.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns2:foo7 2021-10-08T19:28:53.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns2:foo6 2021-10-08T19:28:53.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns1:foo1 2021-10-08T19:28:53.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: :foo1 2021-10-08T19:28:53.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: :foo2 2021-10-08T19:28:53.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: :foo3 2021-10-08T19:28:53.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (123 ms) 2021-10-08T19:28:53.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2021-10-08T19:28:53.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 1 0 2021-10-08T19:28:53.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 10 0 2021-10-08T19:28:53.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 13 0 2021-10-08T19:28:53.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 7 0 2021-10-08T19:28:53.373 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 14 0 2021-10-08T19:28:53.373 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 0 0 2021-10-08T19:28:53.373 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 15 0 2021-10-08T19:28:53.373 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 11 0 2021-10-08T19:28:53.373 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 5 0 2021-10-08T19:28:53.374 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 8 0 2021-10-08T19:28:53.374 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 6 0 2021-10-08T19:28:53.374 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 3 0 2021-10-08T19:28:53.374 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 4 0 2021-10-08T19:28:53.375 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 12 0 2021-10-08T19:28:53.375 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 9 0 2021-10-08T19:28:53.375 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 2 0 2021-10-08T19:28:53.375 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-10-08T19:28:53.376 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (67 ms) 2021-10-08T19:28:53.376 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2021-10-08T19:28:53.376 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: x cursor=MIN 2021-10-08T19:28:53.376 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=1 cursor=14:02547ec2:::1:head 2021-10-08T19:28:53.377 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=10 cursor=14:52ea6a34:::10:head 2021-10-08T19:28:53.377 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=13 cursor=14:566253c9:::13:head 2021-10-08T19:28:53.377 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=7 cursor=14:5c6b0b28:::7:head 2021-10-08T19:28:53.378 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=14 cursor=14:62a1935d:::14:head 2021-10-08T19:28:53.378 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=0 cursor=14:6cac518f:::0:head 2021-10-08T19:28:53.378 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=15 cursor=14:863748b0:::15:head 2021-10-08T19:28:53.378 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=11 cursor=14:89d3ae78:::11:head 2021-10-08T19:28:53.379 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=5 cursor=14:b29083e3:::5:head 2021-10-08T19:28:53.379 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=8 cursor=14:bd63b0f1:::8:head 2021-10-08T19:28:53.379 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=6 cursor=14:c4fdafeb:::6:head 2021-10-08T19:28:53.379 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=3 cursor=14:cfc208b3:::3:head 2021-10-08T19:28:53.380 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=4 cursor=14:d83876eb:::4:head 2021-10-08T19:28:53.380 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=12 cursor=14:de5d7c5f:::12:head 2021-10-08T19:28:53.380 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=9 cursor=14:e960b815:::9:head 2021-10-08T19:28:53.380 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > oid=2 cursor=14:f905c69b:::2:head 2021-10-08T19:28:53.380 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: FIRST> seek to MIN oid=1 2021-10-08T19:28:53.381 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=1 cursor=14:02547ec2:::1:head 2021-10-08T19:28:53.381 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:02547ec2:::1:head 2021-10-08T19:28:53.381 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:02547ec2:::1:head -> 1 2021-10-08T19:28:53.381 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=10 cursor=14:52ea6a34:::10:head 2021-10-08T19:28:53.382 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:52ea6a34:::10:head 2021-10-08T19:28:53.382 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:52ea6a34:::10:head -> 10 2021-10-08T19:28:53.382 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=13 cursor=14:566253c9:::13:head 2021-10-08T19:28:53.382 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:566253c9:::13:head 2021-10-08T19:28:53.382 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:566253c9:::13:head -> 13 2021-10-08T19:28:53.383 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=7 cursor=14:5c6b0b28:::7:head 2021-10-08T19:28:53.383 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:5c6b0b28:::7:head 2021-10-08T19:28:53.383 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:5c6b0b28:::7:head -> 7 2021-10-08T19:28:53.431 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=14 cursor=14:62a1935d:::14:head 2021-10-08T19:28:53.432 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:62a1935d:::14:head 2021-10-08T19:28:53.432 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:62a1935d:::14:head -> 14 2021-10-08T19:28:53.432 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=0 cursor=14:6cac518f:::0:head 2021-10-08T19:28:53.432 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:6cac518f:::0:head 2021-10-08T19:28:53.433 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:6cac518f:::0:head -> 0 2021-10-08T19:28:53.433 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=15 cursor=14:863748b0:::15:head 2021-10-08T19:28:53.433 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:863748b0:::15:head 2021-10-08T19:28:53.433 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:863748b0:::15:head -> 15 2021-10-08T19:28:53.434 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=11 cursor=14:89d3ae78:::11:head 2021-10-08T19:28:53.434 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:89d3ae78:::11:head 2021-10-08T19:28:53.434 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:89d3ae78:::11:head -> 11 2021-10-08T19:28:53.434 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=5 cursor=14:b29083e3:::5:head 2021-10-08T19:28:53.435 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:b29083e3:::5:head 2021-10-08T19:28:53.435 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:b29083e3:::5:head -> 5 2021-10-08T19:28:53.435 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=8 cursor=14:bd63b0f1:::8:head 2021-10-08T19:28:53.435 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:bd63b0f1:::8:head 2021-10-08T19:28:53.436 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:bd63b0f1:::8:head -> 8 2021-10-08T19:28:53.436 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=6 cursor=14:c4fdafeb:::6:head 2021-10-08T19:28:53.436 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:c4fdafeb:::6:head 2021-10-08T19:28:53.436 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:c4fdafeb:::6:head -> 6 2021-10-08T19:28:53.436 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=3 cursor=14:cfc208b3:::3:head 2021-10-08T19:28:53.437 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:cfc208b3:::3:head 2021-10-08T19:28:53.437 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:cfc208b3:::3:head -> 3 2021-10-08T19:28:53.437 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=4 cursor=14:d83876eb:::4:head 2021-10-08T19:28:53.437 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:d83876eb:::4:head 2021-10-08T19:28:53.438 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:d83876eb:::4:head -> 4 2021-10-08T19:28:53.438 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=12 cursor=14:de5d7c5f:::12:head 2021-10-08T19:28:53.438 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:de5d7c5f:::12:head 2021-10-08T19:28:53.438 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:de5d7c5f:::12:head -> 12 2021-10-08T19:28:53.438 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=9 cursor=14:e960b815:::9:head 2021-10-08T19:28:53.439 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:e960b815:::9:head 2021-10-08T19:28:53.439 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:e960b815:::9:head -> 9 2021-10-08T19:28:53.439 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : oid=2 cursor=14:f905c69b:::2:head 2021-10-08T19:28:53.439 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:f905c69b:::2:head 2021-10-08T19:28:53.439 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:f905c69b:::2:head -> 2 2021-10-08T19:28:53.440 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:863748b0:::15:head 2021-10-08T19:28:53.440 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:863748b0:::15:head expected=14:863748b0:::15:head 2021-10-08T19:28:53.440 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:863748b0:::15:head -> 15 2021-10-08T19:28:53.441 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=15 expected=15 2021-10-08T19:28:53.441 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:f905c69b:::2:head 2021-10-08T19:28:53.441 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:f905c69b:::2:head expected=14:f905c69b:::2:head 2021-10-08T19:28:53.441 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:f905c69b:::2:head -> 2 2021-10-08T19:28:53.441 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=2 expected=2 2021-10-08T19:28:53.442 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:e960b815:::9:head 2021-10-08T19:28:53.442 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:e960b815:::9:head expected=14:e960b815:::9:head 2021-10-08T19:28:53.442 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:e960b815:::9:head -> 9 2021-10-08T19:28:53.442 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=9 expected=9 2021-10-08T19:28:53.443 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:de5d7c5f:::12:head 2021-10-08T19:28:53.443 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:de5d7c5f:::12:head expected=14:de5d7c5f:::12:head 2021-10-08T19:28:53.443 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:de5d7c5f:::12:head -> 12 2021-10-08T19:28:53.443 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=12 expected=12 2021-10-08T19:28:53.444 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:6cac518f:::0:head 2021-10-08T19:28:53.444 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:6cac518f:::0:head expected=14:6cac518f:::0:head 2021-10-08T19:28:53.444 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:6cac518f:::0:head -> 0 2021-10-08T19:28:53.444 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=0 expected=0 2021-10-08T19:28:53.445 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:62a1935d:::14:head 2021-10-08T19:28:53.445 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:62a1935d:::14:head expected=14:62a1935d:::14:head 2021-10-08T19:28:53.445 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:62a1935d:::14:head -> 14 2021-10-08T19:28:53.445 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=14 expected=14 2021-10-08T19:28:53.445 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:5c6b0b28:::7:head 2021-10-08T19:28:53.446 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:5c6b0b28:::7:head expected=14:5c6b0b28:::7:head 2021-10-08T19:28:53.446 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:5c6b0b28:::7:head -> 7 2021-10-08T19:28:53.446 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=7 expected=7 2021-10-08T19:28:53.446 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:02547ec2:::1:head 2021-10-08T19:28:53.447 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:02547ec2:::1:head expected=14:02547ec2:::1:head 2021-10-08T19:28:53.447 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:02547ec2:::1:head -> 1 2021-10-08T19:28:53.522 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:28:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:28:53.574 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : list_parallel: process_1_[83581]: starting. 2021-10-08T19:28:53.574 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_1_[83581]: creating pool ceph_test_rados_list_parallel.smithi112-83564 2021-10-08T19:28:53.575 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_1_[83581]: created object 0... 2021-10-08T19:28:53.575 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_1_[83581]: created object 25... 2021-10-08T19:28:53.575 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_1_[83581]: created object 49... 2021-10-08T19:28:53.575 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_1_[83581]: finishing. 2021-10-08T19:28:53.575 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_1_[83581]: shutting down. 2021-10-08T19:28:53.576 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_2_[83582]: starting. 2021-10-08T19:28:53.576 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_2_[83582]: listing objects. 2021-10-08T19:28:53.577 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_2_[83582]: listed object 0... 2021-10-08T19:28:53.577 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_2_[83582]: listed object 25... 2021-10-08T19:28:53.577 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_2_[83582]: saw 50 objects 2021-10-08T19:28:53.577 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_2_[83582]: shutting down. 2021-10-08T19:28:53.577 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.578 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_3_[84372]: starting. 2021-10-08T19:28:53.578 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_3_[84372]: creating pool ceph_test_rados_list_parallel.smithi112-83564 2021-10-08T19:28:53.578 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_3_[84372]: created object 0... 2021-10-08T19:28:53.578 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_3_[84372]: created object 25... 2021-10-08T19:28:53.579 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_3_[84372]: created object 49... 2021-10-08T19:28:53.579 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_3_[84372]: finishing. 2021-10-08T19:28:53.579 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_3_[84372]: shutting down. 2021-10-08T19:28:53.579 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.579 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_4_[84373]: starting. 2021-10-08T19:28:53.580 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_4_[84373]: listing objects. 2021-10-08T19:28:53.580 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_4_[84373]: listed object 0... 2021-10-08T19:28:53.580 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_4_[84373]: listed object 25... 2021-10-08T19:28:53.580 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_4_[84373]: saw 42 objects 2021-10-08T19:28:53.580 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_4_[84373]: shutting down. 2021-10-08T19:28:53.581 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.581 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_5_[84374]: starting. 2021-10-08T19:28:53.581 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_5_[84374]: removed 25 objects... 2021-10-08T19:28:53.581 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_5_[84374]: removed half of the objects 2021-10-08T19:28:53.582 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_5_[84374]: removed 50 objects... 2021-10-08T19:28:53.582 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_5_[84374]: removed 50 objects 2021-10-08T19:28:53.582 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_5_[84374]: shutting down. 2021-10-08T19:28:53.582 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.583 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.583 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_6_[84420]: starting. 2021-10-08T19:28:53.583 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_6_[84420]: creating pool ceph_test_rados_list_parallel.smithi112-83564 2021-10-08T19:28:53.584 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_6_[84420]: created object 0... 2021-10-08T19:28:53.584 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_6_[84420]: created object 25... 2021-10-08T19:28:53.584 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_6_[84420]: created object 49... 2021-10-08T19:28:53.584 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_6_[84420]: finishing. 2021-10-08T19:28:53.585 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_6_[84420]: shutting down. 2021-10-08T19:28:53.585 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.585 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.585 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_7_[84421]: starting. 2021-10-08T19:28:53.586 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_7_[84421]: listing objects. 2021-10-08T19:28:53.586 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_7_[84421]: listed object 0... 2021-10-08T19:28:53.586 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_7_[84421]: listed object 25... 2021-10-08T19:28:53.586 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_7_[84421]: listed object 50... 2021-10-08T19:28:53.587 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_7_[84421]: listed object 75... 2021-10-08T19:28:53.587 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_7_[84421]: saw 89 objects 2021-10-08T19:28:53.587 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_7_[84421]: shutting down. 2021-10-08T19:28:53.588 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.588 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.588 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_8_[84422]: starting. 2021-10-08T19:28:53.588 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_8_[84422]: added 25 objects... 2021-10-08T19:28:53.588 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_8_[84422]: added half of the objects 2021-10-08T19:28:53.589 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_8_[84422]: added 50 objects... 2021-10-08T19:28:53.589 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_8_[84422]: added 50 objects 2021-10-08T19:28:53.589 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_8_[84422]: shutting down. 2021-10-08T19:28:53.589 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:53.783 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:28:53.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:53.783 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:28:53.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:28:53.783 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:28:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:28:53.505Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:28:53.784 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: pgmap v84: 868 pgs: 230 creating+peering, 132 active+clean, 506 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 902 B/s rd, 0 op/s 2021-10-08T19:28:53.784 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.785 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.785 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.785 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.785 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.786 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4162286952' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83126-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:53.826 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: *************** api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2021-10-08T19:28:53.827 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2021-10-08T19:28:53.827 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2021-10-08T19:28:53.827 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2021-10-08T19:28:53.827 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (7449 ms) 2021-10-08T19:28:53.828 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (7449 ms total) 2021-10-08T19:28:53.828 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: 2021-10-08T19:28:53.828 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2021-10-08T19:28:53.828 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (7449 ms total) 2021-10-08T19:28:53.828 INFO:tasks.workunit.client.0.smithi112.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2021-10-08T19:28:53.891 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: Running main() from gmock_main.cc 2021-10-08T19:28:53.891 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [==========] Running 16 tests from 1 test suite. 2021-10-08T19:28:53.891 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [----------] Global test environment set-up. 2021-10-08T19:28:53.892 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest 2021-10-08T19:28:53.892 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2021-10-08T19:28:53.892 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2021-10-08T19:28:53.892 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2021-10-08T19:28:53.893 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (8 ms) 2021-10-08T19:28:53.893 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2021-10-08T19:28:53.893 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (15 ms) 2021-10-08T19:28:53.893 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2021-10-08T19:28:53.893 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (18 ms) 2021-10-08T19:28:53.894 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2021-10-08T19:28:53.894 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (16 ms) 2021-10-08T19:28:53.895 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2021-10-08T19:28:53.895 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (9 ms) 2021-10-08T19:28:53.895 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2021-10-08T19:28:53.895 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (6 ms) 2021-10-08T19:28:53.896 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2021-10-08T19:28:53.896 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (3 ms) 2021-10-08T19:28:53.896 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2021-10-08T19:28:53.896 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (8 ms) 2021-10-08T19:28:53.896 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2021-10-08T19:28:53.897 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (3 ms) 2021-10-08T19:28:53.897 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2021-10-08T19:28:53.897 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (4 ms) 2021-10-08T19:28:53.898 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2021-10-08T19:28:53.898 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (6 ms) 2021-10-08T19:28:53.898 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2021-10-08T19:28:53.898 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (9 ms) 2021-10-08T19:28:53.899 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2021-10-08T19:28:53.899 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (10 ms) 2021-10-08T19:28:53.899 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2021-10-08T19:28:53.899 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (7 ms) 2021-10-08T19:28:53.900 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2021-10-08T19:28:53.900 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (6 ms) 2021-10-08T19:28:53.900 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest (130 ms total) 2021-10-08T19:28:53.900 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: 2021-10-08T19:28:53.900 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [----------] Global test environment tear-down 2021-10-08T19:28:53.901 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [==========] 16 tests from 1 test suite ran. (7536 ms total) 2021-10-08T19:28:53.901 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_read_operations: [ PASSED ] 16 tests. 2021-10-08T19:28:54.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: pgmap v84: 868 pgs: 230 creating+peering, 132 active+clean, 506 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 902 B/s rd, 0 op/s 2021-10-08T19:28:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4162286952' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83126-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/721886468' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2855995392' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83366-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1264746582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2900417176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3418189570' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83556-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.079 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:28:54.079 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.079 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.080 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:54.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/721886468' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2855995392' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83366-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1264746582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2900417176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3418189570' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83556-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:28:54.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.084 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:54.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: pgmap v84: 868 pgs: 230 creating+peering, 132 active+clean, 506 unknown; 582 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 902 B/s rd, 0 op/s 2021-10-08T19:28:54.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83081-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83057-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4162286952' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83126-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/721886468' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2855995392' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83366-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1264746582' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2900417176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3418189570' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83556-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83359-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83540-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:54.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: osdmap e74: 8 total, 8 up, 8 in 2021-10-08T19:28:54.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:54.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:54.534 INFO:tasks.workunit.client.0.smithi112.stdout:**************** 2021-10-08T19:28:54.534 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.535 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_9_[84470]: starting. 2021-10-08T19:28:54.535 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_9_[84470]: creating pool ceph_test_rados_list_parallel.smithi112-83564 2021-10-08T19:28:54.537 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_9_[84470]: created object 0... 2021-10-08T19:28:54.537 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_9_[84470]: created object 25... 2021-10-08T19:28:54.538 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_9_[84470]: created object 49... 2021-10-08T19:28:54.538 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_9_[84470]: finishing. 2021-10-08T19:28:54.538 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_9_[84470]: shutting down. 2021-10-08T19:28:54.539 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.539 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.539 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.539 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_13_[84474]: starting. 2021-10-08T19:28:54.539 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_13_[84474]: removed 25 objects... 2021-10-08T19:28:54.540 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_13_[84474]: removed half of the objects 2021-10-08T19:28:54.540 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_13_[84474]: removed 50 objects... 2021-10-08T19:28:54.540 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_13_[84474]: removed 50 objects 2021-10-08T19:28:54.541 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_13_[84474]: shutting down. 2021-10-08T19:28:54.541 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.541 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.541 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.542 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_10_[84471]: starting. 2021-10-08T19:28:54.542 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_10_[84471]: listing objects. 2021-10-08T19:28:54.542 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_10_[84471]: listed object 0... 2021-10-08T19:28:54.542 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_10_[84471]: listed object 25... 2021-10-08T19:28:54.543 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_10_[84471]: listed object 50... 2021-10-08T19:28:54.543 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_10_[84471]: saw 55 objects 2021-10-08T19:28:54.543 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_10_[84471]: shutting down. 2021-10-08T19:28:54.544 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.545 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.545 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.546 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_12_[84473]: starting. 2021-10-08T19:28:54.546 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_12_[84473]: added 25 objects... 2021-10-08T19:28:54.546 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_12_[84473]: added half of the objects 2021-10-08T19:28:54.546 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_12_[84473]: added 50 objects... 2021-10-08T19:28:54.546 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_12_[84473]: added 50 objects 2021-10-08T19:28:54.547 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_12_[84473]: shutting down. 2021-10-08T19:28:54.547 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.547 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.547 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.548 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_11_[84472]: starting. 2021-10-08T19:28:54.548 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_11_[84472]: added 25 objects... 2021-10-08T19:28:54.548 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_11_[84472]: added half of the objects 2021-10-08T19:28:54.548 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_11_[84472]: added 50 objects... 2021-10-08T19:28:54.548 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_11_[84472]: added 50 objects 2021-10-08T19:28:54.549 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_11_[84472]: shutting down. 2021-10-08T19:28:54.549 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.549 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.549 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.550 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.551 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_14_[84733]: starting. 2021-10-08T19:28:54.551 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_14_[84733]: creating pool ceph_test_rados_list_parallel.smithi112-83564 2021-10-08T19:28:54.551 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_14_[84733]: created object 0... 2021-10-08T19:28:54.551 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_14_[84733]: created object 25... 2021-10-08T19:28:54.552 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_14_[84733]: created object 49... 2021-10-08T19:28:54.552 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_14_[84733]: finishing. 2021-10-08T19:28:54.552 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_14_[84733]: shutting down. 2021-10-08T19:28:54.552 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.552 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.553 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.553 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:54.553 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: starting. 2021-10-08T19:28:54.553 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: listing objects. 2021-10-08T19:28:54.553 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: listed object 0... 2021-10-08T19:28:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:28:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:28:55] "GET /metrics HTTP/1.1" 200 178498 "" "Prometheus/2.18.1" 2021-10-08T19:28:55.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:28:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:28:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:55.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:28:55.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:28:55.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:55.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:55.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:28:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: osdmap e75: 8 total, 8 up, 8 in 2021-10-08T19:28:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:55.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:55.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:55.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:55.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:55.995 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: listed object 25... 2021-10-08T19:28:55.995 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: listed object 50... 2021-10-08T19:28:55.996 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: listed object 75... 2021-10-08T19:28:55.996 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: listed object 100... 2021-10-08T19:28:55.996 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: listed object 125... 2021-10-08T19:28:55.996 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: saw 150 objects 2021-10-08T19:28:55.997 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_15_[84734]: shutting down. 2021-10-08T19:28:55.997 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:55.997 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:55.997 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:55.998 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:55.998 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_16_[84735]: starting. 2021-10-08T19:28:55.998 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_16_[84735]: added 25 objects... 2021-10-08T19:28:55.998 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_16_[84735]: added half of the objects 2021-10-08T19:28:55.998 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_16_[84735]: added 50 objects... 2021-10-08T19:28:55.999 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_16_[84735]: added 50 objects 2021-10-08T19:28:55.999 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: process_16_[84735]: shutting down. 2021-10-08T19:28:55.999 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:55.999 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:56.000 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:56.000 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:56.000 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******************************* 2021-10-08T19:28:56.000 INFO:tasks.workunit.client.0.smithi112.stdout: list_parallel: ******* SUCCESS ********** 2021-10-08T19:28:56.006 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: Running main() from gmock_main.cc 2021-10-08T19:28:56.007 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2021-10-08T19:28:56.007 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [----------] Global test environment set-up. 2021-10-08T19:28:56.007 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2021-10-08T19:28:56.007 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2021-10-08T19:28:56.007 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (674 ms) 2021-10-08T19:28:56.008 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2021-10-08T19:28:56.008 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (2865 ms) 2021-10-08T19:28:56.008 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2021-10-08T19:28:56.008 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (6157 ms) 2021-10-08T19:28:56.009 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (9696 ms total) 2021-10-08T19:28:56.009 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: 2021-10-08T19:28:56.009 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [----------] Global test environment tear-down 2021-10-08T19:28:56.009 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (9696 ms total) 2021-10-08T19:28:56.009 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2021-10-08T19:28:56.288 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: Running main() from gmock_main.cc 2021-10-08T19:28:56.288 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2021-10-08T19:28:56.288 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [----------] Global test environment set-up. 2021-10-08T19:28:56.288 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2021-10-08T19:28:56.289 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2021-10-08T19:28:56.289 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (35 ms) 2021-10-08T19:28:56.289 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2021-10-08T19:28:56.289 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (40 ms) 2021-10-08T19:28:56.290 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2021-10-08T19:28:56.290 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (9634 ms) 2021-10-08T19:28:56.290 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2021-10-08T19:28:56.290 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:53.796148+0000 mon.a [INF] from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:28:56.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:53.796277+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83452-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:53.796383+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83409-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:53.805355+0000 mon.b [INF] from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:53.820847+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.291 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:53.838982+0000 mon.a [INF] from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.292 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:53.901806+0000 mon.b [INF] from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.292 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.441546+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.292 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.442960+0000 mon.b [INF] from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.292 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.704203+0000 mon.a [INF] from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.293 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.704407+0000 mon.a [INF] from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.293 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.971827+0000 mon.a [INF] from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.293 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.971954+0000 mon.a [INF] from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.293 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.972074+0000 mon.a [INF] from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.293 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.980270+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.294 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.980389+0000 mon.a [INF] from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.294 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:54.989062+0000 mon.c [INF] from='client.? 172.21.15.112:0/3457400653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.294 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.276330+0000 mon.a [INF] from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.294 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.276527+0000 mon.a [INF] from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83057-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.295 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.276784+0000 mon.a [INF] from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83311-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.295 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.277258+0000 mon.a [INF] from='client.? 172.21.15.112:0/1674622474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.295 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.277433+0000 mon.a [INF] from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83049-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.295 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.282291+0000 mon.a [INF] from='client.? 172.21.15.112:0/3334045684' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.296 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.548463+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.296 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.549292+0000 mon.b [INF] from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.296 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.798801+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:28:56.297 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.799675+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:28:56.297 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.800343+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:28:56.298 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.801866+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:28:56.298 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.802312+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.298 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.802528+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:28:56.298 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.803049+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:28:56.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.803623+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:28:56.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.804206+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:28:56.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.804871+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:28:56.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.805450+0000 mon.a [INF] from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:28:56.299 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.806624+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.300 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.980356+0000 mon.a [INF] from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83057-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.300 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.980433+0000 mon.a [INF] from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83311-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.300 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.980494+0000 mon.a [INF] from='client.? 172.21.15.112:0/1674622474' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.980559+0000 mon.a [INF] from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83049-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.980619+0000 mon.a [INF] from='client.? 172.21.15.112:0/3334045684' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.980886+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.981009+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.301 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.982822+0000 mon.a [INF] from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83057-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.302 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.983399+0000 mon.a [INF] from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83311-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.302 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.985409+0000 mon.a [INF] from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:56.302 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.987719+0000 mon.b [INF] from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.302 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:55.992234+0000 mon.b [INF] from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.303 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.001566+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.303 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.001771+0000 mon.a [INF] from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.303 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.001990+0000 mon.a [INF] from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83049-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.303 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.002428+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.055189+0000 mon.c [INF] from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:28:56.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.058463+0000 client.admin [INF] onexx 2021-10-08T19:28:56.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.058798+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:28:56.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.059899+0000 mon.a [INF] from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:56.304 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.062646+0000 mon.a [INF] from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:56.305 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.063646+0000 mon.a [INF] from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83126-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: pgmap v87: 652 pgs: 96 creating+peering, 484 active+clean, 72 unknown; 593 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 69 KiB/s wr, 229 op/s 2021-10-08T19:28:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4082032199' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:28:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3457400653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:28:56.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83057-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83311-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1674622474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83049-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3334045684' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:56.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: pgmap v87: 652 pgs: 96 creating+peering, 484 active+clean, 72 unknown; 593 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 69 KiB/s wr, 229 op/s 2021-10-08T19:28:56.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4082032199' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:28:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3457400653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:28:56.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83057-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83311-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1674622474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83049-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3334045684' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:56.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:28:56.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:28:56.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:28:56.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:28:56.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:28:56.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:28:56.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:28:56.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:28:56.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:28:56.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:28:56.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:28:56.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:28:56.585 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:28:56.585 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:28:56.585 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:28:56.585 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:28:56.585 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:28:56.586 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:28:56.586 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:28:56.586 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:28:56.586 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.587 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83057-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.587 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83311-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.588 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:28:56.588 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:28:56.588 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:28:56.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:28:56.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:28:56.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:28:56.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:28:56.589 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:28:56.590 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.590 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:28:56.590 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:28:56.590 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:28:56.591 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:28:56.591 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:28:56.591 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:28:56.591 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:28:56.592 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:28:56.592 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:28:56.592 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:28:56.592 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:28:56.593 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:28:56.593 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.593 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83057-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.593 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83311-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.594 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1674622474' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.594 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83049-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.594 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3334045684' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.594 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.595 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.595 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:28:56.595 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83057-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.595 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83311-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.595 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:56.596 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.596 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.596 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.597 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.597 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83049-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.597 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.597 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:28:56.598 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: onexx 2021-10-08T19:28:56.598 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:28:56.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:56.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:56.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83126-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.599 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.600 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.600 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.600 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.600 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.601 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.601 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1674622474' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.601 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83049-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.602 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3334045684' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.602 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.602 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.602 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:28:56.603 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83057-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.603 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83311-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.603 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:56.603 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.604 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.604 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.604 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.604 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83049-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.605 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.605 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:28:56.605 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: onexx 2021-10-08T19:28:56.605 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:28:56.606 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:56.606 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:56.606 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83126-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.606 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.607 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:28:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:28:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: pgmap v87: 652 pgs: 96 creating+peering, 484 active+clean, 72 unknown; 593 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 69 KiB/s wr, 229 op/s 2021-10-08T19:28:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4082032199' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2021-10-08T19:28:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3457400653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: osdmap e76: 8 total, 8 up, 8 in 2021-10-08T19:28:56.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83057-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83311-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1674622474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83049-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3334045684' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:56.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.779 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.779 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:28:56.780 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:28:56.780 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:28:56.780 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:28:56.780 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:28:56.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:28:56.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:28:56.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:28:56.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:28:56.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:28:56.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:28:56.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:28:56.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:28:56.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:28:56.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:28:56.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:28:56.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:28:56.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:28:56.784 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:28:56.784 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:28:56.784 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.784 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83057-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.785 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83311-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.785 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1674622474' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.785 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83049-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.785 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3334045684' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.785 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:56.786 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83359-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:56.786 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: osdmap e77: 8 total, 8 up, 8 in 2021-10-08T19:28:56.786 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83057-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:28:56.786 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83311-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:28:56.787 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:56.787 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.787 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.788 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.788 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:28:56.788 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83049-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:28:56.788 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:28:56.789 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:28:56.789 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: onexx 2021-10-08T19:28:56.789 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-10-08T19:28:56.789 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:56.790 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:56.790 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83126-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.790 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.790 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.790 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.791 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:56.791 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:56.791 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:28:58.007 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.070580+0000 mon.c [INF] from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rado open_pools_parallel: process_1_[83643]: starting. 2021-10-08T19:28:58.008 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_1_[83643]: creating pool ceph_test_rados_open_pools_parallel.smithi112-83610 2021-10-08T19:28:58.008 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_1_[83643]: created object 0... 2021-10-08T19:28:58.008 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_1_[83643]: created object 25... 2021-10-08T19:28:58.008 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_1_[83643]: created object 49... 2021-10-08T19:28:58.008 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_1_[83643]: finishing. 2021-10-08T19:28:58.009 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_1_[83643]: shutting down. 2021-10-08T19:28:58.009 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_2_[83646]: starting. 2021-10-08T19:28:58.009 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_2_[83646]: rados_pool_create. 2021-10-08T19:28:58.009 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_2_[83646]: rados_ioctx_create. 2021-10-08T19:28:58.010 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_2_[83646]: shutting down. 2021-10-08T19:28:58.010 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: ******************************* 2021-10-08T19:28:58.010 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_3_[84553]: starting. 2021-10-08T19:28:58.010 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_3_[84553]: creating pool ceph_test_rados_open_pools_parallel.smithi112-83610 2021-10-08T19:28:58.011 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_3_[84553]: created object 0... 2021-10-08T19:28:58.011 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_3_[84553]: created object 25... 2021-10-08T19:28:58.011 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_3_[84553]: created object 49... 2021-10-08T19:28:58.011 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_3_[84553]: finishing. 2021-10-08T19:28:58.011 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_3_[84553]: shutting down. 2021-10-08T19:28:58.012 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: ******************************* 2021-10-08T19:28:58.012 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_4_[84555]: starting. 2021-10-08T19:28:58.012 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_4_[84555]: rados_pool_create. 2021-10-08T19:28:58.012 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_4_[84555]: rados_ioctx_create. 2021-10-08T19:28:58.012 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: process_4_[84555]: shutting down. 2021-10-08T19:28:58.013 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: ******************************* 2021-10-08T19:28:58.013 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: ******************************* 2021-10-08T19:28:58.013 INFO:tasks.workunit.client.0.smithi112.stdout: open_pools_parallel: ******* SUCCESS ********** 2021-10-08T19:28:58.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:58 smithi142 ceph-mon[33432]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:58.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-10-08T19:28:58.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:28:58.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:58 smithi142 ceph-mon[33432]: twoxx 2021-10-08T19:28:58.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:28:58.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[40655]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-10-08T19:28:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:28:58.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[40655]: twoxx 2021-10-08T19:28:58.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:28:58.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[31694]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:28:58.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-10-08T19:28:58.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:28:58.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[31694]: twoxx 2021-10-08T19:28:58.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-10-08T19:28:58.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:59.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: Running main() from gmock_main.cc 2021-10-08T19:28:59.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2021-10-08T19:28:59.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [----------] Global test environment set-up. 2021-10-08T19:28:59.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2021-10-08T19:28:59.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: seed 83057 2021-10-08T19:28:59.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2021-10-08T19:28:59.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2021-10-08T19:28:59.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2021-10-08T19:28:59.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (233 ms) 2021-10-08T19:28:59.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2021-10-08T19:28:59.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (11 ms) 2021-10-08T19:28:59.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2021-10-08T19:28:59.114 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (4 ms) 2021-10-08T19:28:59.114 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2021-10-08T19:28:59.114 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (3 ms) 2021-10-08T19:28:59.114 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2021-10-08T19:28:59.114 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (3 ms) 2021-10-08T19:28:59.115 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2021-10-08T19:28:59.115 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (5 ms) 2021-10-08T19:28:59.115 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2021-10-08T19:28:59.116 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (5 ms) 2021-10-08T19:28:59.117 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2021-10-08T19:28:59.117 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (5 ms) 2021-10-08T19:28:59.117 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2021-10-08T19:28:59.118 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (4 ms) 2021-10-08T19:28:59.118 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2021-10-08T19:28:59.118 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (5 ms) 2021-10-08T19:28:59.118 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2021-10-08T19:28:59.119 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (5 ms) 2021-10-08T19:28:59.119 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2021-10-08T19:28:59.119 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (4 ms) 2021-10-08T19:28:59.119 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2021-10-08T19:28:59.119 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (4 ms) 2021-10-08T19:28:59.121 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2021-10-08T19:28:59.122 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (4 ms) 2021-10-08T19:28:59.122 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2021-10-08T19:28:59.123 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (10 ms) 2021-10-08T19:28:59.123 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2021-10-08T19:28:59.124 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (5 ms) 2021-10-08T19:28:59.124 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2021-10-08T19:28:59.125 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (6 ms) 2021-10-08T19:28:59.125 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2021-10-08T19:28:59.125 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (4 ms) 2021-10-08T19:28:59.125 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2021-10-08T19:28:59.126 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (6 ms) 2021-10-08T19:28:59.126 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (326 ms total) 2021-10-08T19:28:59.126 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: 2021-10-08T19:28:59.127 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2021-10-08T19:28:59.127 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2021-10-08T19:28:59.128 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1054 ms) 2021-10-08T19:28:59.128 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2021-10-08T19:28:59.128 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (13 ms) 2021-10-08T19:28:59.129 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2021-10-08T19:28:59.129 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (2 ms) 2021-10-08T19:28:59.129 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2021-10-08T19:28:59.129 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (5 ms) 2021-10-08T19:28:59.129 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2021-10-08T19:28:59.130 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (4 ms) 2021-10-08T19:28:59.550 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] delete_pools_parallel: process_1_[83644]: starting. 2021-10-08T19:28:59.551 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_1_[83644]: creating pool ceph_test_rados_delete_pools_parallel.smithi112-83626 2021-10-08T19:28:59.551 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_1_[83644]: created object 0... 2021-10-08T19:28:59.551 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_1_[83644]: created object 25... 2021-10-08T19:28:59.552 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_1_[83644]: created object 49... 2021-10-08T19:28:59.552 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_1_[83644]: finishing. 2021-10-08T19:28:59.553 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_1_[83644]: shutting down. 2021-10-08T19:28:59.553 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_2_[83647]: starting. 2021-10-08T19:28:59.554 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_2_[83647]: deleting pool ceph_test_rados_delete_pools_parallel.smithi112-83626 2021-10-08T19:28:59.554 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_2_[83647]: shutting down. 2021-10-08T19:28:59.555 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:59.555 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_3_[84551]: starting. 2021-10-08T19:28:59.556 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_3_[84551]: creating pool ceph_test_rados_delete_pools_parallel.smithi112-83626 2021-10-08T19:28:59.556 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_3_[84551]: created object 0... 2021-10-08T19:28:59.556 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_3_[84551]: created object 25... 2021-10-08T19:28:59.557 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_3_[84551]: created object 49... 2021-10-08T19:28:59.557 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_3_[84551]: finishing. 2021-10-08T19:28:59.557 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_3_[84551]: shutting down. 2021-10-08T19:28:59.558 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:59.558 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_5_[84554]: starting. 2021-10-08T19:28:59.559 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_5_[84554]: listing objects. 2021-10-08T19:28:59.559 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_5_[84554]: listed object 0... 2021-10-08T19:28:59.560 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_5_[84554]: listed object 25... 2021-10-08T19:28:59.560 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_5_[84554]: saw 50 objects 2021-10-08T19:28:59.560 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_5_[84554]: shutting down. 2021-10-08T19:28:59.561 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:59.561 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_4_[84552]: starting. 2021-10-08T19:28:59.561 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_4_[84552]: deleting pool ceph_test_rados_delete_pools_parallel.smithi112-83626 2021-10-08T19:28:59.561 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: process_4_[84552]: shutting down. 2021-10-08T19:28:59.562 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:59.562 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: ******************************* 2021-10-08T19:28:59.562 INFO:tasks.workunit.client.0.smithi112.stdout: delete_pools_parallel: ******* SUCCESS ********** 2021-10-08T19:28:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: 18.3 deep-scrub ok 2021-10-08T19:28:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: pgmap v90: 676 pgs: 32 creating+peering, 356 active+clean, 288 unknown; 586 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 21 KiB/s wr, 185 op/s 2021-10-08T19:28:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: 18.7 deep-scrub ok 2021-10-08T19:28:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:28:59.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:28:59.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:59.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: 18.0 deep-scrub ok 2021-10-08T19:28:59.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83126-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:59.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:59.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:28:59.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:59.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:59.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83126-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:59.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-10-08T19:28:59.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83057-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:28:59.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83311-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:28:59.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:28:59.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: 18.3 deep-scrub ok 2021-10-08T19:28:59.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: pgmap v90: 676 pgs: 32 creating+peering, 356 active+clean, 288 unknown; 586 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 21 KiB/s wr, 185 op/s 2021-10-08T19:28:59.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: 18.7 deep-scrub ok 2021-10-08T19:28:59.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:28:59.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:28:59.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:28:59.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:59.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: 18.0 deep-scrub ok 2021-10-08T19:28:59.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83126-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:59.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:28:59.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:28:59.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:59.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:28:59.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83126-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:28:59.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-10-08T19:28:59.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83057-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:28:59.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83311-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:28:59.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83049-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:28:59.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:28:59.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:28:59.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi112-83041-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-10-08T19:28:59.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:28:59.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:59.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:28:59.835 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83049-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:28:59.835 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:28:59.835 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:28:59.836 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi112-83041-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-10-08T19:28:59.836 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:28:59.836 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:28:59.836 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:28:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:00.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: 18.3 deep-scrub ok 2021-10-08T19:29:00.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: pgmap v90: 676 pgs: 32 creating+peering, 356 active+clean, 288 unknown; 586 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 21 KiB/s wr, 185 op/s 2021-10-08T19:29:00.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: 18.7 deep-scrub ok 2021-10-08T19:29:00.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:29:00.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: 18.0 deep-scrub ok 2021-10-08T19:29:00.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83126-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:00.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:00.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: osdmap e78: 8 total, 8 up, 8 in 2021-10-08T19:29:00.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:00.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:29:00.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83126-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:29:00.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-10-08T19:29:00.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83057-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:29:00.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83311-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:29:00.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83049-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:29:00.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:29:00.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: osdmap e79: 8 total, 8 up, 8 in 2021-10-08T19:29:00.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi112-83041-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-10-08T19:29:00.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:00.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:28:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.030 INFO:tasks.workunit.client.0.smithi112.stdout:s-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:00.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.071396+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:00.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.075546+0000 mon.c [INF] from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:00.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.075899+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:00.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.100701+0000 mon.c [INF] from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:00.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:56.103483+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:00.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:57.495282+0000 mon.a [INF] from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:29:00.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:57.495424+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:57.495510+0000 mon.a [INF] from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:57.496738+0000 mon.b [INF] from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.001639+0000 mon.a [INF] from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83126-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:00.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.001755+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83081-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:00.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.002628+0000 mon.c [INF] from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:00.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.008229+0000 mon.a [INF] from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]: dispatch 2021-10-08T19:29:00.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.008585+0000 mon.a [INF] from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83126-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:29:00.556 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.015874+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-10-08T19:29:00.557 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.016417+0000 mon.a [INF] from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83057-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:29:00.557 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.016484+0000 mon.a [INF] from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83311-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:29:00.557 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.016545+0000 mon.a [INF] from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83049-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:29:00.557 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.016607+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83359-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:29:00.557 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.025777+0000 mon.a [INF] from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi112-83041-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-10-08T19:29:00.558 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.027401+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.558 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:58.033288+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:00.558 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.028755+0000 mon.a [INF] from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:29:00.558 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.298968+0000 mon.a [INF] from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi112-83041-3", "field": "max_bytes", "val": "4096"}]': finished 2021-10-08T19:29:00.559 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.299035+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:00.559 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.300029+0000 mon.b [INF] from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.559 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.545446+0000 mon.c [INF] from='client.? 172.21.15.112:0/1880884855' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.559 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.545587+0000 mon.b [INF] from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.560 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.545729+0000 mon.c [INF] from='client.? 172.21.15.112:0/930611008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.560 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.550049+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.560 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.550420+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.560 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.550806+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.560 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.551022+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.561 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.556990+0000 mon.a [INF] from='client.? 172.21.15.112:0/587303899' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.561 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.979394+0000 mon.a [INF] from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83126-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:00.561 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.979480+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:00.561 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.979941+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:00.561 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.980010+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.562 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.980072+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.562 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.980130+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.562 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.980208+0000 mon.a [INF] from='client.? 172.21.15.112:0/587303899' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.562 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.983621+0000 mon.b [INF] from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:29:00.563 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.985078+0000 mon.a [INF] from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:29:00.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: pgmap v93: 548 pgs: 32 creating+peering, 516 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 286 op/s 2021-10-08T19:29:00.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:29:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi112-83041-3", "field": "max_bytes", "val": "4096"}]': finished 2021-10-08T19:29:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:29:00.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1880884855' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/930611008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/587303899' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: 18.2 deep-scrub ok 2021-10-08T19:29:00.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83126-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:00.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:00.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: pgmap v93: 548 pgs: 32 creating+peering, 516 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 286 op/s 2021-10-08T19:29:00.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:29:00.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi112-83041-3", "field": "max_bytes", "val": "4096"}]': finished 2021-10-08T19:29:00.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:00.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:29:00.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1880884855' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/930611008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:00.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/587303899' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: 18.2 deep-scrub ok 2021-10-08T19:29:00.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83126-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:00.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:00.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:00.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/587303899' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:29:00.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:29:00.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:29:00.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:29:00.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:29:00.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:00.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:29:00.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:00.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:29:00.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: threexx 2021-10-08T19:29:00.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:29:00.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-10-08T19:29:00.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:00.837 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:00.837 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.838 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.838 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.838 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/587303899' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:00.838 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:29:00.838 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:29:00.839 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:29:00.839 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:29:00.839 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:29:00.839 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.840 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:00.840 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:29:00.840 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:00.840 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.840 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:29:00.841 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: threexx 2021-10-08T19:29:00.841 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:29:00.841 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-10-08T19:29:00.841 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.842 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:00.842 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:01.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: pgmap v93: 548 pgs: 32 creating+peering, 516 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 286 op/s 2021-10-08T19:29:01.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/283625004' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83404-1"}]': finished 2021-10-08T19:29:01.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3192251587' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi112-83041-3", "field": "max_bytes", "val": "4096"}]': finished 2021-10-08T19:29:01.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:01.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:01.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:01.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: osdmap e80: 8 total, 8 up, 8 in 2021-10-08T19:29:01.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1880884855' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/930611008' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:01.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/587303899' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: 18.2 deep-scrub ok 2021-10-08T19:29:01.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83126-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:01.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83081-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:01.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-4", "overlaypool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:01.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:01.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:01.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:01.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/587303899' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:01.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: osdmap e81: 8 total, 8 up, 8 in 2021-10-08T19:29:01.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:29:01.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:29:01.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:29:01.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:29:01.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:01.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:29:01.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:01.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:29:01.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: threexx 2021-10-08T19:29:01.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:29:01.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-10-08T19:29:01.032 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.033 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:01.033 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:02.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.986078+0000 mon.a [INF] from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": " api_io: Running main() from gmock_main.cc 2021-10-08T19:29:02.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2021-10-08T19:29:02.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [----------] Global test environment set-up. 2021-10-08T19:29:02.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [----------] 14 tests from LibRadosIo 2021-10-08T19:29:02.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2021-10-08T19:29:02.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (468 ms) 2021-10-08T19:29:02.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2021-10-08T19:29:02.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2021-10-08T19:29:02.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2021-10-08T19:29:02.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: no timeout :/ 2021-10-08T19:29:02.080 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: no timeout :/ 2021-10-08T19:29:02.080 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: no timeout :/ 2021-10-08T19:29:02.080 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: no timeout :/ 2021-10-08T19:29:02.080 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: no timeout :/ 2021-10-08T19:29:02.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (119 ms) 2021-10-08T19:29:02.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2021-10-08T19:29:02.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (8 ms) 2021-10-08T19:29:02.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2021-10-08T19:29:02.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.Checksum (5 ms) 2021-10-08T19:29:02.082 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2021-10-08T19:29:02.082 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (5 ms) 2021-10-08T19:29:02.082 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2021-10-08T19:29:02.082 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (5 ms) 2021-10-08T19:29:02.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2021-10-08T19:29:02.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (5 ms) 2021-10-08T19:29:02.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2021-10-08T19:29:02.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (4 ms) 2021-10-08T19:29:02.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2021-10-08T19:29:02.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.TruncTest (5 ms) 2021-10-08T19:29:02.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2021-10-08T19:29:02.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (9 ms) 2021-10-08T19:29:02.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2021-10-08T19:29:02.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (3 ms) 2021-10-08T19:29:02.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2021-10-08T19:29:02.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.RmXattr (10 ms) 2021-10-08T19:29:02.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2021-10-08T19:29:02.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIo.XattrIter (6 ms) 2021-10-08T19:29:02.086 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [----------] 14 tests from LibRadosIo (653 ms total) 2021-10-08T19:29:02.086 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: 2021-10-08T19:29:02.086 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2021-10-08T19:29:02.086 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2021-10-08T19:29:02.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (802 ms) 2021-10-08T19:29:02.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2021-10-08T19:29:02.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (7 ms) 2021-10-08T19:29:02.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2021-10-08T19:29:02.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (4 ms) 2021-10-08T19:29:02.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2021-10-08T19:29:02.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (6 ms) 2021-10-08T19:29:02.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2021-10-08T19:29:02.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (6 ms) 2021-10-08T19:29:02.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2021-10-08T19:29:02.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2021-10-08T19:29:02.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2021-10-08T19:29:02.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (4 ms) 2021-10-08T19:29:02.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2021-10-08T19:29:02.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (4 ms) 2021-10-08T19:29:02.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2021-10-08T19:29:02.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (11 ms) 2021-10-08T19:29:02.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2021-10-08T19:29:02.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (7 ms) 2021-10-08T19:29:02.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [----------] 10 tests from LibRadosIoEC (855 ms total) 2021-10-08T19:29:02.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: 2021-10-08T19:29:02.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [------- LibRadosIoECPP.OverlappingWriteRoundTripPP 2021-10-08T19:29:02.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (4 ms) 2021-10-08T19:29:02.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2021-10-08T19:29:02.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (4 ms) 2021-10-08T19:29:02.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2021-10-08T19:29:02.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3 ms) 2021-10-08T19:29:02.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2021-10-08T19:29:02.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (4 ms) 2021-10-08T19:29:02.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2021-10-08T19:29:02.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (5 ms) 2021-10-08T19:29:02.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2021-10-08T19:29:02.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (3 ms) 2021-10-08T19:29:02.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2021-10-08T19:29:02.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (4 ms) 2021-10-08T19:29:02.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2021-10-08T19:29:02.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (10 ms) 2021-10-08T19:29:02.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2021-10-08T19:29:02.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (4 ms) 2021-10-08T19:29:02.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2021-10-08T19:29:02.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (6 ms) 2021-10-08T19:29:02.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2021-10-08T19:29:02.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (3 ms) 2021-10-08T19:29:02.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2021-10-08T19:29:02.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (7 ms) 2021-10-08T19:29:02.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1135 ms total) 2021-10-08T19:29:02.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: 2021-10-08T19:29:02.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [----------] Global test environment tear-down 2021-10-08T19:29:02.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (15905 ms total) 2021-10-08T19:29:02.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_io_pp: [ PASSED ] 37 tests. 2021-10-08T19:29:02.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: Running main() from gmock_main.cc 2021-10-08T19:29:02.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [==========] Running 8 tests from 2 test suites. 2021-10-08T19:29:02.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [----------] Global test environment set-up. 2021-10-08T19:29:02.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [----------] 4 tests from LibRadosStat 2021-10-08T19:29:02.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2021-10-08T19:29:02.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ OK ] LibRadosStat.Stat (1221 ms) 2021-10-08T19:29:02.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2021-10-08T19:29:02.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ OK ] LibRadosStat.StatNS (14 ms) 2021-10-08T19:29:02.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2021-10-08T19:29:02.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (1 ms) 2021-10-08T19:29:02.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2021-10-08T19:29:02.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (4 ms) 2021-10-08T19:29:02.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [----------] 4 tests from LibRadosStat (1240 ms total) 2021-10-08T19:29:02.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: 2021-10-08T19:29:02.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2021-10-08T19:29:02.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2021-10-08T19:29:02.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1057 ms) 2021-10-08T19:29:02.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2021-10-08T19:29:02.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (9 ms) 2021-10-08T19:29:02.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2021-10-08T19:29:02.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (454 ms) 2021-10-08T19:29:02.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2021-10-08T19:29:02.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (10 ms) 2021-10-08T19:29:02.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1530 ms total) 2021-10-08T19:29:02.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: 2021-10-08T19:29:02.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [----------] Global test environment tear-down 2021-10-08T19:29:02.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [==========] 8 tests from 2 test suites ran. (15808 ms total) 2021-10-08T19:29:02.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat: [ PASSED ] 8 tests. 2021-10-08T19:29:02.105 INFO:tasks.workunit.client.0.smithi112.stdout:---] Global test environment tear-down 2021-10-08T19:29:02.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [==========] 24 tests from 2 test suites ran. (15911 ms total) 2021-10-08T19:29:02.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_io: [ PASSED ] 24 tests. 2021-10-08T19:29:02.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: Running main() from gmock_main.cc 2021-10-08T19:29:02.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2021-10-08T19:29:02.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [----------] Global test environment set-up. 2021-10-08T19:29:02.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2021-10-08T19:29:02.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: seed 83359 2021-10-08T19:29:02.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2021-10-08T19:29:02.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (5 ms) 2021-10-08T19:29:02.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2021-10-08T19:29:02.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (4 ms) 2021-10-08T19:29:02.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2021-10-08T19:29:02.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2021-10-08T19:29:02.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2021-10-08T19:29:02.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (20 ms) 2021-10-08T19:29:02.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2021-10-08T19:29:02.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (27 ms) 2021-10-08T19:29:02.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (56 ms total) 2021-10-08T19:29:02.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: 2021-10-08T19:29:02.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2021-10-08T19:29:02.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2021-10-08T19:29:02.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1042 ms) 2021-10-08T19:29:02.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2021-10-08T19:29:02.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2021-10-08T19:29:02.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2021-10-08T19:29:02.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (3 ms) 2021-10-08T19:29:02.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2021-10-08T19:29:02.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (8 ms) 2021-10-08T19:29:02.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1054 ms total) 2021-10-08T19:29:02.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: 2021-10-08T19:29:02.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [----------] Global test environment tear-down 2021-10-08T19:29:02.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (15814 ms total) 2021-10-08T19:29:02.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_stat_pp: [ PASSED ] 9 tests. 2021-10-08T19:29:02.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:02 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:29:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:02.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-10-08T19:29:02.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:29:02.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: fourxx 2021-10-08T19:29:02.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:29:02.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: 18.8 deep-scrub ok 2021-10-08T19:29:02.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:02.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:29:02.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:29:02.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:29:02.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]': finished 2021-10-08T19:29:02.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:29:02.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:29:02.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:02.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:02.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:29:02.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:29:02.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:29:02.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2"}]: dispatch 2021-10-08T19:29:02.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:02.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:02.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]: dispatch 2021-10-08T19:29:02.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]: dispatch 2021-10-08T19:29:02.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]: dispatch 2021-10-08T19:29:02.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:02.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-10-08T19:29:02.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:29:02.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: fourxx 2021-10-08T19:29:02.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:29:02.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: 18.8 deep-scrub ok 2021-10-08T19:29:02.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:02.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:29:02.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:29:02.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:29:02.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]': finished 2021-10-08T19:29:02.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:29:02.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:29:02.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:02.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:02.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:29:02.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:29:02.333 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:29:02.333 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2"}]: dispatch 2021-10-08T19:29:02.333 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:02.333 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:02.334 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]: dispatch 2021-10-08T19:29:02.334 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]: dispatch 2021-10-08T19:29:02.334 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]: dispatch 2021-10-08T19:29:02.334 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-10-08T19:29:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:29:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: fourxx 2021-10-08T19:29:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-10-08T19:29:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: 18.8 deep-scrub ok 2021-10-08T19:29:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:02.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:29:02.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:29:02.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:29:02.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]': finished 2021-10-08T19:29:02.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:29:02.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:02.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: osdmap e82: 8 total, 8 up, 8 in 2021-10-08T19:29:02.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:02.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:02.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]: dispatch 2021-10-08T19:29:02.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:29:02.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:29:02.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2"}]: dispatch 2021-10-08T19:29:02.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:02.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:02.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]: dispatch 2021-10-08T19:29:02.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]: dispatch 2021-10-08T19:29:02.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]: dispatch 2021-10-08T19:29:02.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: pgmap v96: 660 pgs: 176 unknown, 484 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 364 op/s 2021-10-08T19:29:03.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]: dispatch 2021-10-08T19:29:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-10-08T19:29:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:29:03.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:29:03.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:29:03.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:29:03.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:03.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]': finished 2021-10-08T19:29:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:29:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:03.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/73476955' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4272869314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3037479437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:29:03.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:29:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:03.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-10-08T19:29:03.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:03.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:03.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: pgmap v96: 660 pgs: 176 unknown, 484 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 364 op/s 2021-10-08T19:29:03.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]: dispatch 2021-10-08T19:29:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-10-08T19:29:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:29:03.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:29:03.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:29:03.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:29:03.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:03.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]': finished 2021-10-08T19:29:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:29:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:03.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/73476955' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4272869314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:03.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3037479437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:29:03.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:29:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:03.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-10-08T19:29:03.332 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:03.333 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:03.333 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:29:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:03.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: pgmap v96: 660 pgs: 176 unknown, 484 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 364 op/s 2021-10-08T19:29:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]: dispatch 2021-10-08T19:29:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-10-08T19:29:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83359-7"}]': finished 2021-10-08T19:29:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3052661289' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83049-16"}]': finished 2021-10-08T19:29:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83057-22"}]': finished 2021-10-08T19:29:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3436957946' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83311-6"}]': finished 2021-10-08T19:29:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83404-6", "pg_num": 4}]': finished 2021-10-08T19:29:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: osdmap e83: 8 total, 8 up, 8 in 2021-10-08T19:29:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:03.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/73476955' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4272869314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:03.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3037479437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:03.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:29:03.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:29:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:03.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-10-08T19:29:03.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:03.531 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:03.531 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:03.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:03.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:03.505Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:29:04.093 INFO:tasks.workunit.client.0.smithi112.stdout:osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83311-6"}]: dispatch 2021-10-08T19:29:04.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.987587+0000 mon.a [INF] from='client.? 172.21.15.112:0/3039438743' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83057-22"}]: dispatch 2021-10-08T19:29:04.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.995960+0000 mon.c [INF] from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:04.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.996982+0000 mon.b [INF] from='client.? 172.21.15.112:0/1006418828' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:04.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.999005+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-4-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:29:04.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:28:59.999298+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83359-7"}]: dispatch 2021-10-08T19:29:04.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:29:00.005956+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83404-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:04.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:29:00.026507+0000 mon.c [INF] from='client.? 172.21.15.112:0/2602965069' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:29:04.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:29:00.027346+0000 client.admin [INF] threexx 2021-10-08T19:29:04.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:29:00.027616+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-10-08T19:29:04.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:29:00.073153+0000 mon.b [INF] from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:04.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: got: 2021-10-08T19:29:00.073294+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83163-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:04.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8084 ms) 2021-10-08T19:29:04.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (17793 ms total) 2021-10-08T19:29:04.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: 2021-10-08T19:29:04.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [----------] Global test environment tear-down 2021-10-08T19:29:04.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (17793 ms total) 2021-10-08T19:29:04.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_cmd: [ PASSED ] 4 tests. 2021-10-08T19:29:04.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: pgmap v99: 664 pgs: 180 unknown, 484 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:04.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]': finished 2021-10-08T19:29:04.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:04.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/73476955' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:29:04.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:29:04.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:04.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:04.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:04.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:04.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:04.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:04.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:04.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:04 smithi142 ceph-mon[33432]: 18.6 deep-scrub ok 2021-10-08T19:29:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: pgmap v99: 664 pgs: 180 unknown, 484 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]': finished 2021-10-08T19:29:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/73476955' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:29:04.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:29:04.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:04.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:04.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:04.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:04.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:04.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:04.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:04.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[40655]: 18.6 deep-scrub ok 2021-10-08T19:29:04.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: pgmap v99: 664 pgs: 180 unknown, 484 active+clean; 145 MiB data, 597 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:04.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-4"}]': finished 2021-10-08T19:29:04.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:04.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/73476955' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:04.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:29:04.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: osdmap e84: 8 total, 8 up, 8 in 2021-10-08T19:29:04.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/25371422' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:04.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:04.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]: dispatch 2021-10-08T19:29:04.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:04.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:04.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:29:04.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:04.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:04 smithi112 ceph-mon[31694]: 18.6 deep-scrub ok 2021-10-08T19:29:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: 18.5 deep-scrub ok 2021-10-08T19:29:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]': finished 2021-10-08T19:29:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:29:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:29:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:29:05.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]: dispatch 2021-10-08T19:29:05.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:05.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1367308186' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:05.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:05.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:05.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]: dispatch 2021-10-08T19:29:05.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:05.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:05.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:05.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:05.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:05.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:05.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]': finished 2021-10-08T19:29:05.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:29:05.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:05.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:29:05.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:29:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:05] "GET /metrics HTTP/1.1" 200 178498 "" "Prometheus/2.18.1" 2021-10-08T19:29:05.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: 18.5 deep-scrub ok 2021-10-08T19:29:05.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:05.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:05.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]': finished 2021-10-08T19:29:05.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:29:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:29:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:29:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]: dispatch 2021-10-08T19:29:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1367308186' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:05.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:05.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:05.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]: dispatch 2021-10-08T19:29:05.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:05.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:05.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:05.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:05.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:05.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:05.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]': finished 2021-10-08T19:29:05.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:29:05.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:05.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:29:05.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:29:05.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: 18.5 deep-scrub ok 2021-10-08T19:29:05.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:05.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-4", "tierpool": "test-rados-api-smithi112-83223-4-cache"}]': finished 2021-10-08T19:29:05.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83404-4", "overlaypool": "test-rados-api-smithi112-83404-6"}]': finished 2021-10-08T19:29:05.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:29:05.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: osdmap e85: 8 total, 8 up, 8 in 2021-10-08T19:29:05.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:29:05.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]: dispatch 2021-10-08T19:29:05.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:05.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1367308186' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:05.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:05.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4189254809' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:05.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]: dispatch 2021-10-08T19:29:05.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:29:05.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:05.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:05.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:05.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:05.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83282-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:05.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83404-6", "mode": "writeback"}]': finished 2021-10-08T19:29:05.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83163-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:29:05.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:05.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: osdmap e86: 8 total, 8 up, 8 in 2021-10-08T19:29:05.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]: dispatch 2021-10-08T19:29:06.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: Running main() from gmock_main.cc 2021-10-08T19:29:06.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2021-10-08T19:29:06.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [----------] Global test environment set-up. 2021-10-08T19:29:06.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2021-10-08T19:29:06.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: seed 83126 2021-10-08T19:29:06.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2021-10-08T19:29:06.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (13 ms) 2021-10-08T19:29:06.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2021-10-08T19:29:06.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (12 ms) 2021-10-08T19:29:06.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2021-10-08T19:29:06.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1011 ms) 2021-10-08T19:29:06.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2021-10-08T19:29:06.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1012 ms) 2021-10-08T19:29:06.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2021-10-08T19:29:06.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (4 ms) 2021-10-08T19:29:06.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2021-10-08T19:29:06.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (4 ms) 2021-10-08T19:29:06.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2021-10-08T19:29:06.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (4 ms) 2021-10-08T19:29:06.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2021-10-08T19:29:06.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (3 ms) 2021-10-08T19:29:06.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2064 ms total) 2021-10-08T19:29:06.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: 2021-10-08T19:29:06.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2021-10-08T19:29:06.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2021-10-08T19:29:06.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1054 ms) 2021-10-08T19:29:06.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2021-10-08T19:29:06.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (21 ms) 2021-10-08T19:29:06.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2021-10-08T19:29:06.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1025 ms) 2021-10-08T19:29:06.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2021-10-08T19:29:06.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1059 ms) 2021-10-08T19:29:06.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2021-10-08T19:29:06.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (5 ms) 2021-10-08T19:29:06.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2021-10-08T19:29:06.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (4 ms) 2021-10-08T19:29:06.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2021-10-08T19:29:06.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (5 ms) 2021-10-08T19:29:06.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2021-10-08T19:29:06.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (3 ms) 2021-10-08T19:29:06.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3176 ms total) 2021-10-08T19:29:06.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: 2021-10-08T19:29:06.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [----------] Global test environment tear-down 2021-10-08T19:29:06.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (19886 ms total) 2021-10-08T19:29:06.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock_pp: [ PASSED ] 16 tests. 2021-10-08T19:29:06.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: Running main() from gmock_main.cc 2021-10-08T19:29:06.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2021-10-08T19:29:06.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [----------] Global test environment set-up. 2021-10-08T19:29:06.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [----------] 8 tests from LibRadosLock 2021-10-08T19:29:06.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2021-10-08T19:29:06.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (167 ms) 2021-10-08T19:29:06.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2021-10-08T19:29:06.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLock.LockShared (51 ms) 2021-10-08T19:29:06.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2021-10-08T19:29:06.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1081 ms) 2021-10-08T19:29:06.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2021-10-08T19:29:06.114 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1046 ms) 2021-10-08T19:29:06.114 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2021-10-08T19:29:06.115 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (5 ms) 2021-10-08T19:29:06.115 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2021-10-08T19:29:06.115 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLock.Unlock (9 ms) 2021-10-08T19:29:06.116 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2021-10-08T19:29:06.116 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (14 ms) 2021-10-08T19:29:06.116 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2021-10-08T19:29:06.117 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (8 ms) 2021-10-08T19:29:06.117 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [----------] 8 tests from LibRadosLock (2381 ms total) 2021-10-08T19:29:06.118 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: 2021-10-08T19:29:06.118 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2021-10-08T19:29:06.118 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2021-10-08T19:29:06.119 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1043 ms) 2021-10-08T19:29:06.119 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2021-10-08T19:29:06.120 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (3 ms) 2021-10-08T19:29:06.120 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2021-10-08T19:29:06.121 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1034 ms) 2021-10-08T19:29:06.121 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2021-10-08T19:29:06.122 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1027 ms) 2021-10-08T19:29:06.122 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2021-10-08T19:29:06.122 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (17 ms) 2021-10-08T19:29:06.123 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2021-10-08T19:29:06.123 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (21 ms) 2021-10-08T19:29:06.123 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2021-10-08T19:29:06.124 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (6 ms) 2021-10-08T19:29:06.124 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2021-10-08T19:29:06.124 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (3 ms) 2021-10-08T19:29:06.125 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3154 ms total) 2021-10-08T19:29:06.125 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: 2021-10-08T19:29:06.126 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [----------] Global test environment tear-down 2021-10-08T19:29:06.126 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (19908 ms total) 2021-10-08T19:29:06.126 INFO:tasks.workunit.client.0.smithi112.stdout: api_lock: [ PASSED ] 16 tests. 2021-10-08T19:29:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: pgmap v102: 552 pgs: 32 unknown, 520 active+clean; 145 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 8.0 KiB/s wr, 6 op/s 2021-10-08T19:29:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/591156774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2453798067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:06.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:06.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:06.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:06.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:06.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:06.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:06.529 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:29:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:29:06.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:29:06.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: pgmap v102: 552 pgs: 32 unknown, 520 active+clean; 145 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 8.0 KiB/s wr, 6 op/s 2021-10-08T19:29:06.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/591156774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2453798067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:06.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:06.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:06.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:06.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:06.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:06.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: pgmap v102: 552 pgs: 32 unknown, 520 active+clean; 145 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 8.0 KiB/s wr, 6 op/s 2021-10-08T19:29:06.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/716730797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:06.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/591156774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2453798067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]: dispatch 2021-10-08T19:29:06.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:06.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:06.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:06.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2485892974' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83126-10"}]': finished 2021-10-08T19:29:06.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83081-10"}]': finished 2021-10-08T19:29:06.583 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:06.583 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:06.583 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83366-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:06.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:29:06.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.585 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: osdmap e87: 8 total, 8 up, 8 in 2021-10-08T19:29:06.585 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:06.585 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:07 smithi142 ceph-mon[33432]: pgmap v105: 520 pgs: 96 unknown, 424 active+clean; 145 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2021-10-08T19:29:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:07 smithi142 ceph-mon[33432]: 18.9 deep-scrub ok 2021-10-08T19:29:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:07 smithi142 ceph-mon[33432]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:29:07.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:07.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[31694]: pgmap v105: 520 pgs: 96 unknown, 424 active+clean; 145 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2021-10-08T19:29:07.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[31694]: 18.9 deep-scrub ok 2021-10-08T19:29:07.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[31694]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:29:07.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:07.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:07.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[40655]: pgmap v105: 520 pgs: 96 unknown, 424 active+clean; 145 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2021-10-08T19:29:07.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[40655]: 18.9 deep-scrub ok 2021-10-08T19:29:07.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:07 smithi112 ceph-mon[40655]: osdmap e88: 8 total, 8 up, 8 in 2021-10-08T19:29:08.197 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2021-10-08T19:29:08.198 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2021-10-08T19:29:08.198 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2021-10-08T19:29:08.198 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2021-10-08T19:29:08.198 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2021-10-08T19:29:08.199 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: notify 2021-10-08T19:29:08.199 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1249 ms) 2021-10-08T19:29:08.199 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2021-10-08T19:29:08.199 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (4 ms) 2021-10-08T19:29:08.200 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1253 ms total) 2021-10-08T19:29:08.200 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: 2021-10-08T19:29:08.200 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2021-10-08T19:29:08.201 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2021-10-08T19:29:08.201 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: notify 2021-10-08T19:29:08.201 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (65 ms) 2021-10-08T19:29:08.201 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2021-10-08T19:29:08.201 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: notify 2021-10-08T19:29:08.202 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4100 ms) 2021-10-08T19:29:08.202 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2021-10-08T19:29:08.202 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (6 ms) 2021-10-08T19:29:08.202 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2021-10-08T19:29:08.203 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (4 ms) 2021-10-08T19:29:08.203 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2021-10-08T19:29:08.204 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982298768 notify_id 369367187457 notifier_gid 25120 2021-10-08T19:29:08.204 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (4 ms) 2021-10-08T19:29:08.204 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2021-10-08T19:29:08.204 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982314240 notify_id 369367187460 notifier_gid 25120 2021-10-08T19:29:08.205 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (6 ms) 2021-10-08T19:29:08.205 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2021-10-08T19:29:08.205 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982314240 notify_id 369367187458 notifier_gid 25120 2021-10-08T19:29:08.205 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (5 ms) 2021-10-08T19:29:08.206 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2021-10-08T19:29:08.206 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982314240 notify_id 369367187461 notifier_gid 25120 2021-10-08T19:29:08.206 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (5 ms) 2021-10-08T19:29:08.207 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2021-10-08T19:29:08.207 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982314240 notify_id 369367187462 notifier_gid 25120 2021-10-08T19:29:08.207 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (4 ms) 2021-10-08T19:29:08.207 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2021-10-08T19:29:08.207 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982314240 notify_id 369367187463 notifier_gid 25120 2021-10-08T19:29:08.208 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (4 ms) 2021-10-08T19:29:08.208 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2021-10-08T19:29:08.208 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: trying... 2021-10-08T19:29:08.208 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982314240 notify_id 369367187459 notifier_gid 25120 2021-10-08T19:29:08.209 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: timed out 2021-10-08T19:29:08.209 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: flushing 2021-10-08T19:29:09.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3180663090' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:09.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:09.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:09.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:08 smithi142 ceph-mon[33432]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:29:09.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2432203191' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3180663090' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:09.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:09.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:09.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[40655]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:29:09.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2432203191' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3180663090' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:09.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83366-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:09.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:09.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[31694]: osdmap e89: 8 total, 8 up, 8 in 2021-10-08T19:29:09.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2432203191' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:09.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: pgmap v108: 496 pgs: 72 creating+peering, 424 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2021-10-08T19:29:10.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:29:10.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3225256953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2591453920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: pgmap v108: 496 pgs: 72 creating+peering, 424 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2021-10-08T19:29:10.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:29:10.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3225256953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2591453920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: pgmap v108: 496 pgs: 72 creating+peering, 424 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2 op/s 2021-10-08T19:29:10.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:10.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: osdmap e90: 8 total, 8 up, 8 in 2021-10-08T19:29:10.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3225256953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2591453920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:10.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:10.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:11.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: pool 'test-rados-api-smithi112-83041-3' is full (reached quota's max_bytes: 4 KiB) 2021-10-08T19:29:11.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:29:11.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:11.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:11.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:29:11.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:11.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:11.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:11.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:11.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: 18.1 deep-scrub ok 2021-10-08T19:29:11.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:11.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: pool 'test-rados-api-smithi112-83041-3' is full (reached quota's max_bytes: 4 KiB) 2021-10-08T19:29:11.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:29:11.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:11.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:11.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:29:11.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:11.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:11.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:11.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:11.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: 18.1 deep-scrub ok 2021-10-08T19:29:11.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:11.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: pool 'test-rados-api-smithi112-83041-3' is full (reached quota's max_bytes: 4 KiB) 2021-10-08T19:29:11.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:29:11.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:11.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83299-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:11.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: osdmap e91: 8 total, 8 up, 8 in 2021-10-08T19:29:11.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:11.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:11.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:11.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:11.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: 18.1 deep-scrub ok 2021-10-08T19:29:11.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:12.073 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch api_watch_notify: Running main() from gmock_main.cc 2021-10-08T19:29:12.073 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2021-10-08T19:29:12.073 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [----------] Global test environment set-up. 2021-10-08T19:29:12.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2021-10-08T19:29:12.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2021-10-08T19:29:12.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify_test_cb 2021-10-08T19:29:12.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (38 ms) 2021-10-08T19:29:12.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2021-10-08T19:29:12.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-10-08T19:29:12.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94886917210864 err -107 2021-10-08T19:29:12.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1006 ms) 2021-10-08T19:29:12.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2021-10-08T19:29:12.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-10-08T19:29:12.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94886917222816 err -107 2021-10-08T19:29:12.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1008 ms) 2021-10-08T19:29:12.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2021-10-08T19:29:12.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_cb from 14820 notify_id 326417514496 cookie 94886917228816 2021-10-08T19:29:12.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (5 ms) 2021-10-08T19:29:12.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2021-10-08T19:29:12.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_cb from 14820 notify_id 326417514497 cookie 94886917245664 2021-10-08T19:29:12.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (5 ms) 2021-10-08T19:29:12.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2021-10-08T19:29:12.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_cb from 14820 notify_id 326417514498 cookie 94886917245664 2021-10-08T19:29:12.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (6 ms) 2021-10-08T19:29:12.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2021-10-08T19:29:12.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_cb from 14820 notify_id 326417514497 cookie 94886917245664 2021-10-08T19:29:12.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_cb from 14820 notify_id 326417514497 cookie 94886917282304 2021-10-08T19:29:12.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (6 ms) 2021-10-08T19:29:12.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2021-10-08T19:29:12.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_cb from 14820 notify_id 326417514499 cookie 94886917245664 2021-10-08T19:29:12.080 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_cb from 14820 notify_id 330712481796 cookie 94886917245664 2021-10-08T19:29:12.080 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3004 ms) 2021-10-08T19:29:12.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2021-10-08T19:29:12.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: waiting up to 64 for osd to time us out ... 2021-10-08T19:29:12.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94886917245664 err -107 2021-10-08T19:29:12.081 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_cb from 14820 notify_id 360777252867 cookie 94886917245664 2021-10-08T19:29:12.082 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5007 ms) 2021-10-08T19:29:12.082 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2021-10-08T19:29:12.082 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2021-10-08T19:29:12.082 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94886917295936 err -107 2021-10-08T19:29:12.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1004 ms) 2021-10-08T19:29:12.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11089 ms total) 2021-10-08T19:29:12.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: 2021-10-08T19:29:12.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2021-10-08T19:29:12.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2021-10-08T19:29:12.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: watch_notify_test_cb 2021-10-08T19:29:12.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1257 ms) 2021-10-08T19:29:12.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1257 ms total) 2021-10-08T19:29:12.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: 2021-10-08T19:29:12.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [----------] Global test environment tear-down 2021-10-08T19:29:12.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (25785 ms total) 2021-10-08T19:29:12.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify: [ PASSED ] 11 tests. 2021-10-08T19:29:12.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: pgmap v111: 552 pgs: 96 unknown, 32 creating+peering, 424 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2021-10-08T19:29:12.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:12.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:12.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: osdmap e92: 8 total, 8 up, 8 in 2021-10-08T19:29:12.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:12.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:12.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/595698798' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:12.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:12.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:12.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:11 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:12.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: pgmap v111: 552 pgs: 96 unknown, 32 creating+peering, 424 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2021-10-08T19:29:12.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:12.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:12.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: osdmap e92: 8 total, 8 up, 8 in 2021-10-08T19:29:12.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:12.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:12.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/595698798' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:12.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:12.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:12.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:11 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:12.334 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:11 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:29:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:12.335 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: pgmap v111: 552 pgs: 96 unknown, 32 creating+peering, 424 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2021-10-08T19:29:12.335 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:12.335 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:12.336 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: osdmap e92: 8 total, 8 up, 8 in 2021-10-08T19:29:12.336 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4293901235' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:12.336 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]: dispatch 2021-10-08T19:29:12.336 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/595698798' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.336 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:12.337 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:12.337 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:12.337 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:12.337 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:12 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:13.507 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:29:13.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:29:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:13.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:13.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:13.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:13.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: osdmap e93: 8 total, 8 up, 8 in 2021-10-08T19:29:13.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:13.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/603891702' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1635606341' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.510 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:13.510 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.510 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.510 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:13.511 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:13.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:13.511 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:13.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:13.511 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:13.505Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:29:13.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:29:13.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:29:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:13.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:13.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:13.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:13.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: osdmap e93: 8 total, 8 up, 8 in 2021-10-08T19:29:13.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:13.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/603891702' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1635606341' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:13.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:13.522 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:29:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:29:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:29:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83366-12"}]': finished 2021-10-08T19:29:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: osdmap e93: 8 total, 8 up, 8 in 2021-10-08T19:29:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/603891702' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1635606341' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:13.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:14.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: Running main() from gmock_main.cc 2021-10-08T19:29:14.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2021-10-08T19:29:14.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [----------] Global test environment set-up. 2021-10-08T19:29:14.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2021-10-08T19:29:14.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2021-10-08T19:29:14.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2021-10-08T19:29:14.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2021-10-08T19:29:14.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: 2021-10-08T19:29:14.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2021-10-08T19:29:14.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2021-10-08T19:29:14.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (7496 ms) 2021-10-08T19:29:14.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2021-10-08T19:29:14.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (4166 ms) 2021-10-08T19:29:14.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2021-10-08T19:29:14.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (2991 ms) 2021-10-08T19:29:14.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2021-10-08T19:29:14.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3085 ms) 2021-10-08T19:29:14.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2021-10-08T19:29:14.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3373 ms) 2021-10-08T19:29:14.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2021-10-08T19:29:14.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3548 ms) 2021-10-08T19:29:14.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2021-10-08T19:29:14.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (3080 ms) 2021-10-08T19:29:14.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (27740 ms total) 2021-10-08T19:29:14.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: 2021-10-08T19:29:14.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [----------] Global test environment tear-down 2021-10-08T19:29:14.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (27740 ms total) 2021-10-08T19:29:14.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2021-10-08T19:29:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: pgmap v114: 584 pgs: 160 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]': finished 2021-10-08T19:29:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: osdmap e94: 8 total, 8 up, 8 in 2021-10-08T19:29:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: 18.4 deep-scrub ok 2021-10-08T19:29:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:14.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:14.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:14.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:14.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: osdmap e95: 8 total, 8 up, 8 in 2021-10-08T19:29:14.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:14.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:14.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4053895654' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: pgmap v114: 584 pgs: 160 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:14.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]': finished 2021-10-08T19:29:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: osdmap e94: 8 total, 8 up, 8 in 2021-10-08T19:29:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: 18.4 deep-scrub ok 2021-10-08T19:29:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:14.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: osdmap e95: 8 total, 8 up, 8 in 2021-10-08T19:29:14.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:14.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:14.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4053895654' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: pgmap v114: 584 pgs: 160 unknown, 32 creating+peering, 392 active+clean; 145 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:14.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-7"}]': finished 2021-10-08T19:29:14.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83532-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:14.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: osdmap e94: 8 total, 8 up, 8 in 2021-10-08T19:29:14.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: 18.4 deep-scrub ok 2021-10-08T19:29:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:14.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: osdmap e95: 8 total, 8 up, 8 in 2021-10-08T19:29:14.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:14.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]: dispatch 2021-10-08T19:29:14.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4053895654' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:14.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:15.138 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2021-10-08T19:29:15.138 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [----------] Global test environment set-up. 2021-10-08T19:29:15.138 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [----------] 4 tests from LibRadosService 2021-10-08T19:29:15.139 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2021-10-08T19:29:15.139 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5385 ms) 2021-10-08T19:29:15.139 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2021-10-08T19:29:15.139 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ OK ] LibRadosService.RegisterLate (13 ms) 2021-10-08T19:29:15.139 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2021-10-08T19:29:15.140 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: cluster: 2021-10-08T19:29:15.140 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: id: c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:29:15.140 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: health: HEALTH_OK 2021-10-08T19:29:15.141 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.141 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: services: 2021-10-08T19:29:15.142 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: mon: 3 daemons, quorum a,c,b (age 1069638781) 2021-10-08T19:29:15.142 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: mgr: y(active, since 2m), standbys: x 2021-10-08T19:29:15.142 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 3m) 2021-10-08T19:29:15.143 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2021-10-08T19:29:15.143 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.143 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: data: 2021-10-08T19:29:15.143 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: pools: 6 pools, 132 pgs 2021-10-08T19:29:15.144 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: objects: 194 objects, 582 KiB 2021-10-08T19:29:15.144 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: usage: 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:15.144 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: pgs: 132 active+clean 2021-10-08T19:29:15.144 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.144 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: io: 2021-10-08T19:29:15.145 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2021-10-08T19:29:15.145 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.145 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.145 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: cluster: 2021-10-08T19:29:15.146 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: id: c1559bde-286c-11ec-8c25-001a4aab830c 2021-10-08T19:29:15.146 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: health: HEALTH_OK 2021-10-08T19:29:15.146 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.146 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: services: 2021-10-08T19:29:15.146 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: mon: 3 daemons, quorum a,c,b (age -850773156) 2021-10-08T19:29:15.147 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: mgr: y(active, since 2m), standbys: x 2021-10-08T19:29:15.147 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 3m) 2021-10-08T19:29:15.147 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2021-10-08T19:29:15.147 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: laundry: 1 daemon active (1 hosts) 2021-10-08T19:29:15.148 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2021-10-08T19:29:15.148 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.149 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: data: 2021-10-08T19:29:15.149 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: pools: 29 pools, 868 pgs 2021-10-08T19:29:15.149 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: objects: 194 objects, 582 KiB 2021-10-08T19:29:15.150 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: usage: 53 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:15.150 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: pgs: 58.295% pgs unknown 2021-10-08T19:29:15.150 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 26.498% pgs not active 2021-10-08T19:29:15.150 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 506 unknown 2021-10-08T19:29:15.151 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 230 creating+peering 2021-10-08T19:29:15.151 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 132 active+clean 2021-10-08T19:29:15.151 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.152 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: io: 2021-10-08T19:29:15.152 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: client: 902 B/s rd, 0 op/s rd, 0 op/s wr 2021-10-08T19:29:15.152 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.152 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.153 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ OK ] LibRadosService.StatusFormat (3336 ms) 2021-10-08T19:29:15.153 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ RUN ] LibRadosService.Status 2021-10-08T19:29:15.153 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ OK ] LibRadosService.Status (20062 ms) 2021-10-08T19:29:15.153 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [----------] 4 tests from LibRadosService (28796 ms total) 2021-10-08T19:29:15.154 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: 2021-10-08T19:29:15.154 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [----------] Global test environment tear-down 2021-10-08T19:29:15.154 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [==========] 4 tests from 1 test suite ran. (28798 ms total) 2021-10-08T19:29:15.155 INFO:tasks.workunit.client.0.smithi112.stdout: api_service: [ PASSED ] 4 tests. 2021-10-08T19:29:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]': finished 2021-10-08T19:29:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:15.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: osdmap e96: 8 total, 8 up, 8 in 2021-10-08T19:29:15.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:15.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:15.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]': finished 2021-10-08T19:29:15.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:15.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:15.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: osdmap e96: 8 total, 8 up, 8 in 2021-10-08T19:29:15.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:15.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:15.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-7"}]': finished 2021-10-08T19:29:15.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:15.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:15.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: osdmap e96: 8 total, 8 up, 8 in 2021-10-08T19:29:15.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:15.576 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:15] "GET /metrics HTTP/1.1" 200 165125 "" "Prometheus/2.18.1" 2021-10-08T19:29:16.772 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:29:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:29:17.705 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2021-10-08T19:29:17.706 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [----------] Global test environment set-up. 2021-10-08T19:29:17.706 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2021-10-08T19:29:17.706 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2021-10-08T19:29:17.706 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5627 ms) 2021-10-08T19:29:17.707 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2021-10-08T19:29:17.707 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (618 ms) 2021-10-08T19:29:17.707 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2021-10-08T19:29:17.707 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20029 ms) 2021-10-08T19:29:17.708 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2021-10-08T19:29:17.708 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: attempt 0 of 20 2021-10-08T19:29:17.708 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5086 ms) 2021-10-08T19:29:17.708 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (31360 ms total) 2021-10-08T19:29:17.708 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: 2021-10-08T19:29:17.709 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [----------] Global test environment tear-down 2021-10-08T19:29:17.709 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (31360 ms total) 2021-10-08T19:29:17.709 INFO:tasks.workunit.client.0.smithi112.stdout: api_service_pp: [ PASSED ] 4 tests. 2021-10-08T19:29:17.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:17 smithi142 ceph-mon[33432]: pgmap v117: 552 pgs: 64 unknown, 488 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:29:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:17 smithi142 ceph-mon[33432]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:29:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:17 smithi142 ceph-mon[33432]: osdmap e97: 8 total, 8 up, 8 in 2021-10-08T19:29:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:17 smithi112 ceph-mon[31694]: pgmap v117: 552 pgs: 64 unknown, 488 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:29:17.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:17 smithi112 ceph-mon[31694]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:29:17.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:17 smithi112 ceph-mon[31694]: osdmap e97: 8 total, 8 up, 8 in 2021-10-08T19:29:17.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:17 smithi112 ceph-mon[40655]: pgmap v117: 552 pgs: 64 unknown, 488 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:29:17.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:17.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:17 smithi112 ceph-mon[40655]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:29:17.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:17 smithi112 ceph-mon[40655]: osdmap e97: 8 total, 8 up, 8 in 2021-10-08T19:29:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: pgmap v120: 392 pgs: 392 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:29:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]: dispatch 2021-10-08T19:29:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]: dispatch 2021-10-08T19:29:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: osdmap e98: 8 total, 8 up, 8 in 2021-10-08T19:29:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3545409220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:18.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:18.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:18.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3318853105' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:29:18.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:29:18.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:18.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:18.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:18.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: pgmap v120: 392 pgs: 392 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:29:18.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:18.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]: dispatch 2021-10-08T19:29:18.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]: dispatch 2021-10-08T19:29:18.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:18.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: osdmap e98: 8 total, 8 up, 8 in 2021-10-08T19:29:18.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:18.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:18.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3545409220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:18.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:18.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:18.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3318853105' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:29:18.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:29:18.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:18.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:18.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:18.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: pgmap v120: 392 pgs: 392 active+clean; 145 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-10-08T19:29:18.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:29:18.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]: dispatch 2021-10-08T19:29:18.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]: dispatch 2021-10-08T19:29:18.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:18.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: osdmap e98: 8 total, 8 up, 8 in 2021-10-08T19:29:18.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:29:18.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:29:18.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3545409220' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:18.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:18.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:18.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:18.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3318853105' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:29:18.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-10-08T19:29:18.834 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]': finished 2021-10-08T19:29:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:29:19.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: osdmap e99: 8 total, 8 up, 8 in 2021-10-08T19:29:19.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2775411373' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:19.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:19.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:19.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:19.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:19.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:19.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: pgmap v123: 496 pgs: 32 creating+peering, 464 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2021-10-08T19:29:19.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:19.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]': finished 2021-10-08T19:29:19.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:29:19.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: osdmap e99: 8 total, 8 up, 8 in 2021-10-08T19:29:19.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2775411373' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:19.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:19.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:19.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:19.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:19.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:19.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: pgmap v123: 496 pgs: 32 creating+peering, 464 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2021-10-08T19:29:19.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:19.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83404-4"}]': finished 2021-10-08T19:29:19.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83251-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:19.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:29:19.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: osdmap e99: 8 total, 8 up, 8 in 2021-10-08T19:29:19.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2775411373' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:19.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:19.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:19.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:19.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]: dispatch 2021-10-08T19:29:19.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:19.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:19.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: pgmap v123: 496 pgs: 32 creating+peering, 464 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2021-10-08T19:29:19.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:20.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:20.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:20.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2775411373' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:20.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]': finished 2021-10-08T19:29:20.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:29:20.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:20.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: osdmap e100: 8 total, 8 up, 8 in 2021-10-08T19:29:20.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:20.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:29:20.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:20.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:29:20.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:20.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:20.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]': finished 2021-10-08T19:29:20.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:29:20.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]': finished 2021-10-08T19:29:20.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: osdmap e101: 8 total, 8 up, 8 in 2021-10-08T19:29:20.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1027775297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]: dispatch 2021-10-08T19:29:20.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]: dispatch 2021-10-08T19:29:20.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:20.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:20.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2775411373' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:20.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]': finished 2021-10-08T19:29:20.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:29:20.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:20.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: osdmap e100: 8 total, 8 up, 8 in 2021-10-08T19:29:20.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:20.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:29:20.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:20.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:29:20.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:20.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:20.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]': finished 2021-10-08T19:29:20.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:29:20.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]': finished 2021-10-08T19:29:20.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: osdmap e101: 8 total, 8 up, 8 in 2021-10-08T19:29:20.833 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1027775297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.834 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.834 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:20.834 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]: dispatch 2021-10-08T19:29:20.834 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]: dispatch 2021-10-08T19:29:20.835 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:21.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:21.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2775411373' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:21.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83404-4", "tierpool": "test-rados-api-smithi112-83404-6"}]': finished 2021-10-08T19:29:21.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:29:21.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:21.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: osdmap e100: 8 total, 8 up, 8 in 2021-10-08T19:29:21.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2421306492' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:21.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:29:21.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:21.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]: dispatch 2021-10-08T19:29:21.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:21.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:21.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache", "force_nonempty":""}]': finished 2021-10-08T19:29:21.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi112-83404-6", "pool2": "test-rados-api-smithi112-83404-6", "yes_i_really_really_mean_it": true}]': finished 2021-10-08T19:29:21.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-9"}]': finished 2021-10-08T19:29:21.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: osdmap e101: 8 total, 8 up, 8 in 2021-10-08T19:29:21.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1027775297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]: dispatch 2021-10-08T19:29:21.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]: dispatch 2021-10-08T19:29:21.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.053 INFO:tasks.workunit.client.0.smithi112.stdout:_notify_pp: flushed 2021-10-08T19:29:21.053 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3005 ms) 2021-10-08T19:29:21.053 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2021-10-08T19:29:21.054 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: trying... 2021-10-08T19:29:21.054 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982314240 notify_id 382252089352 notifier_gid 25120 2021-10-08T19:29:21.054 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: timed out 2021-10-08T19:29:21.055 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: flushing 2021-10-08T19:29:21.055 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: flushed 2021-10-08T19:29:21.055 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3017 ms) 2021-10-08T19:29:21.056 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2021-10-08T19:29:21.056 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: List watches 2021-10-08T19:29:21.056 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: notify2 2021-10-08T19:29:21.056 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982314240 notify_id 395136991241 notifier_gid 25120 2021-10-08T19:29:21.057 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: notify2 done 2021-10-08T19:29:21.057 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: watch_check 2021-10-08T19:29:21.057 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: unwatch2 2021-10-08T19:29:21.057 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: flushing 2021-10-08T19:29:21.057 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: done 2021-10-08T19:29:21.058 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3069 ms) 2021-10-08T19:29:21.058 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2021-10-08T19:29:21.058 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: List watches 2021-10-08T19:29:21.058 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: notify2 2021-10-08T19:29:21.059 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: handle_notify cookie 94207982318656 notify_id 408021893130 notifier_gid 25120 2021-10-08T19:29:21.059 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: notify2 done 2021-10-08T19:29:21.059 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: watch_check 2021-10-08T19:29:21.059 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: unwatch2 2021-10-08T19:29:21.059 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: flushing 2021-10-08T19:29:21.060 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: done 2021-10-08T19:29:21.060 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3047 ms) 2021-10-08T19:29:21.060 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16341 ms total) 2021-10-08T19:29:21.060 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: 2021-10-08T19:29:21.061 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2021-10-08T19:29:21.061 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (34751 ms total) 2021-10-08T19:29:21.061 INFO:tasks.workunit.client.0.smithi112.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2021-10-08T19:29:21.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: pgmap v126: 492 pgs: 64 unknown, 428 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 op/s 2021-10-08T19:29:21.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:21.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:21.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:21.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]': finished 2021-10-08T19:29:21.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:21.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: osdmap e102: 8 total, 8 up, 8 in 2021-10-08T19:29:21.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1916370299' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]: dispatch 2021-10-08T19:29:21.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]: dispatch 2021-10-08T19:29:21.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:21.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:21.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: pgmap v126: 492 pgs: 64 unknown, 428 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 op/s 2021-10-08T19:29:21.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:21.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:21.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:21.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]': finished 2021-10-08T19:29:21.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:21.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: osdmap e102: 8 total, 8 up, 8 in 2021-10-08T19:29:21.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1916370299' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:21.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]: dispatch 2021-10-08T19:29:21.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]: dispatch 2021-10-08T19:29:21.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:21.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:22.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: pgmap v126: 492 pgs: 64 unknown, 428 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 op/s 2021-10-08T19:29:22.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:22.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:22.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:22.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-9", "mode": "writeback"}]': finished 2021-10-08T19:29:22.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83251-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:22.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: osdmap e102: 8 total, 8 up, 8 in 2021-10-08T19:29:22.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1916370299' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:22.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:22.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/568374421' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]: dispatch 2021-10-08T19:29:22.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]: dispatch 2021-10-08T19:29:22.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:22.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:22.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:22.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:22.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]': finished 2021-10-08T19:29:22.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:22.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[31694]: osdmap e103: 8 total, 8 up, 8 in 2021-10-08T19:29:22.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:22.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:22.899 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:22.899 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:22.899 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]': finished 2021-10-08T19:29:22.900 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:22.900 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[40655]: osdmap e103: 8 total, 8 up, 8 in 2021-10-08T19:29:22.900 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:22.900 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:23.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:23.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:23.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83251-8", "tierpool":"test-rados-api-smithi112-83251-8-cache"}]': finished 2021-10-08T19:29:23.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:23.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:22 smithi142 ceph-mon[33432]: osdmap e103: 8 total, 8 up, 8 in 2021-10-08T19:29:23.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:23.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]: dispatch 2021-10-08T19:29:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:29:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:23.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: pgmap v129: 460 pgs: 64 unknown, 396 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:23.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:23.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:23.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:23.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:23.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:23.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:23.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]': finished 2021-10-08T19:29:23.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: osdmap e104: 8 total, 8 up, 8 in 2021-10-08T19:29:23.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/379924446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:23.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:23.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:23.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:23.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:23.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:23.505Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:29:23.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: pgmap v129: 460 pgs: 64 unknown, 396 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:23.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:23.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:23.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:23.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:23.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:23.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:23.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]': finished 2021-10-08T19:29:23.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: osdmap e104: 8 total, 8 up, 8 in 2021-10-08T19:29:23.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/379924446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: pgmap v129: 460 pgs: 64 unknown, 396 active+clean; 145 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:29:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:24.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:29:24.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:24.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:29:24.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:24.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:24.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-9"}]': finished 2021-10-08T19:29:24.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: osdmap e104: 8 total, 8 up, 8 in 2021-10-08T19:29:24.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/379924446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:24.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: Running main() from gmock_main.cc 2021-10-08T19:29:24.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [==========] Running 7 tests from 1 test suite. 2021-10-08T19:29:24.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [----------] Global test environment set-up. 2021-10-08T19:29:24.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [----------] 7 tests from LibRadosPools 2021-10-08T19:29:24.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2021-10-08T19:29:24.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ OK ] LibRadosPools.PoolList (7565 ms) 2021-10-08T19:29:24.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2021-10-08T19:29:24.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4222 ms) 2021-10-08T19:29:24.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2021-10-08T19:29:24.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (2963 ms) 2021-10-08T19:29:24.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2021-10-08T19:29:24.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5105 ms) 2021-10-08T19:29:24.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2021-10-08T19:29:24.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (4917 ms) 2021-10-08T19:29:24.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2021-10-08T19:29:24.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5043 ms) 2021-10-08T19:29:24.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2021-10-08T19:29:24.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8004 ms) 2021-10-08T19:29:24.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [----------] 7 tests from LibRadosPools (37819 ms total) 2021-10-08T19:29:24.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: 2021-10-08T19:29:24.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [----------] Global test environment tear-down 2021-10-08T19:29:24.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [==========] 7 tests from 1 test suite ran. (37819 ms total) 2021-10-08T19:29:24.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_pool: [ PASSED ] 7 tests. 2021-10-08T19:29:25.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:25.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/379924446' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:24 smithi142 ceph-mon[33432]: osdmap e105: 8 total, 8 up, 8 in 2021-10-08T19:29:25.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3107207584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:25.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/379924446' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[31694]: osdmap e105: 8 total, 8 up, 8 in 2021-10-08T19:29:25.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3107207584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:25.078 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/379924446' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.079 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[40655]: osdmap e105: 8 total, 8 up, 8 in 2021-10-08T19:29:25.079 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3107207584' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.079 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:25] "GET /metrics HTTP/1.1" 200 166270 "" "Prometheus/2.18.1" 2021-10-08T19:29:25.859 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[31694]: pgmap v132: 396 pgs: 32 unknown, 32 creating+peering, 332 active+clean; 145 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 8.0 KiB/s wr, 14 op/s 2021-10-08T19:29:25.859 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:25.859 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.860 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[31694]: osdmap e106: 8 total, 8 up, 8 in 2021-10-08T19:29:25.860 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.860 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.861 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[40655]: pgmap v132: 396 pgs: 32 unknown, 32 creating+peering, 332 active+clean; 145 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 8.0 KiB/s wr, 14 op/s 2021-10-08T19:29:25.861 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:25.861 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:25.861 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[40655]: osdmap e106: 8 total, 8 up, 8 in 2021-10-08T19:29:25.861 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:25.862 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:26.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:25 smithi142 ceph-mon[33432]: pgmap v132: 396 pgs: 32 unknown, 32 creating+peering, 332 active+clean; 145 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 8.0 KiB/s wr, 14 op/s 2021-10-08T19:29:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:26.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:25 smithi142 ceph-mon[33432]: osdmap e106: 8 total, 8 up, 8 in 2021-10-08T19:29:26.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:26.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:26.609 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:29:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:29:27.000 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:27.001 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:27.001 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: osdmap e107: 8 total, 8 up, 8 in 2021-10-08T19:29:27.001 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1374178260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:27.001 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:29:27.002 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:29:27.002 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:29:27.002 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:29:27.002 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:29:27.003 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:29:27.003 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:29:27.003 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:29:27.003 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:29:27.003 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:29:27.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:27.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:27.004 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: osdmap e107: 8 total, 8 up, 8 in 2021-10-08T19:29:27.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1374178260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:27.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:29:27.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:29:27.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:29:27.005 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:29:27.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:29:27.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:29:27.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:29:27.006 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:29:27.007 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:29:27.007 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:29:27.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:27.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:27.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: osdmap e107: 8 total, 8 up, 8 in 2021-10-08T19:29:27.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1374178260' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:27.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:29:27.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:29:27.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:29:27.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:29:27.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:29:27.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:29:27.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:29:27.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:29:27.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:29:27.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:29:28.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:28.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:29:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:29:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:29:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:29:28.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:29:28.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:29:28.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:29:28.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:29:28.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:29:28.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:29:28.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: pgmap v135: 396 pgs: 64 unknown, 332 active+clean; 145 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 8.2 KiB/s wr, 14 op/s 2021-10-08T19:29:28.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: 18.3 deep-scrub ok 2021-10-08T19:29:28.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:28.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1374178260' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:28.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: osdmap e108: 8 total, 8 up, 8 in 2021-10-08T19:29:28.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4158731779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:28.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:28.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:28.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:28.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:28.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:27 smithi142 ceph-mon[33432]: 18.0 deep-scrub ok 2021-10-08T19:29:28.081 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:28.081 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:29:28.082 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:29:28.082 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:29:28.082 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:29:28.082 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:29:28.083 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:29:28.083 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:29:28.083 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:29:28.083 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:29:28.084 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:29:28.084 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: pgmap v135: 396 pgs: 64 unknown, 332 active+clean; 145 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 8.2 KiB/s wr, 14 op/s 2021-10-08T19:29:28.084 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: 18.3 deep-scrub ok 2021-10-08T19:29:28.085 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:28.085 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1374178260' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:28.085 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: osdmap e108: 8 total, 8 up, 8 in 2021-10-08T19:29:28.085 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4158731779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:28.086 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:28.086 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:28.086 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:28.086 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:28.087 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[40655]: 18.0 deep-scrub ok 2021-10-08T19:29:28.087 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:28.087 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.0"}]: dispatch 2021-10-08T19:29:28.087 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.1"}]: dispatch 2021-10-08T19:29:28.088 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.2"}]: dispatch 2021-10-08T19:29:28.088 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.3"}]: dispatch 2021-10-08T19:29:28.088 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.4"}]: dispatch 2021-10-08T19:29:28.088 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.5"}]: dispatch 2021-10-08T19:29:28.089 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.6"}]: dispatch 2021-10-08T19:29:28.089 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.7"}]: dispatch 2021-10-08T19:29:28.089 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.8"}]: dispatch 2021-10-08T19:29:28.089 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "18.9"}]: dispatch 2021-10-08T19:29:28.090 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: pgmap v135: 396 pgs: 64 unknown, 332 active+clean; 145 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 8.2 KiB/s wr, 14 op/s 2021-10-08T19:29:28.090 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: 18.3 deep-scrub ok 2021-10-08T19:29:28.090 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:28.091 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1374178260' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:28.091 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: osdmap e108: 8 total, 8 up, 8 in 2021-10-08T19:29:28.091 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4158731779' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:28.091 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:28.092 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:28.092 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:28.092 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:28.092 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:27 smithi112 ceph-mon[31694]: 18.0 deep-scrub ok 2021-10-08T19:29:29.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:29.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:29.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:29.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:29.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:28 smithi142 ceph-mon[33432]: osdmap e109: 8 total, 8 up, 8 in 2021-10-08T19:29:29.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:29.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:29.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:29.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[40655]: osdmap e109: 8 total, 8 up, 8 in 2021-10-08T19:29:29.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:29.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:29.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:29.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:29.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:29.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:29.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:29.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[31694]: osdmap e109: 8 total, 8 up, 8 in 2021-10-08T19:29:29.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]: dispatch 2021-10-08T19:29:29.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:29.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:30.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: 18.7 deep-scrub ok 2021-10-08T19:29:30.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: pgmap v138: 388 pgs: 388 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 4 op/s 2021-10-08T19:29:30.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:29:30.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:29:30.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: 18.5 deep-scrub ok 2021-10-08T19:29:30.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:30.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:30.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]': finished 2021-10-08T19:29:30.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-10-08T19:29:30.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: osdmap e110: 8 total, 8 up, 8 in 2021-10-08T19:29:30.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]: dispatch 2021-10-08T19:29:30.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]: dispatch 2021-10-08T19:29:30.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/67428003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:30.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:30.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: 18.7 deep-scrub ok 2021-10-08T19:29:30.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: pgmap v138: 388 pgs: 388 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 4 op/s 2021-10-08T19:29:30.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:29:30.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:29:30.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: 18.5 deep-scrub ok 2021-10-08T19:29:30.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:30.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:30.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]': finished 2021-10-08T19:29:30.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-10-08T19:29:30.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: osdmap e110: 8 total, 8 up, 8 in 2021-10-08T19:29:30.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]: dispatch 2021-10-08T19:29:30.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]: dispatch 2021-10-08T19:29:30.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/67428003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:30.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:30.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: 18.7 deep-scrub ok 2021-10-08T19:29:30.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: pgmap v138: 388 pgs: 388 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 4 op/s 2021-10-08T19:29:30.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:29:30.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-10-08T19:29:30.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: 18.5 deep-scrub ok 2021-10-08T19:29:30.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:30.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1186575131' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-9"}]': finished 2021-10-08T19:29:30.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-11"}]': finished 2021-10-08T19:29:30.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83070-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-10-08T19:29:30.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: osdmap e110: 8 total, 8 up, 8 in 2021-10-08T19:29:30.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]: dispatch 2021-10-08T19:29:30.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]: dispatch 2021-10-08T19:29:30.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/67428003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:30.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:30.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:30.083 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:31.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:31.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:31.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:31.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:31.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]': finished 2021-10-08T19:29:31.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:31.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:31.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:29:31.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: osdmap e111: 8 total, 8 up, 8 in 2021-10-08T19:29:31.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:31.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3533729943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:31.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:31.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:31.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:31.031 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:30 smithi142 ceph-mon[33432]: 18.8 deep-scrub ok 2021-10-08T19:29:31.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:31.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:31.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:31.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:31.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]': finished 2021-10-08T19:29:31.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:31.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:31.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:29:31.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: osdmap e111: 8 total, 8 up, 8 in 2021-10-08T19:29:31.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:31.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3533729943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:31.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:31.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:31.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:31.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[40655]: 18.8 deep-scrub ok 2021-10-08T19:29:31.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:31.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:31.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]: dispatch 2021-10-08T19:29:31.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:31.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-11", "mode": "writeback"}]': finished 2021-10-08T19:29:31.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:31.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83282-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:31.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pg_num","val":"11"}]': finished 2021-10-08T19:29:31.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: osdmap e111: 8 total, 8 up, 8 in 2021-10-08T19:29:31.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:31.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:31.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3533729943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:31.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:31.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:31.081 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]: dispatch 2021-10-08T19:29:31.082 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:30 smithi112 ceph-mon[31694]: 18.8 deep-scrub ok 2021-10-08T19:29:31.270 INFO:tasks.workunit.client.0.smithi112.stdout:40 1 -- wait complete. 2021-10-08T19:29:31.271 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b540 10 monclient: shutdown 2021-10-08T19:29:31.271 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:28:46.240+0000 7f796ca9b540 20 monclient: shutdown discarding 0 pending message(s) 2021-10-08T19:29:31.271 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (24 ms) 2021-10-08T19:29:31.271 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure (24 ms total) 2021-10-08T19:29:31.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:29:31.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2021-10-08T19:29:31.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2021-10-08T19:29:31.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: started 0x562de592a5d0 2021-10-08T19:29:31.272 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: started 0x562de5a09dc0 2021-10-08T19:29:31.273 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: started 2 aios 2021-10-08T19:29:31.273 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: waiting 0x562de592a5d0 2021-10-08T19:29:31.273 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: waiting 0x562de5a09dc0 2021-10-08T19:29:31.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: done. 2021-10-08T19:29:31.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (11764 ms) 2021-10-08T19:29:31.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (11764 ms total) 2021-10-08T19:29:31.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:29:31.274 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2021-10-08T19:29:31.275 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2021-10-08T19:29:31.275 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2021-10-08T19:29:31.275 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2021-10-08T19:29:31.275 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMisc.Exec (60 ms) 2021-10-08T19:29:31.276 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2021-10-08T19:29:31.276 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (8 ms) 2021-10-08T19:29:31.276 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2021-10-08T19:29:31.276 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (2 ms) 2021-10-08T19:29:31.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2021-10-08T19:29:31.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5030 ms) 2021-10-08T19:29:31.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2021-10-08T19:29:31.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2021-10-08T19:29:31.277 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2021-10-08T19:29:31.278 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2021-10-08T19:29:31.278 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2021-10-08T19:29:31.278 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (24978 ms) 2021-10-08T19:29:31.278 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] 8 tests from LibRadosMisc (30078 ms total) 2021-10-08T19:29:31.279 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: 2021-10-08T19:29:31.279 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [----------] Global test environment tear-down 2021-10-08T19:29:31.279 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [==========] 11 tests from 4 test suites ran. (45046 ms total) 2021-10-08T19:29:31.279 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc: [ PASSED ] 11 tests. 2021-10-08T19:29:32.263 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: 18.2 deep-scrub ok 2021-10-08T19:29:32.263 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: pgmap v141: 420 pgs: 64 unknown, 356 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 18 MiB/s wr, 3 op/s 2021-10-08T19:29:32.263 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3533729943' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:32.264 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: 18.4 deep-scrub ok 2021-10-08T19:29:32.264 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:29:32.264 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:29:32.264 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:32.265 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:32.265 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:32.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:32 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:29:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:32.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: 18.2 deep-scrub ok 2021-10-08T19:29:32.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: pgmap v141: 420 pgs: 64 unknown, 356 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 18 MiB/s wr, 3 op/s 2021-10-08T19:29:32.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3533729943' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:32.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: 18.4 deep-scrub ok 2021-10-08T19:29:32.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:29:32.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:29:32.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:32.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:32.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:32.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: 18.2 deep-scrub ok 2021-10-08T19:29:32.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: pgmap v141: 420 pgs: 64 unknown, 356 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 18 MiB/s wr, 3 op/s 2021-10-08T19:29:32.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3533729943' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:32.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: 18.4 deep-scrub ok 2021-10-08T19:29:32.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi112-83070-1","var":"pgp_num","val":"11"}]': finished 2021-10-08T19:29:32.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: osdmap e112: 8 total, 8 up, 8 in 2021-10-08T19:29:32.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1424615230' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-10-08T19:29:32.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:32.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:29:33.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:29:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:33.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: 18.6 deep-scrub ok 2021-10-08T19:29:33.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:33.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:33.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:29:33.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:33.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:33.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1507480608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:33.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:29:33.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:29:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:33.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:33.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:33.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83070-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:33.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: 18.6 deep-scrub ok 2021-10-08T19:29:33.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:33.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:33.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:29:33.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:33.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:33.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1507480608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:33.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:29:33.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:29:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:33.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:33.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:33.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83070-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:33.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: 18.6 deep-scrub ok 2021-10-08T19:29:33.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83282-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:33.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:29:33.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: osdmap e113: 8 total, 8 up, 8 in 2021-10-08T19:29:33.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:33.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]: dispatch 2021-10-08T19:29:33.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1507480608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:33.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:33.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:29:33.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:29:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:33.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:33.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:33.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83070-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:33.505Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:33.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:33.506Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=9 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:29:34.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: 18.9 deep-scrub ok 2021-10-08T19:29:34.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: pgmap v144: 332 pgs: 40 unknown, 292 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:34.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:34.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]': finished 2021-10-08T19:29:34.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1507480608' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:34.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83070-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:34.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:29:34.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83070-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:34.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1318421897' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:34.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: 18.9 deep-scrub ok 2021-10-08T19:29:34.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: pgmap v144: 332 pgs: 40 unknown, 292 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:34.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:34.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]': finished 2021-10-08T19:29:34.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1507480608' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:34.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83070-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:34.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:29:34.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83070-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:34.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1318421897' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:34.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: 18.9 deep-scrub ok 2021-10-08T19:29:34.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: pgmap v144: 332 pgs: 40 unknown, 292 active+clean; 217 MiB data, 891 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:34.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:29:34.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-11"}]': finished 2021-10-08T19:29:34.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1507480608' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:34.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83070-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:34.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: osdmap e114: 8 total, 8 up, 8 in 2021-10-08T19:29:34.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83070-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:34.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1318421897' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:34.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:35.506 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:35] "GET /metrics HTTP/1.1" 200 166270 "" "Prometheus/2.18.1" 2021-10-08T19:29:35.507 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: 18.1 deep-scrub ok 2021-10-08T19:29:35.507 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:29:35.507 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: pgmap v147: 300 pgs: 32 creating+peering, 268 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:29:35.508 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83070-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:35.508 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:29:35.508 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2188929675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.508 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.509 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.509 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: 18.1 deep-scrub ok 2021-10-08T19:29:35.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:29:35.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: pgmap v147: 300 pgs: 32 creating+peering, 268 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:29:35.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83070-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:35.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:29:35.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2188929675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: 18.1 deep-scrub ok 2021-10-08T19:29:35.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: osdmap e115: 8 total, 8 up, 8 in 2021-10-08T19:29:35.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: pgmap v147: 300 pgs: 32 creating+peering, 268 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:29:35.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83070-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:35.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: osdmap e116: 8 total, 8 up, 8 in 2021-10-08T19:29:35.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2188929675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:35.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:36.087 INFO:tasks.workunit.client.0.smithi112.stdout:entry=1 expected=1 2021-10-08T19:29:36.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:d83876eb:::4:head 2021-10-08T19:29:36.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:d83876eb:::4:head expected=14:d83876eb:::4:head 2021-10-08T19:29:36.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:d83876eb:::4:head -> 4 2021-10-08T19:29:36.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=4 expected=4 2021-10-08T19:29:36.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:cfc208b3:::3:head 2021-10-08T19:29:36.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:cfc208b3:::3:head expected=14:cfc208b3:::3:head 2021-10-08T19:29:36.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:cfc208b3:::3:head -> 3 2021-10-08T19:29:36.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=3 expected=3 2021-10-08T19:29:36.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:c4fdafeb:::6:head 2021-10-08T19:29:36.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:c4fdafeb:::6:head expected=14:c4fdafeb:::6:head 2021-10-08T19:29:36.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:c4fdafeb:::6:head -> 6 2021-10-08T19:29:36.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=6 expected=6 2021-10-08T19:29:36.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:bd63b0f1:::8:head 2021-10-08T19:29:36.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:bd63b0f1:::8:head expected=14:bd63b0f1:::8:head 2021-10-08T19:29:36.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:bd63b0f1:::8:head -> 8 2021-10-08T19:29:36.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=8 expected=8 2021-10-08T19:29:36.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:b29083e3:::5:head 2021-10-08T19:29:36.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:b29083e3:::5:head expected=14:b29083e3:::5:head 2021-10-08T19:29:36.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:b29083e3:::5:head -> 5 2021-10-08T19:29:36.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=5 expected=5 2021-10-08T19:29:36.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:89d3ae78:::11:head 2021-10-08T19:29:36.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:89d3ae78:::11:head expected=14:89d3ae78:::11:head 2021-10-08T19:29:36.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:89d3ae78:::11:head -> 11 2021-10-08T19:29:36.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=11 expected=11 2021-10-08T19:29:36.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:566253c9:::13:head 2021-10-08T19:29:36.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:566253c9:::13:head expected=14:566253c9:::13:head 2021-10-08T19:29:36.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:566253c9:::13:head -> 13 2021-10-08T19:29:36.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=13 expected=13 2021-10-08T19:29:36.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : seek to 14:52ea6a34:::10:head 2021-10-08T19:29:36.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : cursor()=14:52ea6a34:::10:head expected=14:52ea6a34:::10:head 2021-10-08T19:29:36.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: > 14:52ea6a34:::10:head -> 10 2021-10-08T19:29:36.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: : entry=10 expected=10 2021-10-08T19:29:36.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (200 ms) 2021-10-08T19:29:36.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2021-10-08T19:29:36.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (26234 ms) 2021-10-08T19:29:36.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2021-10-08T19:29:36.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: split 0/5 -> MIN 14:33333333::::head 2021-10-08T19:29:36.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: split 1/5 -> 14:33333333::::head 14:66666666::::head 2021-10-08T19:29:36.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: split 2/5 -> 14:66666666::::head 14:99999999::::head 2021-10-08T19:29:36.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: split 3/5 -> 14:99999999::::head 14:cccccccc::::head 2021-10-08T19:29:36.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: split 4/5 -> 14:cccccccc::::head MAX 2021-10-08T19:29:36.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (11575 ms) 2021-10-08T19:29:36.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [----------] 7 tests from LibRadosList (38500 ms total) 2021-10-08T19:29:36.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 2021-10-08T19:29:36.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [----------] 3 tests from LibRadosListEC 2021-10-08T19:29:36.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2021-10-08T19:29:36.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1033 ms) 2021-10-08T19:29:36.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2021-10-08T19:29:36.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: myset foo1,foo2,foo3 2021-10-08T19:29:36.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo1 2021-10-08T19:29:36.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo2 2021-10-08T19:29:36.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo3 2021-10-08T19:29:36.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: myset foo1,foo4,foo5 2021-10-08T19:29:36.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo4 2021-10-08T19:29:36.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo5 2021-10-08T19:29:36.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo1 2021-10-08T19:29:36.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: myset foo6,foo7 2021-10-08T19:29:36.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo7 2021-10-08T19:29:36.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: foo6 2021-10-08T19:29:36.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-10-08T19:29:36.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns1:foo4 2021-10-08T19:29:36.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns1:foo5 2021-10-08T19:29:36.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns2:foo7 2021-10-08T19:29:36.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns2:foo6 2021-10-08T19:29:36.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: ns1:foo1 2021-10-08T19:29:36.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: :foo1 2021-10-08T19:29:36.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: :foo2 2021-10-08T19:29:36.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: :foo3 2021-10-08T19:29:36.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (30 ms) 2021-10-08T19:29:36.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:36 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:36.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:36.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:36.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:36 smithi142 ceph-mon[33432]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:29:36.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2463979322' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:36.775 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:29:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:29:36.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:36.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:36.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:36.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[40655]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:29:36.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2463979322' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:36.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:36.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:36.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:36.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[31694]: osdmap e117: 8 total, 8 up, 8 in 2021-10-08T19:29:36.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2463979322' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:38.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[40655]: pgmap v150: 372 pgs: 104 unknown, 268 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2021-10-08T19:29:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2463979322' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[40655]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:29:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:38.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:38.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[31694]: pgmap v150: 372 pgs: 104 unknown, 268 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2021-10-08T19:29:38.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2463979322' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:38.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[31694]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:29:38.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:38 smithi142 ceph-mon[33432]: pgmap v150: 372 pgs: 104 unknown, 268 active+clean; 217 MiB data, 887 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2021-10-08T19:29:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:38 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2463979322' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:38 smithi142 ceph-mon[33432]: osdmap e118: 8 total, 8 up, 8 in 2021-10-08T19:29:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:38 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:39.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:39.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[40655]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:29:39.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:39.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2692206046' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:39.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:39.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2692206046' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:39.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[40655]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:29:39.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2225740864' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:39.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[31694]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:29:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2692206046' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:39.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2692206046' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:39.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[31694]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:29:39.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2225740864' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:39.484 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:39.484 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:39 smithi142 ceph-mon[33432]: osdmap e119: 8 total, 8 up, 8 in 2021-10-08T19:29:39.484 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]: dispatch 2021-10-08T19:29:39.485 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2692206046' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:39.485 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/862887771' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83070-2"}]': finished 2021-10-08T19:29:39.485 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2692206046' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:39.485 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:39 smithi142 ceph-mon[33432]: osdmap e120: 8 total, 8 up, 8 in 2021-10-08T19:29:39.485 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2225740864' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:40 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:29:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[40655]: pgmap v153: 332 pgs: 32 creating+peering, 300 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 81 KiB/s wr, 77 op/s 2021-10-08T19:29:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:40.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[40655]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:29:40.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[31694]: pgmap v153: 332 pgs: 32 creating+peering, 300 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 81 KiB/s wr, 77 op/s 2021-10-08T19:29:40.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:40.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[31694]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:29:40.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:40 smithi142 ceph-mon[33432]: pgmap v153: 332 pgs: 32 creating+peering, 300 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 81 KiB/s wr, 77 op/s 2021-10-08T19:29:40.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:40.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:40.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:40 smithi142 ceph-mon[33432]: osdmap e121: 8 total, 8 up, 8 in 2021-10-08T19:29:40.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:29:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:29:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: pgmap v156: 364 pgs: 64 unknown, 300 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 81 KiB/s wr, 77 op/s 2021-10-08T19:29:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:29:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:41.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/824394566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:41.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:41.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:41.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:29:41.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:29:41.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi112-83070-3","pool2":"test-rados-api-smithi112-83070-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:41.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:41.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:41.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:41.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:29:41.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:29:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:41.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: pgmap v156: 364 pgs: 64 unknown, 300 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 81 KiB/s wr, 77 op/s 2021-10-08T19:29:41.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:41.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:41.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:29:41.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:41.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/824394566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:41.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:41.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:41.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:29:41.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:29:41.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi112-83070-3","pool2":"test-rados-api-smithi112-83070-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:41.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:41.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:29:41.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:29:41.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:29:41.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:29:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:29:41.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: pgmap v156: 364 pgs: 64 unknown, 300 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 81 KiB/s wr, 77 op/s 2021-10-08T19:29:41.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83070-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:41.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:29:41.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: osdmap e122: 8 total, 8 up, 8 in 2021-10-08T19:29:41.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:41.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/824394566' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:41.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:41.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:41.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:29:41.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:29:41.779 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi112-83070-3","pool2":"test-rados-api-smithi112-83070-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-10-08T19:29:42.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2021-10-08T19:29:42.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 1 0 2021-10-08T19:29:42.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 10 0 2021-10-08T19:29:42.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 13 0 2021-10-08T19:29:42.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 7 0 2021-10-08T19:29:42.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 14 0 2021-10-08T19:29:42.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 0 0 2021-10-08T19:29:42.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 15 0 2021-10-08T19:29:42.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 11 0 2021-10-08T19:29:42.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 5 0 2021-10-08T19:29:42.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 8 0 2021-10-08T19:29:42.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 6 0 2021-10-08T19:29:42.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 3 0 2021-10-08T19:29:42.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 4 0 2021-10-08T19:29:42.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 12 0 2021-10-08T19:29:42.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 9 0 2021-10-08T19:29:42.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 2 0 2021-10-08T19:29:42.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-10-08T19:29:42.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (46 ms) 2021-10-08T19:29:42.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [----------] 3 tests from LibRadosListEC (1109 ms total) 2021-10-08T19:29:42.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 2021-10-08T19:29:42.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [----------] 1 test from LibRadosListNP 2021-10-08T19:29:42.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2021-10-08T19:29:42.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2980 ms) 2021-10-08T19:29:42.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [----------] 1 test from LibRadosListNP (2980 ms total) 2021-10-08T19:29:42.039 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: 2021-10-08T19:29:42.039 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [----------] Global test environment tear-down 2021-10-08T19:29:42.039 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [==========] 11 tests from 3 test suites ran. (55833 ms total) 2021-10-08T19:29:42.040 INFO:tasks.workunit.client.0.smithi112.stdout: api_list: [ PASSED ] 11 tests. 2021-10-08T19:29:42.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:42 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:42.316Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:42.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:42 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:42.316Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:42.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:42 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:42.316Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:29:43.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: Running main() from gmock_main.cc 2021-10-08T19:29:43.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [==========] Running 12 tests from 4 test suites. 2021-10-08T19:29:43.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] Global test environment set-up. 2021-10-08T19:29:43.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2021-10-08T19:29:43.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2021-10-08T19:29:43.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2151 ms) 2021-10-08T19:29:43.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2021-10-08T19:29:43.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2732 ms) 2021-10-08T19:29:43.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2021-10-08T19:29:43.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (1976 ms) 2021-10-08T19:29:43.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2021-10-08T19:29:43.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2089 ms) 2021-10-08T19:29:43.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (8949 ms total) 2021-10-08T19:29:43.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: 2021-10-08T19:29:43.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged 2021-10-08T19:29:43.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2021-10-08T19:29:43.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4239 ms) 2021-10-08T19:29:43.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2021-10-08T19:29:43.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3746 ms) 2021-10-08T19:29:43.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged (7985 ms total) 2021-10-08T19:29:43.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: 2021-10-08T19:29:43.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2021-10-08T19:29:43.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2021-10-08T19:29:43.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2558 ms) 2021-10-08T19:29:43.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2021-10-08T19:29:43.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2021 ms) 2021-10-08T19:29:43.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2021-10-08T19:29:43.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2046 ms) 2021-10-08T19:29:43.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2021-10-08T19:29:43.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2001 ms) 2021-10-08T19:29:43.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8626 ms total) 2021-10-08T19:29:43.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: 2021-10-08T19:29:43.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2021-10-08T19:29:43.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2021-10-08T19:29:43.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4031 ms) 2021-10-08T19:29:43.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2021-10-08T19:29:43.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4003 ms) 2021-10-08T19:29:43.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8034 ms total) 2021-10-08T19:29:43.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: 2021-10-08T19:29:43.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [----------] Global test environment tear-down 2021-10-08T19:29:43.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [==========] 12 tests from 4 test suites ran. (56767 ms total) 2021-10-08T19:29:43.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots: [ PASSED ] 12 tests. 2021-10-08T19:29:43.035 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:43.035 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83517 2021-10-08T19:29:43.035 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83517 2021-10-08T19:29:43.036 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:43.036 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83060 2021-10-08T19:29:43.036 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83060 2021-10-08T19:29:43.036 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:43.036 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83395 2021-10-08T19:29:43.037 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83395 2021-10-08T19:29:43.037 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:29:43.037 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83294 2021-10-08T19:29:43.037 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83294 2021-10-08T19:29:43.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:29:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:43.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:43.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:43.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]': finished 2021-10-08T19:29:43.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi112-83070-3","pool2":"test-rados-api-smithi112-83070-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-10-08T19:29:43.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:29:43.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:43.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:43.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]: dispatch 2021-10-08T19:29:43.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2673328696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:43.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]: dispatch 2021-10-08T19:29:43.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:43.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:43.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:43.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]': finished 2021-10-08T19:29:43.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi112-83070-3","pool2":"test-rados-api-smithi112-83070-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-10-08T19:29:43.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:29:43.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:43.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:43.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]: dispatch 2021-10-08T19:29:43.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2673328696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:43.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]: dispatch 2021-10-08T19:29:43.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:43.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:43.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:43.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-13"}]': finished 2021-10-08T19:29:43.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3140083138' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi112-83070-3","pool2":"test-rados-api-smithi112-83070-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-10-08T19:29:43.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: osdmap e123: 8 total, 8 up, 8 in 2021-10-08T19:29:43.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2908633012' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:43.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]: dispatch 2021-10-08T19:29:43.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]: dispatch 2021-10-08T19:29:43.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2673328696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:43.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]: dispatch 2021-10-08T19:29:43.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:43.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:43.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:43.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:43.506Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=9 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:29:44.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: pgmap v159: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:44.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:44.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:44.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:44.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]': finished 2021-10-08T19:29:44.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:44.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:29:44.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:29:44.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:29:44.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:29:44.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:29:44.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:29:44.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:29:44.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:29:44.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:29:44.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:29:44.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:29:44.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: pgmap v159: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:44.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:44.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:44.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:44.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]': finished 2021-10-08T19:29:44.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:44.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:29:44.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:29:44.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:29:44.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:29:44.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:29:44.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:29:44.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:29:44.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:29:44.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:29:44.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:29:44.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:29:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: pgmap v159: 356 pgs: 64 unknown, 292 active+clean; 217 MiB data, 897 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:29:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83282-14"}]': finished 2021-10-08T19:29:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-13", "mode": "writeback"}]': finished 2021-10-08T19:29:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: osdmap e124: 8 total, 8 up, 8 in 2021-10-08T19:29:44.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:29:44.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:29:44.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:29:44.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:29:44.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:29:44.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:29:44.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:29:44.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:29:44.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:29:44.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:29:45.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:45] "GET /metrics HTTP/1.1" 200 161871 "" "Prometheus/2.18.1" 2021-10-08T19:29:45.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:29:45.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:29:45.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:29:45.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:29:45.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:29:45.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:29:45.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:29:45.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:29:45.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:29:45.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:29:45.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:29:45.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/418903874' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:45.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:29:45.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4183862661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:29:45.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:29:45.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:29:45.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:29:45.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:29:45.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:29:45.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:29:45.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:29:45.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:29:45.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:29:45.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:29:45.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/418903874' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:45.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:29:45.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4183862661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-10-08T19:29:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-10-08T19:29:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-10-08T19:29:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-10-08T19:29:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-10-08T19:29:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-10-08T19:29:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-10-08T19:29:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-10-08T19:29:45.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-10-08T19:29:45.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-10-08T19:29:45.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: osdmap e125: 8 total, 8 up, 8 in 2021-10-08T19:29:45.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/418903874' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:45.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: osdmap e126: 8 total, 8 up, 8 in 2021-10-08T19:29:45.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4183862661' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:45.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:46.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:46 smithi112 ceph-mon[40655]: pgmap v162: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 48 KiB/s rd, 42 KiB/s wr, 119 op/s 2021-10-08T19:29:46.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:46 smithi112 ceph-mon[40655]: 94.2 scrub ok 2021-10-08T19:29:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:46 smithi112 ceph-mon[40655]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:29:46.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:46 smithi112 ceph-mon[31694]: pgmap v162: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 48 KiB/s rd, 42 KiB/s wr, 119 op/s 2021-10-08T19:29:46.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:46 smithi112 ceph-mon[31694]: 94.2 scrub ok 2021-10-08T19:29:46.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:46.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:46 smithi112 ceph-mon[31694]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:29:46.360 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:46 smithi142 ceph-mon[33432]: pgmap v162: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 48 KiB/s rd, 42 KiB/s wr, 119 op/s 2021-10-08T19:29:46.360 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:46 smithi142 ceph-mon[33432]: 94.2 scrub ok 2021-10-08T19:29:46.361 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:46.361 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:46 smithi142 ceph-mon[33432]: osdmap e127: 8 total, 8 up, 8 in 2021-10-08T19:29:46.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:29:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:29:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[40655]: 94.1 scrub ok 2021-10-08T19:29:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[40655]: 94.3 scrub ok 2021-10-08T19:29:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[40655]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:29:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/923615988' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:47.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[31694]: 94.1 scrub ok 2021-10-08T19:29:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[31694]: 94.3 scrub ok 2021-10-08T19:29:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[31694]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:29:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/923615988' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:47.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:47 smithi142 ceph-mon[33432]: 94.1 scrub ok 2021-10-08T19:29:47.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:47 smithi142 ceph-mon[33432]: 94.3 scrub ok 2021-10-08T19:29:47.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:47 smithi142 ceph-mon[33432]: osdmap e128: 8 total, 8 up, 8 in 2021-10-08T19:29:47.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/923615988' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:47.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:48.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[40655]: pgmap v165: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 52 KiB/s rd, 50 KiB/s wr, 121 op/s 2021-10-08T19:29:48.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[40655]: 94.6 scrub ok 2021-10-08T19:29:48.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[40655]: 94.9 scrub ok 2021-10-08T19:29:48.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:48.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[40655]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:29:48.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2276843018' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:48.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:48.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:48.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[31694]: pgmap v165: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 52 KiB/s rd, 50 KiB/s wr, 121 op/s 2021-10-08T19:29:48.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[31694]: 94.6 scrub ok 2021-10-08T19:29:48.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[31694]: 94.9 scrub ok 2021-10-08T19:29:48.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:48.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[31694]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:29:48.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2276843018' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:48.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:48.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:48.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:48 smithi142 ceph-mon[33432]: pgmap v165: 324 pgs: 32 unknown, 292 active+clean; 217 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 52 KiB/s rd, 50 KiB/s wr, 121 op/s 2021-10-08T19:29:48.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:48 smithi142 ceph-mon[33432]: 94.6 scrub ok 2021-10-08T19:29:48.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:48 smithi142 ceph-mon[33432]: 94.9 scrub ok 2021-10-08T19:29:48.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:48.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:48 smithi142 ceph-mon[33432]: osdmap e129: 8 total, 8 up, 8 in 2021-10-08T19:29:48.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2276843018' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:48.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: 94.4 scrub ok 2021-10-08T19:29:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: 94.8 scrub ok 2021-10-08T19:29:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:29:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:49.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: 94.4 scrub ok 2021-10-08T19:29:49.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: 94.8 scrub ok 2021-10-08T19:29:49.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:49.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:29:49.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:49.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:49.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: 94.4 scrub ok 2021-10-08T19:29:49.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: 94.8 scrub ok 2021-10-08T19:29:49.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:49.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: osdmap e130: 8 total, 8 up, 8 in 2021-10-08T19:29:49.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:49.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:49.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:29:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[40655]: pgmap v168: 356 pgs: 32 creating+peering, 324 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2021-10-08T19:29:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[40655]: 94.0 scrub ok 2021-10-08T19:29:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[40655]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:29:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3696164663' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[31694]: pgmap v168: 356 pgs: 32 creating+peering, 324 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2021-10-08T19:29:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[31694]: 94.0 scrub ok 2021-10-08T19:29:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[31694]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:29:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3696164663' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:50 smithi142 ceph-mon[33432]: pgmap v168: 356 pgs: 32 creating+peering, 324 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2021-10-08T19:29:50.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:50 smithi142 ceph-mon[33432]: 94.0 scrub ok 2021-10-08T19:29:50.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:29:50.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:50 smithi142 ceph-mon[33432]: osdmap e131: 8 total, 8 up, 8 in 2021-10-08T19:29:50.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:50.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:29:50.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3696164663' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:50.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:52.299 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[31694]: pgmap v171: 292 pgs: 32 unknown, 260 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail; 5.0 KiB/s rd, 3 op/s 2021-10-08T19:29:52.300 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[31694]: 94.7 scrub ok 2021-10-08T19:29:52.300 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:52.300 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[31694]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:29:52.301 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2597429841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:52.301 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[40655]: pgmap v171: 292 pgs: 32 unknown, 260 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail; 5.0 KiB/s rd, 3 op/s 2021-10-08T19:29:52.301 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[40655]: 94.7 scrub ok 2021-10-08T19:29:52.301 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:52.302 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[40655]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:29:52.302 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2597429841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:52 smithi142 ceph-mon[33432]: pgmap v171: 292 pgs: 32 unknown, 260 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail; 5.0 KiB/s rd, 3 op/s 2021-10-08T19:29:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:52 smithi142 ceph-mon[33432]: 94.7 scrub ok 2021-10-08T19:29:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:52 smithi142 ceph-mon[33432]: osdmap e132: 8 total, 8 up, 8 in 2021-10-08T19:29:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2597429841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:52.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:52 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:52.316Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:52.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:52 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:52.316Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:52.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:52 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:52.316Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:29:53.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:29:53.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2597429841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:53.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:53 smithi112 ceph-mon[40655]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:29:53.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:53 smithi112 ceph-mon[40655]: 94.5 scrub ok 2021-10-08T19:29:53.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:29:53.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2597429841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:53.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:53 smithi112 ceph-mon[31694]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:29:53.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:53 smithi112 ceph-mon[31694]: 94.5 scrub ok 2021-10-08T19:29:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:29:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:29:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:29:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2597429841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:53 smithi142 ceph-mon[33432]: osdmap e133: 8 total, 8 up, 8 in 2021-10-08T19:29:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:53 smithi142 ceph-mon[33432]: 94.5 scrub ok 2021-10-08T19:29:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:53.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:53.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:29:53.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:29:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:29:53.506Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=9 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:29:54.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:54 smithi112 ceph-mon[40655]: pgmap v174: 300 pgs: 40 unknown, 260 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:54.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:54 smithi112 ceph-mon[40655]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:29:54.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3525681302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:54.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:54.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:54 smithi112 ceph-mon[31694]: pgmap v174: 300 pgs: 40 unknown, 260 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:54.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:54 smithi112 ceph-mon[31694]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:29:54.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3525681302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:54.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:54 smithi142 ceph-mon[33432]: pgmap v174: 300 pgs: 40 unknown, 260 active+clean; 217 MiB data, 917 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:29:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:54 smithi142 ceph-mon[33432]: osdmap e134: 8 total, 8 up, 8 in 2021-10-08T19:29:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3525681302' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:55 smithi142 ceph-mon[33432]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:29:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3144415320' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:55 smithi142 ceph-mon[33432]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:29:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:29:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:29:55] "GET /metrics HTTP/1.1" 200 160836 "" "Prometheus/2.18.1" 2021-10-08T19:29:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[40655]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:29:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3144415320' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[40655]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:29:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[31694]: osdmap e135: 8 total, 8 up, 8 in 2021-10-08T19:29:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3144415320' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:55.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:55.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:55 smithi112 ceph-mon[31694]: osdmap e136: 8 total, 8 up, 8 in 2021-10-08T19:29:56.371 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:56 smithi142 ceph-mon[33432]: pgmap v177: 332 pgs: 32 unknown, 32 creating+peering, 268 active+clean; 217 MiB data, 929 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:56.371 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:56 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:56.372 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:56 smithi142 ceph-mon[33432]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:29:56.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:56 smithi112 ceph-mon[31694]: pgmap v177: 332 pgs: 32 unknown, 32 creating+peering, 268 active+clean; 217 MiB data, 929 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:56.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:56 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:56.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:56 smithi112 ceph-mon[31694]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:29:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:56 smithi112 ceph-mon[40655]: pgmap v177: 332 pgs: 32 unknown, 32 creating+peering, 268 active+clean; 217 MiB data, 929 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:56.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:56 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:29:56.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:56 smithi112 ceph-mon[40655]: osdmap e137: 8 total, 8 up, 8 in 2021-10-08T19:29:56.774 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:29:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:29:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1096444912' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:29:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:57 smithi142 ceph-mon[33432]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:29:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3095457797' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1096444912' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:29:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[40655]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:29:57.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3095457797' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1096444912' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-10-08T19:29:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[31694]: osdmap e138: 8 total, 8 up, 8 in 2021-10-08T19:29:57.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3095457797' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: pgmap v180: 300 pgs: 32 unknown, 268 active+clean; 217 MiB data, 929 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2"}]: dispatch 2021-10-08T19:29:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3095457797' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:29:58.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:58.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:29:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: pgmap v180: 300 pgs: 32 unknown, 268 active+clean; 217 MiB data, 929 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2"}]: dispatch 2021-10-08T19:29:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3095457797' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:29:58.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:58.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:29:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: pgmap v180: 300 pgs: 32 unknown, 268 active+clean; 217 MiB data, 929 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:29:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2"}]: dispatch 2021-10-08T19:29:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:29:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3095457797' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:58.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-10-08T19:29:58.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: osdmap e139: 8 total, 8 up, 8 in 2021-10-08T19:29:58.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:29:58.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:29:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-10-08T19:30:00.448 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: pgmap v183: 300 pgs: 300 active+clean; 217 MiB data, 916 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:30:00.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:30:00.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:30:00.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:30:00.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3692954652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:00.449 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:30:00.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3692954652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:30:00.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 2 pool(s) do not have an application enabled 2021-10-08T19:30:00.450 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2021-10-08T19:30:00.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: pool 'test-rados-api-smithi112-83223-13' with cache_mode writeback needs hit_set_type to be set but it is not 2021-10-08T19:30:00.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:30:00.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:30:00.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: application not enabled on pool 'test-rados-api-smithi112-83299-14' 2021-10-08T19:30:00.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:30:00.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:30:00.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1027859687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:00.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:00.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:00 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:30:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: pgmap v183: 300 pgs: 300 active+clean; 217 MiB data, 916 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:30:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:30:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:30:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:30:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3692954652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:30:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3692954652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:30:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 2 pool(s) do not have an application enabled 2021-10-08T19:30:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2021-10-08T19:30:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: pool 'test-rados-api-smithi112-83223-13' with cache_mode writeback needs hit_set_type to be set but it is not 2021-10-08T19:30:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:30:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:30:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: application not enabled on pool 'test-rados-api-smithi112-83299-14' 2021-10-08T19:30:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:30:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:30:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1027859687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:00.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:00.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: pgmap v183: 300 pgs: 300 active+clean; 217 MiB data, 916 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:30:00.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-10-08T19:30:00.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: osdmap e140: 8 total, 8 up, 8 in 2021-10-08T19:30:00.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-10-08T19:30:00.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3692954652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:00.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-10-08T19:30:00.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3692954652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:00.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: osdmap e141: 8 total, 8 up, 8 in 2021-10-08T19:30:00.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 2 pool(s) do not have an application enabled 2021-10-08T19:30:00.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2021-10-08T19:30:00.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: pool 'test-rados-api-smithi112-83223-13' with cache_mode writeback needs hit_set_type to be set but it is not 2021-10-08T19:30:00.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:30:00.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:30:00.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: application not enabled on pool 'test-rados-api-smithi112-83299-14' 2021-10-08T19:30:00.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:30:00.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1"}]: dispatch 2021-10-08T19:30:00.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1027859687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:00.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:30:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:30:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[40655]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:30:01.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:01.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:01.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:30:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:01.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:30:01.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:01.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:01 smithi112 ceph-mon[31694]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:30:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:01 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:01 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:01 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:30:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/635193244' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi112-83169-1","app":"app1","key":"key1"}]': finished 2021-10-08T19:30:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:01 smithi142 ceph-mon[33432]: osdmap e142: 8 total, 8 up, 8 in 2021-10-08T19:30:02.023 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2021-10-08T19:30:02.024 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] Global test environment set-up. 2021-10-08T19:30:02.024 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2021-10-08T19:30:02.024 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2021-10-08T19:30:02.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2021-10-08T19:30:02.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-10-08T19:30:02.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: 2021-10-08T19:30:02.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2021-10-08T19:30:02.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: seed 83169 2021-10-08T19:30:02.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2021-10-08T19:30:02.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (1 ms) 2021-10-08T19:30:02.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2021-10-08T19:30:02.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (32 ms) 2021-10-08T19:30:02.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2021-10-08T19:30:02.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (10 ms) 2021-10-08T19:30:02.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2021-10-08T19:30:02.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (13 ms) 2021-10-08T19:30:02.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2021-10-08T19:30:02.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (14 ms) 2021-10-08T19:30:02.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2021-10-08T19:30:02.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (6 ms) 2021-10-08T19:30:02.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2021-10-08T19:30:02.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (2 ms) 2021-10-08T19:30:02.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2021-10-08T19:30:02.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (4 ms) 2021-10-08T19:30:02.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2021-10-08T19:30:02.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (2 ms) 2021-10-08T19:30:02.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2021-10-08T19:30:02.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (8 ms) 2021-10-08T19:30:02.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2021-10-08T19:30:02.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (2 ms) 2021-10-08T19:30:02.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2021-10-08T19:30:02.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (6 ms) 2021-10-08T19:30:02.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2021-10-08T19:30:02.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (6 ms) 2021-10-08T19:30:02.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2021-10-08T19:30:02.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: osd_max_attr_size = 0 2021-10-08T19:30:02.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2021-10-08T19:30:02.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1550 ms) 2021-10-08T19:30:02.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2021-10-08T19:30:02.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (539 ms) 2021-10-08T19:30:02.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2021-10-08T19:30:02.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: waiting for initial deep scrubs... 2021-10-08T19:30:02.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: done waiting, doing copies 2021-10-08T19:30:02.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: waiting for final deep scrubs... 2021-10-08T19:30:02.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: done waiting 2021-10-08T19:30:02.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (61166 ms) 2021-10-08T19:30:02.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2021-10-08T19:30:02.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (5 ms) 2021-10-08T19:30:02.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2021-10-08T19:30:02.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (3 ms) 2021-10-08T19:30:02.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2021-10-08T19:30:02.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4501 ms) 2021-10-08T19:30:02.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2021-10-08T19:30:02.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2021-10-08T19:30:02.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2021-10-08T19:30:02.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2021-10-08T19:30:02.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2021-10-08T19:30:02.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2021-10-08T19:30:02.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:02 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:02.316Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:02.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:02 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:02.316Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:02.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:02 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:02.316Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:30:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[31694]: pgmap v186: 332 pgs: 64 unknown, 268 active+clean; 217 MiB data, 916 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:30:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[31694]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:30:02.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/196663315' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:02.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:02.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[40655]: pgmap v186: 332 pgs: 64 unknown, 268 active+clean; 217 MiB data, 916 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:30:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[40655]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:30:02.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/196663315' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:02.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:02.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:02 smithi142 ceph-mon[33432]: pgmap v186: 332 pgs: 64 unknown, 268 active+clean; 217 MiB data, 916 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:30:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:02 smithi142 ceph-mon[33432]: osdmap e143: 8 total, 8 up, 8 in 2021-10-08T19:30:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/196663315' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:02.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:02.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:02.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:30:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:03.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: pgmap v189: 260 pgs: 32 unknown, 228 active+clean; 590 KiB data, 916 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:30:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:30:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:30:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1303451219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:03.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:03.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:03.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:03.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:03.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:03.506Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:30:03.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:03.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:03.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: pgmap v189: 260 pgs: 32 unknown, 228 active+clean; 590 KiB data, 916 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:30:03.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:03.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:30:03.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:03.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:30:03.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:03.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:03.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:03.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1303451219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:03.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:03.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:03.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:03.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: pgmap v189: 260 pgs: 32 unknown, 228 active+clean; 590 KiB data, 916 MiB used, 714 GiB / 715 GiB avail 2021-10-08T19:30:03.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83033-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:03.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:30:03.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:03.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: osdmap e144: 8 total, 8 up, 8 in 2021-10-08T19:30:03.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1141857148' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:03.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:03.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]: dispatch 2021-10-08T19:30:03.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1303451219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:03.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:04.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:04.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:30:04.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:30:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:04.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:30:04.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:04.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:30:04.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-14"}]': finished 2021-10-08T19:30:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:04.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: osdmap e145: 8 total, 8 up, 8 in 2021-10-08T19:30:04.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:04.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:04.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:04.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:05] "GET /metrics HTTP/1.1" 200 160836 "" "Prometheus/2.18.1" 2021-10-08T19:30:06.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: pgmap v192: 260 pgs: 32 creating+peering, 228 active+clean; 590 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:06.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:06.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:06.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:06.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:30:06.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:06.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:06.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:06.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:06.778 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:30:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:30:06.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: pgmap v192: 260 pgs: 32 creating+peering, 228 active+clean; 590 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:06.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:30:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:06.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:06.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:06.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:06.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: pgmap v192: 260 pgs: 32 creating+peering, 228 active+clean; 590 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83299-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: osdmap e146: 8 total, 8 up, 8 in 2021-10-08T19:30:06.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:06.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:06.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:06.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:30:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/773018577' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: pgmap v195: 300 pgs: 72 unknown, 228 active+clean; 590 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:30:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:07.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:30:07.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/773018577' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: pgmap v195: 300 pgs: 72 unknown, 228 active+clean; 590 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:07.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:07.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:07.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:07.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:07.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:30:07.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:07.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: osdmap e147: 8 total, 8 up, 8 in 2021-10-08T19:30:07.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/773018577' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:07.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: pgmap v195: 300 pgs: 72 unknown, 228 active+clean; 590 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:07.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83299-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:07.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:07.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:07.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:07.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: osdmap e148: 8 total, 8 up, 8 in 2021-10-08T19:30:07.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:09.022 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:08 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:30:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:09.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:09.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:09 smithi112 ceph-mon[31694]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:30:09.023 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:09 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:09.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:09.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:09 smithi142 ceph-mon[33432]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:30:09.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:09 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:09.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:09.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:09 smithi112 ceph-mon[40655]: osdmap e149: 8 total, 8 up, 8 in 2021-10-08T19:30:09.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:09 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:10 smithi142 ceph-mon[33432]: pgmap v198: 284 pgs: 284 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 MiB/s wr, 3 op/s 2021-10-08T19:30:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:10 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:30:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:10 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:30:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:10.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:10 smithi142 ceph-mon[33432]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:10.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:10 smithi142 ceph-mon[33432]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:30:10.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:10.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:10.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2018530662' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:10.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[40655]: pgmap v198: 284 pgs: 284 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 MiB/s wr, 3 op/s 2021-10-08T19:30:10.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:30:10.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:30:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:10.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[40655]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:10.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[40655]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:30:10.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:10.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:10.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2018530662' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:10.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[31694]: pgmap v198: 284 pgs: 284 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 MiB/s wr, 3 op/s 2021-10-08T19:30:10.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:30:10.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:30:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:10.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[31694]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:10.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[31694]: osdmap e150: 8 total, 8 up, 8 in 2021-10-08T19:30:10.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:10.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:10.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2018530662' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:11.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:11.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2018530662' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:11.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[40655]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:30:11.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:11.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:11.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:11.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:11.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2018530662' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:11.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[31694]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:30:11.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:11.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:11.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:11.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:11.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2018530662' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:11.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:11 smithi142 ceph-mon[33432]: osdmap e151: 8 total, 8 up, 8 in 2021-10-08T19:30:11.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:11.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4284372805' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:11.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]: dispatch 2021-10-08T19:30:12.318 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: pgmap v201: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2021-10-08T19:30:12.318 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:12.319 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:12.319 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:30:12.319 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:12.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.320 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: pgmap v201: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2021-10-08T19:30:12.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:12.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:12.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:30:12.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: pgmap v201: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2021-10-08T19:30:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-25"}]': finished 2021-10-08T19:30:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: osdmap e152: 8 total, 8 up, 8 in 2021-10-08T19:30:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]: dispatch 2021-10-08T19:30:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:12.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:12.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:12 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:12.316Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:12.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:12 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:12.316Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:12.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:12 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:12.316Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:30:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:30:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:13 smithi142 ceph-mon[33432]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:30:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4125897014' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:13.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:13.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:13.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[40655]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:30:13.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:13.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4125897014' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:13.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:13.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:13.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:13.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:13.506Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:13.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:13.506Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:30:13.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4200653832' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-24"}]': finished 2021-10-08T19:30:13.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:13.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[31694]: osdmap e153: 8 total, 8 up, 8 in 2021-10-08T19:30:13.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:13.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4125897014' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:13.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:14 smithi142 ceph-mon[33432]: pgmap v204: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4125897014' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:14 smithi142 ceph-mon[33432]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:30:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1836070950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:14 smithi142 ceph-mon[33432]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:30:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[40655]: pgmap v204: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4125897014' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[40655]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:30:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1836070950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:14.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[40655]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:30:14.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[31694]: pgmap v204: 268 pgs: 32 unknown, 236 active+clean; 598 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:14.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4125897014' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:14.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[31694]: osdmap e154: 8 total, 8 up, 8 in 2021-10-08T19:30:14.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1836070950' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:14.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:14.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:14.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:14.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:14 smithi112 ceph-mon[31694]: osdmap e155: 8 total, 8 up, 8 in 2021-10-08T19:30:15.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:15] "GET /metrics HTTP/1.1" 200 162918 "" "Prometheus/2.18.1" 2021-10-08T19:30:15.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:15 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:15.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:15 smithi112 ceph-mon[31694]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:30:15.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3544178121' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:15.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:15 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:15.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:15 smithi112 ceph-mon[40655]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:30:15.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3544178121' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:15 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:15 smithi142 ceph-mon[33432]: osdmap e156: 8 total, 8 up, 8 in 2021-10-08T19:30:15.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3544178121' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:16.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:30:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:30:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:16 smithi142 ceph-mon[33432]: pgmap v207: 276 pgs: 32 creating+peering, 8 unknown, 236 active+clean; 614 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-10-08T19:30:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3544178121' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:16 smithi142 ceph-mon[33432]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:30:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/937448754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:16.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[40655]: pgmap v207: 276 pgs: 32 creating+peering, 8 unknown, 236 active+clean; 614 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-10-08T19:30:16.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3544178121' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:16.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[40655]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:30:16.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/937448754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:16.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:16.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:16.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[31694]: pgmap v207: 276 pgs: 32 creating+peering, 8 unknown, 236 active+clean; 614 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-10-08T19:30:16.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3544178121' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:16.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[31694]: osdmap e157: 8 total, 8 up, 8 in 2021-10-08T19:30:16.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/937448754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:16.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:16.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:18.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP ( api_aio: Running main() from gmock_main.cc 2021-10-08T19:30:18.083 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [==========] Running 40 tests from 2 test suites. 2021-10-08T19:30:18.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [----------] Global test environment set-up. 2021-10-08T19:30:18.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [----------] 24 tests from LibRadosAio 2021-10-08T19:30:18.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2021-10-08T19:30:18.084 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.TooBig (7647 ms) 2021-10-08T19:30:18.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2021-10-08T19:30:18.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (4210 ms) 2021-10-08T19:30:18.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2021-10-08T19:30:18.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (2989 ms) 2021-10-08T19:30:18.085 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2021-10-08T19:30:18.086 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3086 ms) 2021-10-08T19:30:18.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2021-10-08T19:30:18.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3353 ms) 2021-10-08T19:30:18.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2021-10-08T19:30:18.087 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (2572 ms) 2021-10-08T19:30:18.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2021-10-08T19:30:18.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3050 ms) 2021-10-08T19:30:18.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2021-10-08T19:30:18.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3330 ms) 2021-10-08T19:30:18.088 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2021-10-08T19:30:18.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3121 ms) 2021-10-08T19:30:18.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2021-10-08T19:30:18.089 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2517 ms) 2021-10-08T19:30:18.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2021-10-08T19:30:18.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3052 ms) 2021-10-08T19:30:18.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2021-10-08T19:30:18.090 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3008 ms) 2021-10-08T19:30:18.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2021-10-08T19:30:18.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3164 ms) 2021-10-08T19:30:18.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2021-10-08T19:30:18.091 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2998 ms) 2021-10-08T19:30:18.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2021-10-08T19:30:18.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.Flush (2767 ms) 2021-10-08T19:30:18.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2021-10-08T19:30:18.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2982 ms) 2021-10-08T19:30:18.092 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2021-10-08T19:30:18.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3016 ms) 2021-10-08T19:30:18.093 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2021-10-08T19:30:18.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3006 ms) 2021-10-08T19:30:18.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2021-10-08T19:30:18.094 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (2994 ms) 2021-10-08T19:30:18.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2021-10-08T19:30:18.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3023 ms) 2021-10-08T19:30:18.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2021-10-08T19:30:18.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3002 ms) 2021-10-08T19:30:18.095 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2021-10-08T19:30:18.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3028 ms) 2021-10-08T19:30:18.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2021-10-08T19:30:18.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2931 ms) 2021-10-08T19:30:18.096 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2021-10-08T19:30:18.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3240 ms) 2021-10-08T19:30:18.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [----------] 24 tests from LibRadosAio (78089 ms total) 2021-10-08T19:30:18.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: 2021-10-08T19:30:18.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2021-10-08T19:30:18.097 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2021-10-08T19:30:18.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6791 ms) 2021-10-08T19:30:18.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2021-10-08T19:30:18.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7036 ms) 2021-10-08T19:30:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: pgmap v210: 300 pgs: 64 unknown, 236 active+clean; 614 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-10-08T19:30:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/937448754' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:30:18.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:18.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:18.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:18.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:18.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:18.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:18.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:18.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:18.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:18.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: pgmap v210: 300 pgs: 64 unknown, 236 active+clean; 614 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-10-08T19:30:18.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/937448754' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:18.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:18.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:30:18.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:18.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:18.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:18.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:18.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:18.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:18.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:18.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: pgmap v210: 300 pgs: 64 unknown, 236 active+clean; 614 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-10-08T19:30:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/937448754' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: osdmap e158: 8 total, 8 up, 8 in 2021-10-08T19:30:18.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3852011740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:18.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]: dispatch 2021-10-08T19:30:18.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:18.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:18.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:30:18.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:30:18.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:30:18.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:30:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3917668706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:30:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:30:19.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:19.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3917668706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:19.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]': finished 2021-10-08T19:30:19.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:19.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:30:19.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4213800498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:19.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:19.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:19.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:30:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3917668706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:30:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:30:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:19.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3917668706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:19.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]': finished 2021-10-08T19:30:19.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:19.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:30:19.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4213800498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:19.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:19.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-26"}]': finished 2021-10-08T19:30:19.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:19.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: osdmap e159: 8 total, 8 up, 8 in 2021-10-08T19:30:19.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3917668706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:19.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:30:19.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]: dispatch 2021-10-08T19:30:19.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:19.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:19.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3917668706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:19.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-13"}]': finished 2021-10-08T19:30:19.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:19.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: osdmap e160: 8 total, 8 up, 8 in 2021-10-08T19:30:19.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.584 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:19.585 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4213800498' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:19.586 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:20.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[31694]: pgmap v213: 268 pgs: 32 creating+peering, 236 active+clean; 607 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 21 op/s 2021-10-08T19:30:20.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:20.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:20.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[31694]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:30:20.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:20.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[40655]: pgmap v213: 268 pgs: 32 creating+peering, 236 active+clean; 607 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 21 op/s 2021-10-08T19:30:20.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:20.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:20.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[40655]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:30:20.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:21.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:20 smithi142 ceph-mon[33432]: pgmap v213: 268 pgs: 32 creating+peering, 236 active+clean; 607 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 21 op/s 2021-10-08T19:30:21.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:21.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83169-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:21.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:20 smithi142 ceph-mon[33432]: osdmap e161: 8 total, 8 up, 8 in 2021-10-08T19:30:21.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:22.024 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.Rou api_snapshots_pp: Running main() from gmock_main.cc 2021-10-08T19:30:22.024 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [==========] Running 18 tests from 4 test suites. 2021-10-08T19:30:22.024 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2021-10-08T19:30:22.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2021-10-08T19:30:22.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: seed 83299 2021-10-08T19:30:22.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2021-10-08T19:30:22.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (1867 ms) 2021-10-08T19:30:22.025 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2021-10-08T19:30:22.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (3017 ms) 2021-10-08T19:30:22.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2021-10-08T19:30:22.026 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (1984 ms) 2021-10-08T19:30:22.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2021-10-08T19:30:22.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2086 ms) 2021-10-08T19:30:22.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2021-10-08T19:30:22.027 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4021 ms) 2021-10-08T19:30:22.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (12975 ms total) 2021-10-08T19:30:22.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: 2021-10-08T19:30:22.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP 2021-10-08T19:30:22.028 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2021-10-08T19:30:22.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4052 ms) 2021-10-08T19:30:22.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2021-10-08T19:30:22.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (4399 ms) 2021-10-08T19:30:22.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2021-10-08T19:30:22.029 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (5554 ms) 2021-10-08T19:30:22.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2021-10-08T19:30:22.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4012 ms) 2021-10-08T19:30:22.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2021-10-08T19:30:22.030 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (1977 ms) 2021-10-08T19:30:22.031 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2021-10-08T19:30:22.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: deleting snap 23 in pool test-rados-api-smithi112-83299-7 2021-10-08T19:30:22.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: waiting for snaps to purge 2021-10-08T19:30:22.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17961 ms) 2021-10-08T19:30:22.032 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP (37955 ms total) 2021-10-08T19:30:22.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: 2021-10-08T19:30:22.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2021-10-08T19:30:22.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2021-10-08T19:30:22.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3005 ms) 2021-10-08T19:30:22.033 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2021-10-08T19:30:22.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2033 ms) 2021-10-08T19:30:22.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2021-10-08T19:30:22.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (1995 ms) 2021-10-08T19:30:22.034 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2021-10-08T19:30:22.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1930 ms) 2021-10-08T19:30:22.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8963 ms total) 2021-10-08T19:30:22.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: 2021-10-08T19:30:22.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2021-10-08T19:30:22.035 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2021-10-08T19:30:22.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4019 ms) 2021-10-08T19:30:22.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2021-10-08T19:30:22.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4010 ms) 2021-10-08T19:30:22.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2021-10-08T19:30:22.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4001 ms) 2021-10-08T19:30:22.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12030 ms total) 2021-10-08T19:30:22.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: 2021-10-08T19:30:22.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2021-10-08T19:30:22.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [==========] 18 tests from 4 test suites ran. (95760 ms total) 2021-10-08T19:30:22.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_snapshots_pp: [ PASSED ] 18 tests. 2021-10-08T19:30:22.039 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:30:22.039 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83147 2021-10-08T19:30:22.040 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83147 2021-10-08T19:30:22.040 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:30:22.040 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83084 2021-10-08T19:30:22.040 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83084 2021-10-08T19:30:22.040 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:30:22.041 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83068 2021-10-08T19:30:22.041 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83068 2021-10-08T19:30:22.042 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:30:22.042 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83363 2021-10-08T19:30:22.043 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83363 2021-10-08T19:30:22.043 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:30:22.044 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83339 2021-10-08T19:30:22.044 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83339 2021-10-08T19:30:22.044 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:30:22.044 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83535 2021-10-08T19:30:22.044 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83535 2021-10-08T19:30:22.045 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:30:22.045 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83036 2021-10-08T19:30:22.045 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83036 2021-10-08T19:30:22.318 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: pgmap v216: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:22.318 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:22.319 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:22.319 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:30:22.319 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:22.320 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3043218669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.320 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:22.320 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.320 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.320 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:22.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:22.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:22.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:22.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: pgmap v216: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:30:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:22.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3043218669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:22.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:22.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:22.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:22.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:22 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: pgmap v216: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: osdmap e162: 8 total, 8 up, 8 in 2021-10-08T19:30:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4153658385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3043218669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]: dispatch 2021-10-08T19:30:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:22.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:22.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:22.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:22.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:22 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:30:22.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:22 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:22.317Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:22.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:22 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:22.317Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:22.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:22 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:22.317Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:30:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:30:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:30:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:23.548 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:23.507Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:23.549 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:23.507Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:23.549 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:23.507Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:30:23.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:23.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:23.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:23.550 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:23.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:30:23.551 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:23.552 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:23.552 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:23.553 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:23.553 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:23.554 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83299-19"}]': finished 2021-10-08T19:30:23.554 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:23.555 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:23.555 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83169-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:23.556 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: osdmap e163: 8 total, 8 up, 8 in 2021-10-08T19:30:23.557 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:23.557 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:23.558 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:30:23.558 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:23.559 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:30:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: pgmap v219: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:30:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:24.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:24.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:24.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:24.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:24.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:30:24.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2317880314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:24.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:24.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:24.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: pgmap v219: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:24.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:30:24.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:30:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2317880314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:24.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:24.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:24.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: pgmap v219: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:24.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: osdmap e164: 8 total, 8 up, 8 in 2021-10-08T19:30:24.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:24.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:24.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83169-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:24.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:24.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:24.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: osdmap e165: 8 total, 8 up, 8 in 2021-10-08T19:30:24.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2317880314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:24.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:24.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3412954014' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:24.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:24.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]: dispatch 2021-10-08T19:30:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:25] "GET /metrics HTTP/1.1" 200 159656 "" "Prometheus/2.18.1" 2021-10-08T19:30:26.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: pgmap v222: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:26.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2317880314' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:26.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]': finished 2021-10-08T19:30:26.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:26.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:30:26.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]: dispatch 2021-10-08T19:30:26.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]: dispatch 2021-10-08T19:30:26.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:26.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:26.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:26.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: pgmap v222: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:26.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2317880314' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:26.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]': finished 2021-10-08T19:30:26.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:26.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:30:26.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]: dispatch 2021-10-08T19:30:26.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]: dispatch 2021-10-08T19:30:26.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:26.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:26.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:26.402 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: pgmap v222: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:26.403 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2317880314' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:26.403 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-15"}]': finished 2021-10-08T19:30:26.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-27"}]': finished 2021-10-08T19:30:26.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: osdmap e166: 8 total, 8 up, 8 in 2021-10-08T19:30:26.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]: dispatch 2021-10-08T19:30:26.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]: dispatch 2021-10-08T19:30:26.405 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:26.405 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:26.405 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:26.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:30:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:30:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]': finished 2021-10-08T19:30:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:27.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[31694]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:30:27.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:27.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:27.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:27.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:27 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:30:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:27.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:27.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]': finished 2021-10-08T19:30:27.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:27.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[40655]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:30:27.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:27.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:27.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:27 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-15", "mode": "writeback"}]': finished 2021-10-08T19:30:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:27 smithi142 ceph-mon[33432]: osdmap e167: 8 total, 8 up, 8 in 2021-10-08T19:30:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:27.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:28.035 INFO:tasks.workunit.client.0.smithi112.stdout:67870 ms total) 2021-10-08T19:30:28.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: 2021-10-08T19:30:28.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2021-10-08T19:30:28.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2021-10-08T19:30:28.036 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (289 ms) 2021-10-08T19:30:28.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (289 ms total) 2021-10-08T19:30:28.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: 2021-10-08T19:30:28.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2021-10-08T19:30:28.037 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2021-10-08T19:30:28.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (54 ms) 2021-10-08T19:30:28.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2021-10-08T19:30:28.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (9 ms) 2021-10-08T19:30:28.038 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (63 ms total) 2021-10-08T19:30:28.039 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: 2021-10-08T19:30:28.039 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2021-10-08T19:30:28.039 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2021-10-08T19:30:28.039 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (42 ms) 2021-10-08T19:30:28.039 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2021-10-08T19:30:28.040 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (4 ms) 2021-10-08T19:30:28.040 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (46 ms total) 2021-10-08T19:30:28.040 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: 2021-10-08T19:30:28.040 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2021-10-08T19:30:28.040 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2021-10-08T19:30:28.041 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (29 ms) 2021-10-08T19:30:28.041 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2021-10-08T19:30:28.041 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (9 ms) 2021-10-08T19:30:28.041 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (38 ms total) 2021-10-08T19:30:28.042 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: 2021-10-08T19:30:28.042 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2021-10-08T19:30:28.042 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2021-10-08T19:30:28.042 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1024 ms) 2021-10-08T19:30:28.043 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1024 ms total) 2021-10-08T19:30:28.043 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: 2021-10-08T19:30:28.043 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [----------] Global test environment tear-down 2021-10-08T19:30:28.043 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (101808 ms total) 2021-10-08T19:30:28.043 INFO:tasks.workunit.client.0.smithi112.stdout: api_misc_pp: [ PASSED ] 31 tests. 2021-10-08T19:30:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: pgmap v225: 228 pgs: 228 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:30:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3502005412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:30:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:28.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3502005412' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:28.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:28.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:30:28.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:28.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:28.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:28.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: pgmap v225: 228 pgs: 228 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:28.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:30:28.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:28.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3502005412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:28.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:28.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:28.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:28.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:28.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:30:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:28.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:28.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:28.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3502005412' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:28.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:28.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:30:28.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:28.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:28.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:28.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: pgmap v225: 228 pgs: 228 active+clean; 583 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:28.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: osdmap e168: 8 total, 8 up, 8 in 2021-10-08T19:30:28.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]: dispatch 2021-10-08T19:30:28.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3502005412' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:28.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:28.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:28.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:28.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:28.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:30:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:28.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:28.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/306365954' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83169-36"}]': finished 2021-10-08T19:30:28.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3502005412' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:28.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:28.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: osdmap e169: 8 total, 8 up, 8 in 2021-10-08T19:30:28.779 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:28.779 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]: dispatch 2021-10-08T19:30:29.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:29 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:29.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]': finished 2021-10-08T19:30:29.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:29 smithi112 ceph-mon[31694]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:30:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:29 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]': finished 2021-10-08T19:30:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:29 smithi112 ceph-mon[40655]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:30:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:29 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-15"}]': finished 2021-10-08T19:30:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:29 smithi142 ceph-mon[33432]: osdmap e170: 8 total, 8 up, 8 in 2021-10-08T19:30:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[40655]: pgmap v228: 268 pgs: 8 creating+peering, 260 active+clean; 584 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:30:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[40655]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:30:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2550447870' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:30.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[31694]: pgmap v228: 268 pgs: 8 creating+peering, 260 active+clean; 584 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:30:30.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[31694]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:30:30.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:30.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2550447870' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:30.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:30 smithi142 ceph-mon[33432]: pgmap v228: 268 pgs: 8 creating+peering, 260 active+clean; 584 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:30:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:30 smithi142 ceph-mon[33432]: osdmap e171: 8 total, 8 up, 8 in 2021-10-08T19:30:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2550447870' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:32.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[31694]: pgmap v231: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:32.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:32.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:32.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[31694]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:30:32.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:32.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:32.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:32.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[40655]: pgmap v231: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:32.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:32.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:32.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[40655]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:30:32.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:32.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:32.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:32 smithi142 ceph-mon[33432]: pgmap v231: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:30:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:32 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:32.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:32.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:32 smithi142 ceph-mon[33432]: osdmap e172: 8 total, 8 up, 8 in 2021-10-08T19:30:32.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:32 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]: dispatch 2021-10-08T19:30:32.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:32 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:32.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:33.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:33.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:33.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:30:33.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:33.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:33.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:33.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:33.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:30:33.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:33.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:33.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.330 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.331 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:30:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:33.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2894626663' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-28"}]': finished 2021-10-08T19:30:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: osdmap e173: 8 total, 8 up, 8 in 2021-10-08T19:30:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:33.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:33.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:33.507Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:33.507Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:33.507Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:30:34.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: pgmap v234: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:34.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:34.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:34.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:30:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/691452252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:34.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:34.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:34.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: pgmap v234: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:34.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:34.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:34.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:30:34.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/691452252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:34.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:34.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:34.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:34.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:34.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:34.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: pgmap v234: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:34.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:34.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:34.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: osdmap e174: 8 total, 8 up, 8 in 2021-10-08T19:30:34.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/691452252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:34.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:34.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:34.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:34.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:34.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:35.066 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: Running main() from gmock_main.cc 2021-10-08T19:30:35.066 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [==========] Running 54 tests from 4 test suites. 2021-10-08T19:30:35.067 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] Global test environment set-up. 2021-10-08T19:30:35.067 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] 29 tests from LibRadosAio 2021-10-08T19:30:35.067 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2021-10-08T19:30:35.067 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (6960 ms) 2021-10-08T19:30:35.068 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2021-10-08T19:30:35.068 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (24381 ms) 2021-10-08T19:30:35.068 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2021-10-08T19:30:35.068 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (5537 ms) 2021-10-08T19:30:35.068 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2021-10-08T19:30:35.069 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3054 ms) 2021-10-08T19:30:35.069 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2021-10-08T19:30:35.069 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3017 ms) 2021-10-08T19:30:35.069 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2021-10-08T19:30:35.070 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2896 ms) 2021-10-08T19:30:35.070 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2021-10-08T19:30:35.070 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3018 ms) 2021-10-08T19:30:35.070 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2021-10-08T19:30:35.071 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3000 ms) 2021-10-08T19:30:35.071 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2021-10-08T19:30:35.071 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2990 ms) 2021-10-08T19:30:35.071 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2021-10-08T19:30:35.072 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3005 ms) 2021-10-08T19:30:35.072 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2021-10-08T19:30:35.072 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2998 ms) 2021-10-08T19:30:35.072 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2021-10-08T19:30:35.072 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3018 ms) 2021-10-08T19:30:35.073 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2021-10-08T19:30:35.073 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3009 ms) 2021-10-08T19:30:35.073 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2021-10-08T19:30:35.073 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3031 ms) 2021-10-08T19:30:35.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2021-10-08T19:30:35.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3000 ms) 2021-10-08T19:30:35.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2021-10-08T19:30:35.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2945 ms) 2021-10-08T19:30:35.074 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2021-10-08T19:30:35.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3003 ms) 2021-10-08T19:30:35.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2021-10-08T19:30:35.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2996 ms) 2021-10-08T19:30:35.075 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2021-10-08T19:30:35.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3020 ms) 2021-10-08T19:30:35.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2021-10-08T19:30:35.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3007 ms) 2021-10-08T19:30:35.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2021-10-08T19:30:35.076 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3016 ms) 2021-10-08T19:30:35.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2021-10-08T19:30:35.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3204 ms) 2021-10-08T19:30:35.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2021-10-08T19:30:35.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2991 ms) 2021-10-08T19:30:35.077 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2021-10-08T19:30:35.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (2765 ms) 2021-10-08T19:30:35.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2021-10-08T19:30:35.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripAppendPP (3007 ms) 2021-10-08T19:30:35.078 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2021-10-08T19:30:35.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2986 ms) 2021-10-08T19:30:35.079 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2021-10-08T19:30:35.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:35] "GET /metrics HTTP/1.1" 200 159656 "" "Prometheus/2.18.1" 2021-10-08T19:30:35.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:35.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]': finished 2021-10-08T19:30:35.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[40655]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:30:35.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]: dispatch 2021-10-08T19:30:35.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]: dispatch 2021-10-08T19:30:35.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:35.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]': finished 2021-10-08T19:30:35.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[31694]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:30:35.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]: dispatch 2021-10-08T19:30:35.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]: dispatch 2021-10-08T19:30:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-17"}]': finished 2021-10-08T19:30:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:35 smithi142 ceph-mon[33432]: osdmap e175: 8 total, 8 up, 8 in 2021-10-08T19:30:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]: dispatch 2021-10-08T19:30:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]: dispatch 2021-10-08T19:30:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[40655]: pgmap v237: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:36.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:36.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]': finished 2021-10-08T19:30:36.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[40655]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:30:36.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:36.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[31694]: pgmap v237: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:36.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]': finished 2021-10-08T19:30:36.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[31694]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:30:36.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:36.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:36.407 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:36 smithi142 ceph-mon[33432]: pgmap v237: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:36.407 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:36 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:36.407 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:36.407 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-17", "mode": "writeback"}]': finished 2021-10-08T19:30:36.408 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:36 smithi142 ceph-mon[33432]: osdmap e176: 8 total, 8 up, 8 in 2021-10-08T19:30:36.408 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:36.408 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:36.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:30:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:30:37.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:36 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:30:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:37.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:37.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[31694]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:30:37.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:37.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:37.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3247023213' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:37.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:37.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:37.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:37.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[40655]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:30:37.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:37.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:37.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3247023213' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:37.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:37.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:37 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:37 smithi142 ceph-mon[33432]: osdmap e177: 8 total, 8 up, 8 in 2021-10-08T19:30:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]: dispatch 2021-10-08T19:30:37.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3247023213' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:37.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:37.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:37 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:38.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:38.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: pgmap v240: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:30:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:30:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]': finished 2021-10-08T19:30:38.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:38.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:30:38.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:38.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:38.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:38.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: pgmap v240: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:38.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:30:38.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:30:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:38.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:38.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]': finished 2021-10-08T19:30:38.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:38.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:30:38.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:38.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: pgmap v240: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:30:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:30:36] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-17"}]': finished 2021-10-08T19:30:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:38.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: osdmap e178: 8 total, 8 up, 8 in 2021-10-08T19:30:38.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:38.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:39 smithi142 ceph-mon[33432]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:30:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:39.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:39 smithi112 ceph-mon[40655]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:30:39.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:39.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:39 smithi112 ceph-mon[31694]: osdmap e179: 8 total, 8 up, 8 in 2021-10-08T19:30:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/333174426' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]: dispatch 2021-10-08T19:30:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: pgmap v243: 196 pgs: 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:30:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1110914196' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: pgmap v243: 196 pgs: 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:30:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1110914196' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: pgmap v243: 196 pgs: 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:40.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-29"}]': finished 2021-10-08T19:30:40.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: osdmap e180: 8 total, 8 up, 8 in 2021-10-08T19:30:40.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1110914196' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:40.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:40.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:40.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:30:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1110914196' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:30:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:30:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:30:41.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:41.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:41.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:41.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:41.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1110914196' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:30:41.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:30:41.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:41.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:41.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:41.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: osdmap e181: 8 total, 8 up, 8 in 2021-10-08T19:30:41.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:41.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:41.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:41.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:41.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1110914196' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:30:41.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]: dispatch 2021-10-08T19:30:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:42 smithi142 ceph-mon[33432]: pgmap v246: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]': finished 2021-10-08T19:30:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:42 smithi142 ceph-mon[33432]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:30:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[40655]: pgmap v246: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]': finished 2021-10-08T19:30:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[40655]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:30:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[31694]: pgmap v246: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi112-83041-31", "var": "eio", "val": "true"}]': finished 2021-10-08T19:30:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[31694]: osdmap e182: 8 total, 8 up, 8 in 2021-10-08T19:30:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:43.508 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:43.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]': finished 2021-10-08T19:30:43.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[40655]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:30:43.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.510 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:43.510 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]': finished 2021-10-08T19:30:43.510 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[31694]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:30:43.511 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.511 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:30:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:43.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:43.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-19"}]': finished 2021-10-08T19:30:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:43 smithi142 ceph-mon[33432]: osdmap e183: 8 total, 8 up, 8 in 2021-10-08T19:30:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]: dispatch 2021-10-08T19:30:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:43.507Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:43.507Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:43.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:43.507Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:30:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:44 smithi142 ceph-mon[33432]: pgmap v249: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:44 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]': finished 2021-10-08T19:30:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:44 smithi142 ceph-mon[33432]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:30:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2274932264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:44.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[31694]: pgmap v249: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]': finished 2021-10-08T19:30:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[31694]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:30:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2274932264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:44.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:44.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:44.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[40655]: pgmap v249: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 284 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:44.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:44.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-19", "mode": "writeback"}]': finished 2021-10-08T19:30:44.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[40655]: osdmap e184: 8 total, 8 up, 8 in 2021-10-08T19:30:44.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2274932264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:44.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:44.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2274932264' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:45 smithi142 ceph-mon[33432]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:30:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:45.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:45] "GET /metrics HTTP/1.1" 200 158605 "" "Prometheus/2.18.1" 2021-10-08T19:30:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2274932264' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[40655]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:30:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:45.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2274932264' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:45.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:45.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[31694]: osdmap e185: 8 total, 8 up, 8 in 2021-10-08T19:30:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]: dispatch 2021-10-08T19:30:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:46.417 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:46 smithi142 ceph-mon[33432]: pgmap v252: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:30:46.418 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:46 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:46.418 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]': finished 2021-10-08T19:30:46.418 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:46.419 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:46 smithi142 ceph-mon[33432]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:30:46.419 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:46 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:46.419 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[40655]: pgmap v252: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:30:46.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:46.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]': finished 2021-10-08T19:30:46.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:46.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[40655]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:30:46.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:46.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:46.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[31694]: pgmap v252: 260 pgs: 32 creating+peering, 228 active+clean; 583 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:30:46.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:46.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-19"}]': finished 2021-10-08T19:30:46.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:46.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[31694]: osdmap e186: 8 total, 8 up, 8 in 2021-10-08T19:30:46.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3326480878' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:46.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]: dispatch 2021-10-08T19:30:46.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:30:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:30:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:30:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/350480726' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:30:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/350480726' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:47.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-30"}]': finished 2021-10-08T19:30:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: osdmap e187: 8 total, 8 up, 8 in 2021-10-08T19:30:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/350480726' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:47.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:47.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: pgmap v255: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:30:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:48.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:48.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:48.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:48.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:48.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: pgmap v255: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:30:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:48.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:48.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: pgmap v255: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:30:48.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:48.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:48.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: osdmap e188: 8 total, 8 up, 8 in 2021-10-08T19:30:48.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:48.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:48.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:48.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:49 smithi142 ceph-mon[33432]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:30:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2471152407' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[40655]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:30:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2471152407' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[31694]: osdmap e189: 8 total, 8 up, 8 in 2021-10-08T19:30:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2471152407' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:49.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:49.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:50 smithi142 ceph-mon[33432]: pgmap v258: 292 pgs: 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:30:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:50 smithi142 ceph-mon[33432]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:30:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[31694]: pgmap v258: 292 pgs: 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:30:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:50.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[31694]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:30:50.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:50.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:50.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[40655]: pgmap v258: 292 pgs: 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:30:50.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:50.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:50.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:50.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[40655]: osdmap e190: 8 total, 8 up, 8 in 2021-10-08T19:30:50.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:50.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]': finished 2021-10-08T19:30:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:51 smithi142 ceph-mon[33432]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:30:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/704101288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]: dispatch 2021-10-08T19:30:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]: dispatch 2021-10-08T19:30:51.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]': finished 2021-10-08T19:30:51.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[31694]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:30:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/704101288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]: dispatch 2021-10-08T19:30:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]: dispatch 2021-10-08T19:30:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-21"}]': finished 2021-10-08T19:30:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[40655]: osdmap e191: 8 total, 8 up, 8 in 2021-10-08T19:30:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/704101288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:51.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]: dispatch 2021-10-08T19:30:51.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]: dispatch 2021-10-08T19:30:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: pgmap v261: 332 pgs: 40 unknown, 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]': finished 2021-10-08T19:30:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:30:52.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:52.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:52.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:52.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: pgmap v261: 332 pgs: 40 unknown, 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]': finished 2021-10-08T19:30:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:30:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: pgmap v261: 332 pgs: 40 unknown, 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:30:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:30:52.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:52.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-21", "mode": "writeback"}]': finished 2021-10-08T19:30:52.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: osdmap e192: 8 total, 8 up, 8 in 2021-10-08T19:30:52.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:52.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:52.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:52.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:30:53.509 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:53.510 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:53.510 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[40655]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:30:53.510 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:53.511 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:53.511 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:53.511 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:53.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:53.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:53.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[31694]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:30:53.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:53.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:53.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:53.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:30:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:30:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:30:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:53 smithi142 ceph-mon[33432]: osdmap e193: 8 total, 8 up, 8 in 2021-10-08T19:30:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]: dispatch 2021-10-08T19:30:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1355401679' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]: dispatch 2021-10-08T19:30:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:53.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:53.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:30:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:30:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:30:53.508Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:30:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: pgmap v264: 292 pgs: 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]': finished 2021-10-08T19:30:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:30:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: pgmap v264: 292 pgs: 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:54.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]': finished 2021-10-08T19:30:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:30:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: pgmap v264: 292 pgs: 32 creating+peering, 260 active+clean; 583 KiB data, 306 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:30:54.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:30:54.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-21"}]': finished 2021-10-08T19:30:54.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-31"}]': finished 2021-10-08T19:30:54.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: osdmap e194: 8 total, 8 up, 8 in 2021-10-08T19:30:54.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:54.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:54.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:30:55.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:54 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:30:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:55 smithi142 ceph-mon[33432]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:30:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:55 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:30:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:30:55] "GET /metrics HTTP/1.1" 200 159812 "" "Prometheus/2.18.1" 2021-10-08T19:30:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[31694]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:30:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:30:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[40655]: osdmap e195: 8 total, 8 up, 8 in 2021-10-08T19:30:55.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:55.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:55.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:55 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:30:56.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:30:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:30:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:56 smithi142 ceph-mon[33432]: pgmap v267: 196 pgs: 196 active+clean; 583 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:30:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:56 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:56 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:30:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:56 smithi142 ceph-mon[33432]: osdmap e196: 8 total, 8 up, 8 in 2021-10-08T19:30:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1716452097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[40655]: pgmap v267: 196 pgs: 196 active+clean; 583 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:30:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:30:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[40655]: osdmap e196: 8 total, 8 up, 8 in 2021-10-08T19:30:56.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1716452097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[31694]: pgmap v267: 196 pgs: 196 active+clean; 583 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:30:56.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:30:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:30:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:30:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[31694]: osdmap e196: 8 total, 8 up, 8 in 2021-10-08T19:30:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1716452097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:56.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:57.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:30:57.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.404 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.405 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:57 smithi142 ceph-mon[33432]: osdmap e197: 8 total, 8 up, 8 in 2021-10-08T19:30:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:30:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:57 smithi112 ceph-mon[40655]: osdmap e197: 8 total, 8 up, 8 in 2021-10-08T19:30:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:30:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:57 smithi112 ceph-mon[31694]: osdmap e197: 8 total, 8 up, 8 in 2021-10-08T19:30:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:58 smithi142 ceph-mon[33432]: pgmap v270: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:30:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:58 smithi142 ceph-mon[33432]: osdmap e198: 8 total, 8 up, 8 in 2021-10-08T19:30:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/738372108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:58.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:58.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[40655]: pgmap v270: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:30:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[40655]: osdmap e198: 8 total, 8 up, 8 in 2021-10-08T19:30:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/738372108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:58.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:30:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[31694]: pgmap v270: 268 pgs: 72 unknown, 196 active+clean; 583 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:30:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[31694]: osdmap e198: 8 total, 8 up, 8 in 2021-10-08T19:30:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/738372108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:30:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:30:59.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/738372108' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:59.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:59.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: osdmap e199: 8 total, 8 up, 8 in 2021-10-08T19:30:59.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:30:59.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:30:59.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:59.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:59.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: pgmap v273: 292 pgs: 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:59.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]': finished 2021-10-08T19:30:59.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:30:59.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:30:59 smithi142 ceph-mon[33432]: osdmap e200: 8 total, 8 up, 8 in 2021-10-08T19:30:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/738372108' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: osdmap e199: 8 total, 8 up, 8 in 2021-10-08T19:30:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:30:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:30:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:59.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:59.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: pgmap v273: 292 pgs: 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:59.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]': finished 2021-10-08T19:30:59.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:30:59.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[40655]: osdmap e200: 8 total, 8 up, 8 in 2021-10-08T19:30:59.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/738372108' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:30:59.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:30:59.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: osdmap e199: 8 total, 8 up, 8 in 2021-10-08T19:30:59.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:30:59.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:30:59.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:59.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:30:59.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: pgmap v273: 292 pgs: 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:30:59.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-23"}]': finished 2021-10-08T19:30:59.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:30:59.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:30:59 smithi112 ceph-mon[31694]: osdmap e200: 8 total, 8 up, 8 in 2021-10-08T19:31:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:31:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:31:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]: dispatch 2021-10-08T19:31:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]: dispatch 2021-10-08T19:31:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2423580106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:31:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]': finished 2021-10-08T19:31:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:00 smithi142 ceph-mon[33432]: osdmap e201: 8 total, 8 up, 8 in 2021-10-08T19:31:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:31:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:31:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]: dispatch 2021-10-08T19:31:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]: dispatch 2021-10-08T19:31:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2423580106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:31:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]': finished 2021-10-08T19:31:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:00.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[40655]: osdmap e201: 8 total, 8 up, 8 in 2021-10-08T19:31:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2071719939' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:31:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]: dispatch 2021-10-08T19:31:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]: dispatch 2021-10-08T19:31:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]: dispatch 2021-10-08T19:31:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2423580106' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:00.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:00.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-32"}]': finished 2021-10-08T19:31:00.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-23", "mode": "writeback"}]': finished 2021-10-08T19:31:00.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:00.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:00 smithi112 ceph-mon[31694]: osdmap e201: 8 total, 8 up, 8 in 2021-10-08T19:31:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: pgmap v276: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:31:01.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:01.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:31:01.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1763331252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:01.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: pgmap v276: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:31:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:31:01.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1763331252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:01.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: pgmap v276: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2021-10-08T19:31:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: osdmap e202: 8 total, 8 up, 8 in 2021-10-08T19:31:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1763331252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:02.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1763331252' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:02.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:02.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:02.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:02.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1763331252' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:02.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1763331252' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:03.470 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:31:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:03.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:03.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:31:03.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:31:03.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:31:03.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: pgmap v279: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:03.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:03.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:03.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]': finished 2021-10-08T19:31:03.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:31:03.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2042402176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:03.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:03.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:03.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:03.508Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:31:03.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:03.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:31:03.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:31:03.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:31:03.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: pgmap v279: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:03.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:03.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]': finished 2021-10-08T19:31:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:31:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2042402176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:03.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:03.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: osdmap e203: 8 total, 8 up, 8 in 2021-10-08T19:31:03.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:31:03.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]: dispatch 2021-10-08T19:31:03.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: pgmap v279: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 315 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:03.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:03.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:03.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-23"}]': finished 2021-10-08T19:31:03.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: osdmap e204: 8 total, 8 up, 8 in 2021-10-08T19:31:03.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2042402176' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:03.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:05.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:05 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:31:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:05.372 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:05] "GET /metrics HTTP/1.1" 200 159812 "" "Prometheus/2.18.1" 2021-10-08T19:31:05.373 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:05.373 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[40655]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:31:05.373 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[40655]: pgmap v282: 364 pgs: 40 creating+peering, 324 active+clean; 583 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:31:05.374 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:05.374 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:31:05.374 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:31:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:05.374 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:05.375 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[31694]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:31:05.375 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[31694]: pgmap v282: 364 pgs: 40 creating+peering, 324 active+clean; 583 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:31:05.375 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:05.375 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:31:05.376 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:05 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:31:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:05 smithi142 ceph-mon[33432]: osdmap e205: 8 total, 8 up, 8 in 2021-10-08T19:31:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:05 smithi142 ceph-mon[33432]: pgmap v282: 364 pgs: 40 creating+peering, 324 active+clean; 583 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:31:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:05 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:05 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:31:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:05 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:31:05] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:06.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:31:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:31:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:06 smithi142 ceph-mon[33432]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:31:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:06.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[40655]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:31:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[31694]: osdmap e206: 8 total, 8 up, 8 in 2021-10-08T19:31:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:07 smithi142 ceph-mon[33432]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:31:07.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:07.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:07.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:07.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:07 smithi142 ceph-mon[33432]: pgmap v285: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:31:07.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:07.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:07.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[40655]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:31:07.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:07.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:07.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:07.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[40655]: pgmap v285: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:31:07.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:07.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:07.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[31694]: osdmap e207: 8 total, 8 up, 8 in 2021-10-08T19:31:07.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3661894710' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:07.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]: dispatch 2021-10-08T19:31:07.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:07.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:07 smithi112 ceph-mon[31694]: pgmap v285: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:31:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:08 smithi142 ceph-mon[33432]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:31:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[40655]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:31:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-33"}]': finished 2021-10-08T19:31:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[31694]: osdmap e208: 8 total, 8 up, 8 in 2021-10-08T19:31:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:09 smithi142 ceph-mon[33432]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:31:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:09.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:09 smithi142 ceph-mon[33432]: pgmap v288: 260 pgs: 260 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:31:09.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:09.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[31694]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:31:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:09.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[31694]: pgmap v288: 260 pgs: 260 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:31:09.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:09.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:09.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[40655]: osdmap e209: 8 total, 8 up, 8 in 2021-10-08T19:31:09.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:09.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:09.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:09.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:09 smithi112 ceph-mon[40655]: pgmap v288: 260 pgs: 260 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:31:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]': finished 2021-10-08T19:31:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]: dispatch 2021-10-08T19:31:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:31:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]: dispatch 2021-10-08T19:31:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:10.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]': finished 2021-10-08T19:31:10.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:31:10.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2475686501' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:10.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:10.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:10.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:10.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]': finished 2021-10-08T19:31:10.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]: dispatch 2021-10-08T19:31:10.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:31:10.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]: dispatch 2021-10-08T19:31:10.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:10.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:10.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]': finished 2021-10-08T19:31:10.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:31:10.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2475686501' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:10.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:10.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:10.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:10.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-25"}]': finished 2021-10-08T19:31:10.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]: dispatch 2021-10-08T19:31:10.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: osdmap e210: 8 total, 8 up, 8 in 2021-10-08T19:31:10.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]: dispatch 2021-10-08T19:31:10.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:10.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:10.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-25", "mode": "writeback"}]': finished 2021-10-08T19:31:10.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: osdmap e211: 8 total, 8 up, 8 in 2021-10-08T19:31:10.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2475686501' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:10.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:10.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:10.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:12.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[31694]: pgmap v291: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:12.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[31694]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:31:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:12.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:12.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[40655]: pgmap v291: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:12.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:12.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[40655]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:31:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:12.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:12 smithi142 ceph-mon[33432]: pgmap v291: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:12 smithi142 ceph-mon[33432]: osdmap e212: 8 total, 8 up, 8 in 2021-10-08T19:31:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]: dispatch 2021-10-08T19:31:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:31:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:13 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]': finished 2021-10-08T19:31:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:13 smithi142 ceph-mon[33432]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:31:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:13 smithi142 ceph-mon[33432]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:31:13.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:13.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]': finished 2021-10-08T19:31:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[31694]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:31:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[31694]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:31:13.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:13.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-25"}]': finished 2021-10-08T19:31:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[40655]: osdmap e213: 8 total, 8 up, 8 in 2021-10-08T19:31:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:13 smithi112 ceph-mon[40655]: osdmap e214: 8 total, 8 up, 8 in 2021-10-08T19:31:13.575 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:13.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:13.575 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:13.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:13.575 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:13.508Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:31:14.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: pgmap v294: 228 pgs: 228 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:14.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/911560982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:31:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:14.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:14.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: pgmap v294: 228 pgs: 228 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:14.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/911560982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:14.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:14.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:31:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:14.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: pgmap v294: 228 pgs: 228 active+clean; 583 KiB data, 309 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/911560982' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]: dispatch 2021-10-08T19:31:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1382785059' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-34"}]': finished 2021-10-08T19:31:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-42","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: osdmap e215: 8 total, 8 up, 8 in 2021-10-08T19:31:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:14.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:14.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:15.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:15] "GET /metrics HTTP/1.1" 200 159793 "" "Prometheus/2.18.1" 2021-10-08T19:31:16.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: pgmap v297: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:31:16.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:16.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:16.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:31:16.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:16.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:16.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:16.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:16.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: pgmap v297: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:31:16.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:16.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:16.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:31:16.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:16.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:16.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:16.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:16.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: pgmap v297: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 583 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:31:16.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:16.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:16.451 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: osdmap e216: 8 total, 8 up, 8 in 2021-10-08T19:31:16.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:16.452 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:16.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.453 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:16.454 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:16.454 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:16.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:31:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:31:17.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:17.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[40655]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:31:17.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:17.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:17.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:17.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[31694]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:31:17.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:17.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:17.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:17 smithi142 ceph-mon[33432]: osdmap e217: 8 total, 8 up, 8 in 2021-10-08T19:31:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:18.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: pgmap v300: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:31:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:31:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:18.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:18.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: pgmap v300: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:31:18.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:31:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:18.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:18.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:18.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: pgmap v300: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:31:18.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:18.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:18.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: osdmap e218: 8 total, 8 up, 8 in 2021-10-08T19:31:18.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:18.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:18.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:31:18.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:31:18.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:31:18.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:19.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:19.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]': finished 2021-10-08T19:31:19.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[40655]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:31:19.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:19.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]': finished 2021-10-08T19:31:19.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[31694]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:31:19.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-27"}]': finished 2021-10-08T19:31:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:19 smithi142 ceph-mon[33432]: osdmap e219: 8 total, 8 up, 8 in 2021-10-08T19:31:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]: dispatch 2021-10-08T19:31:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]: dispatch 2021-10-08T19:31:20.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[40655]: pgmap v303: 244 pgs: 8 creating+peering, 236 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:31:20.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:20.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:20.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]': finished 2021-10-08T19:31:20.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[40655]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:31:20.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:20.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:20.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[31694]: pgmap v303: 244 pgs: 8 creating+peering, 236 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:31:20.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:20.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:20.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]': finished 2021-10-08T19:31:20.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[31694]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:31:20.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:20.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:20.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:20 smithi142 ceph-mon[33432]: pgmap v303: 244 pgs: 8 creating+peering, 236 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2021-10-08T19:31:20.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:20 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:20.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:20 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-27", "mode": "writeback"}]': finished 2021-10-08T19:31:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:20 smithi142 ceph-mon[33432]: osdmap e220: 8 total, 8 up, 8 in 2021-10-08T19:31:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:21.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:21.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[31694]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:31:21.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:21.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:21.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:21.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:21.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:21.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:21.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:21.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[40655]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:31:21.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:21.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:21.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:21.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:21.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:21.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:21 smithi142 ceph-mon[33432]: osdmap e221: 8 total, 8 up, 8 in 2021-10-08T19:31:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/216665242' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]: dispatch 2021-10-08T19:31:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:22.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:21 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:31:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:22.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: pgmap v306: 228 pgs: 228 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:31:22.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:22.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:22.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:31:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:22.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:22.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:22.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: pgmap v306: 228 pgs: 228 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:31:22.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:22.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:22.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:22.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:31:22.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:22.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:22.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:22.327 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:22.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.328 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.329 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: pgmap v306: 228 pgs: 228 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:31:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-35"}]': finished 2021-10-08T19:31:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:22.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: osdmap e222: 8 total, 8 up, 8 in 2021-10-08T19:31:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2737552187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]: dispatch 2021-10-08T19:31:22.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]: dispatch 2021-10-08T19:31:22.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:22.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:22.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:23.509 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:31:23.510 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:31:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:23.510 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:23.510 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:23.510 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]': finished 2021-10-08T19:31:23.511 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:23.511 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:31:23.511 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:23.511 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:23.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:23.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:23.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:23.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:23.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:23.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:23.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:23.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:31:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:31:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]': finished 2021-10-08T19:31:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:31:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:23.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:23.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:23.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:23.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:23.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:23.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:23.525 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:31:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:31:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:31:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-43"}]': finished 2021-10-08T19:31:23.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-27"}]': finished 2021-10-08T19:31:23.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:23.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: osdmap e223: 8 total, 8 up, 8 in 2021-10-08T19:31:23.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:23.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:23.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:23.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:23.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:23.531 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:23.531 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:31:23.532 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:23.532 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:31:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:23.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:23.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:23.508Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:31:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:24 smithi142 ceph-mon[33432]: pgmap v309: 228 pgs: 228 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:24.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:24 smithi142 ceph-mon[33432]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:31:24.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:24 smithi112 ceph-mon[31694]: pgmap v309: 228 pgs: 228 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:24.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:24 smithi112 ceph-mon[31694]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:31:24.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:24 smithi112 ceph-mon[40655]: pgmap v309: 228 pgs: 228 active+clean; 583 KiB data, 326 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:24 smithi112 ceph-mon[40655]: osdmap e224: 8 total, 8 up, 8 in 2021-10-08T19:31:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:25.413 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:25.414 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:25 smithi142 ceph-mon[33432]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:31:25.414 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.414 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.415 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:25 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:25] "GET /metrics HTTP/1.1" 200 157569 "" "Prometheus/2.18.1" 2021-10-08T19:31:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[40655]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:31:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:25.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:25.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[31694]: osdmap e225: 8 total, 8 up, 8 in 2021-10-08T19:31:25.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:25.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:25 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:31:26.458 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:26 smithi142 ceph-mon[33432]: pgmap v312: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 328 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:26.459 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:26.459 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:26.459 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:26 smithi142 ceph-mon[33432]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:31:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:26 smithi112 ceph-mon[40655]: pgmap v312: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 328 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:26.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:26.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:26 smithi112 ceph-mon[40655]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:31:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:26 smithi112 ceph-mon[31694]: pgmap v312: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 328 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:26 smithi112 ceph-mon[31694]: osdmap e226: 8 total, 8 up, 8 in 2021-10-08T19:31:26.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:31:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:31:27.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:27 smithi142 ceph-mon[33432]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:31:27.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:27.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:27.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:27 smithi112 ceph-mon[40655]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:31:27.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:27.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:27 smithi112 ceph-mon[31694]: osdmap e227: 8 total, 8 up, 8 in 2021-10-08T19:31:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:27.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: pgmap v315: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 328 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: osdmap e228: 8 total, 8 up, 8 in 2021-10-08T19:31:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:28.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: pgmap v315: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 328 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: osdmap e228: 8 total, 8 up, 8 in 2021-10-08T19:31:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:28.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:28.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: pgmap v315: 236 pgs: 40 unknown, 196 active+clean; 583 KiB data, 328 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:28.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:28.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: osdmap e228: 8 total, 8 up, 8 in 2021-10-08T19:31:28.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:28.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4089467980' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:28.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]: dispatch 2021-10-08T19:31:28.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:28.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:29.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:29.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:29.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: osdmap e229: 8 total, 8 up, 8 in 2021-10-08T19:31:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:29.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:29.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:29.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: osdmap e229: 8 total, 8 up, 8 in 2021-10-08T19:31:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:29.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:29.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:29.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-36"}]': finished 2021-10-08T19:31:29.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:29.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: osdmap e229: 8 total, 8 up, 8 in 2021-10-08T19:31:29.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:29.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]: dispatch 2021-10-08T19:31:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:29.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:29.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: pgmap v318: 228 pgs: 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2021-10-08T19:31:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]': finished 2021-10-08T19:31:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:30.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: osdmap e230: 8 total, 8 up, 8 in 2021-10-08T19:31:30.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]: dispatch 2021-10-08T19:31:30.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:30.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]: dispatch 2021-10-08T19:31:30.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:30.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:30.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]': finished 2021-10-08T19:31:30.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: pgmap v318: 228 pgs: 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2021-10-08T19:31:30.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:30.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]': finished 2021-10-08T19:31:30.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:30.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: osdmap e230: 8 total, 8 up, 8 in 2021-10-08T19:31:30.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]: dispatch 2021-10-08T19:31:30.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:30.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]: dispatch 2021-10-08T19:31:30.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:30.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:30.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]': finished 2021-10-08T19:31:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: pgmap v318: 228 pgs: 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.0 MiB/s wr, 1 op/s 2021-10-08T19:31:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4268452718' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-44"}]': finished 2021-10-08T19:31:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-29"}]': finished 2021-10-08T19:31:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: osdmap e230: 8 total, 8 up, 8 in 2021-10-08T19:31:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]: dispatch 2021-10-08T19:31:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:30.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]: dispatch 2021-10-08T19:31:30.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:30.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:30.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:30.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:30.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-29", "mode": "writeback"}]': finished 2021-10-08T19:31:31.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:31.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[40655]: osdmap e231: 8 total, 8 up, 8 in 2021-10-08T19:31:31.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:31.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:31.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[40655]: pgmap v321: 228 pgs: 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:31:31.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:31.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[40655]: osdmap e232: 8 total, 8 up, 8 in 2021-10-08T19:31:31.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:31.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[31694]: osdmap e231: 8 total, 8 up, 8 in 2021-10-08T19:31:31.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:31.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:31.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[31694]: pgmap v321: 228 pgs: 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:31:31.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:31.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:31 smithi112 ceph-mon[31694]: osdmap e232: 8 total, 8 up, 8 in 2021-10-08T19:31:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:31 smithi142 ceph-mon[33432]: osdmap e231: 8 total, 8 up, 8 in 2021-10-08T19:31:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:31 smithi142 ceph-mon[33432]: pgmap v321: 228 pgs: 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:31:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:31.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:31 smithi142 ceph-mon[33432]: osdmap e232: 8 total, 8 up, 8 in 2021-10-08T19:31:33.032 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:32 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:31:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:33.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:33.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:33 smithi112 ceph-mon[40655]: osdmap e233: 8 total, 8 up, 8 in 2021-10-08T19:31:33.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:33 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:33.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:33.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:33 smithi112 ceph-mon[31694]: osdmap e233: 8 total, 8 up, 8 in 2021-10-08T19:31:33.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:33 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:31:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:33 smithi142 ceph-mon[33432]: osdmap e233: 8 total, 8 up, 8 in 2021-10-08T19:31:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:33 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:33.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:33.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:33.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:31:34.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[31694]: pgmap v324: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:34.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:31:34.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:31:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:34.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[31694]: osdmap e234: 8 total, 8 up, 8 in 2021-10-08T19:31:34.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:34.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:34.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[40655]: pgmap v324: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:34.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:31:34.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:31:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:34.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[40655]: osdmap e234: 8 total, 8 up, 8 in 2021-10-08T19:31:34.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:34.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:34.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:34.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:34 smithi142 ceph-mon[33432]: pgmap v324: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 342 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:34 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:31:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:34 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:31:32] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:34.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:34 smithi142 ceph-mon[33432]: osdmap e234: 8 total, 8 up, 8 in 2021-10-08T19:31:34.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:34.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:34.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:34.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:35.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:35] "GET /metrics HTTP/1.1" 200 157569 "" "Prometheus/2.18.1" 2021-10-08T19:31:35.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:35.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:35.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: osdmap e235: 8 total, 8 up, 8 in 2021-10-08T19:31:35.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:35.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:35.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:35.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:35.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:35.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:35.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:35.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:35.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: osdmap e235: 8 total, 8 up, 8 in 2021-10-08T19:31:35.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:35.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:35.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:35.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:35.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:35.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: osdmap e235: 8 total, 8 up, 8 in 2021-10-08T19:31:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1629299499' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]: dispatch 2021-10-08T19:31:35.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:35.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]: dispatch 2021-10-08T19:31:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: pgmap v327: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2021-10-08T19:31:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]': finished 2021-10-08T19:31:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:31:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:36.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:36.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: pgmap v327: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2021-10-08T19:31:36.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:36.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]': finished 2021-10-08T19:31:36.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:36.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:36.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:31:36.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:36.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:36.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:36.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:36.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:31:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:31:36.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: pgmap v327: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 1024 KiB/s wr, 27 op/s 2021-10-08T19:31:36.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:36.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-29"}]': finished 2021-10-08T19:31:36.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:36.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-37"}]': finished 2021-10-08T19:31:36.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: osdmap e236: 8 total, 8 up, 8 in 2021-10-08T19:31:36.781 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3445969601' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:36.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]: dispatch 2021-10-08T19:31:36.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:36.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:36.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:37.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:37.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:31:37.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:37.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:37.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:37.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:37.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:37.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:37.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[40655]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:31:37.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:37.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:37.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:31:37.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:37.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:37.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:37.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:37.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:37.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:37.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:37 smithi112 ceph-mon[31694]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:31:37.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-45"}]': finished 2021-10-08T19:31:37.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:37.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: osdmap e237: 8 total, 8 up, 8 in 2021-10-08T19:31:37.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:37.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:37.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:37.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:37.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:37.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:37.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:37.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:37 smithi142 ceph-mon[33432]: osdmap e238: 8 total, 8 up, 8 in 2021-10-08T19:31:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: pgmap v330: 196 pgs: 196 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:31:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:38.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:38.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:38.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:38.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:31:38.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: pgmap v330: 196 pgs: 196 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:31:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:38.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:38.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:38.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:38.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:38.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:38.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:31:38.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:38.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:38.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: pgmap v330: 196 pgs: 196 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2021-10-08T19:31:38.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:38.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:38.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:38.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:38.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:38.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:38.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: osdmap e239: 8 total, 8 up, 8 in 2021-10-08T19:31:38.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:40.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: pgmap v333: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:40.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:40.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:40.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:31:40.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:40.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:40.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]': finished 2021-10-08T19:31:40.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:31:40.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]: dispatch 2021-10-08T19:31:40.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:40.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]: dispatch 2021-10-08T19:31:40.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:40.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: pgmap v333: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:40.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:40.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:40.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:31:40.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:40.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:40.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]': finished 2021-10-08T19:31:40.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:31:40.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]: dispatch 2021-10-08T19:31:40.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:40.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]: dispatch 2021-10-08T19:31:40.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: pgmap v333: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:40.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:40.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: osdmap e240: 8 total, 8 up, 8 in 2021-10-08T19:31:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:40.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-31"}]': finished 2021-10-08T19:31:40.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: osdmap e241: 8 total, 8 up, 8 in 2021-10-08T19:31:40.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]: dispatch 2021-10-08T19:31:40.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:40.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]: dispatch 2021-10-08T19:31:40.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:41.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:41.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]': finished 2021-10-08T19:31:41.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:41.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[40655]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:31:41.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:41.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:41.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:41.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:41.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:41.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]': finished 2021-10-08T19:31:41.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:41.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[31694]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:31:41.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:41.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:41.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:41.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:41 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-31", "mode": "writeback"}]': finished 2021-10-08T19:31:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:41 smithi142 ceph-mon[33432]: osdmap e242: 8 total, 8 up, 8 in 2021-10-08T19:31:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2794772726' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]: dispatch 2021-10-08T19:31:41.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:41.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:42.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: pgmap v336: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:42.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:42.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:42.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:42.332 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:42.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:42.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:31:42.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:42.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:42.333 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:42.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:42.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.334 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.335 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.335 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:42.335 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:42.335 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: pgmap v336: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:42.337 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:42.338 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:42.338 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:42.338 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:42.338 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:42.339 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:31:42.339 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:42.339 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:42.339 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:42.339 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:42.340 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.340 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.340 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.340 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.341 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:42.341 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: pgmap v336: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-38"}]': finished 2021-10-08T19:31:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:42.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:42.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: osdmap e243: 8 total, 8 up, 8 in 2021-10-08T19:31:42.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3035639623' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:42.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]: dispatch 2021-10-08T19:31:42.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:42.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]: dispatch 2021-10-08T19:31:42.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:42.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:42.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.511 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:43.512 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:43.512 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]': finished 2021-10-08T19:31:43.512 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:43.513 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:31:43.513 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:43.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:43.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.517 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:43.517 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:43.517 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]': finished 2021-10-08T19:31:43.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:43.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:31:43.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:43.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:43.519 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.519 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.519 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.519 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.519 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:31:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-46"}]': finished 2021-10-08T19:31:43.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-31"}]': finished 2021-10-08T19:31:43.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:43.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: osdmap e244: 8 total, 8 up, 8 in 2021-10-08T19:31:43.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:43.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:43.787 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:43.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:43.787 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:43.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:43.787 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:43.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:31:44.294 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:44 smithi112 ceph-mon[31694]: pgmap v339: 228 pgs: 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:44 smithi112 ceph-mon[40655]: pgmap v339: 228 pgs: 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:44.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:44 smithi142 ceph-mon[33432]: pgmap v339: 228 pgs: 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:45] "GET /metrics HTTP/1.1" 200 157567 "" "Prometheus/2.18.1" 2021-10-08T19:31:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:31:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: pgmap v342: 196 pgs: 196 active+clean; 4.6 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:31:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:45.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:45.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:31:45.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: pgmap v342: 196 pgs: 196 active+clean; 4.6 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:31:45.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:45.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: osdmap e245: 8 total, 8 up, 8 in 2021-10-08T19:31:45.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:45.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:45.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: pgmap v342: 196 pgs: 196 active+clean; 4.6 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:45.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:45.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: osdmap e246: 8 total, 8 up, 8 in 2021-10-08T19:31:45.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:45.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:46.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:31:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:31:47.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:47.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:47.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[40655]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:31:47.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:47.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:47.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:47.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:47.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[31694]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:31:47.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:47.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:47 smithi142 ceph-mon[33432]: osdmap e247: 8 total, 8 up, 8 in 2021-10-08T19:31:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:48.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:48.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[40655]: pgmap v345: 244 pgs: 48 unknown, 196 active+clean; 4.6 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:48.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:48.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[40655]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:31:48.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:48.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:48.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:48.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:48.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:48.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[31694]: pgmap v345: 244 pgs: 48 unknown, 196 active+clean; 4.6 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:48.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:48.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[31694]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:31:48.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:48.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:48.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:48.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:48 smithi142 ceph-mon[33432]: pgmap v345: 244 pgs: 48 unknown, 196 active+clean; 4.6 MiB data, 363 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:48 smithi142 ceph-mon[33432]: osdmap e248: 8 total, 8 up, 8 in 2021-10-08T19:31:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:48.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:49.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:48 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:31:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:49.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:49.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]': finished 2021-10-08T19:31:49.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:31:49.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:49.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]: dispatch 2021-10-08T19:31:49.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:49.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:49.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]: dispatch 2021-10-08T19:31:49.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:49.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:49.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:49.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]': finished 2021-10-08T19:31:49.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:31:49.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:49.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]: dispatch 2021-10-08T19:31:49.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:49.329 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:49.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]: dispatch 2021-10-08T19:31:49.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:49.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:49 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-33"}]': finished 2021-10-08T19:31:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: osdmap e249: 8 total, 8 up, 8 in 2021-10-08T19:31:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4276650088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]: dispatch 2021-10-08T19:31:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]: dispatch 2021-10-08T19:31:49.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]: dispatch 2021-10-08T19:31:49.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:49.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:49 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:31:50.082 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: pgmap v348: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:50.082 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:31:50.082 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:31:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:50.083 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:50.083 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:50.083 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]': finished 2021-10-08T19:31:50.084 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:31:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:50.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:50.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:50.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: pgmap v348: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:31:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:31:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]': finished 2021-10-08T19:31:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:31:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:50.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:50.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:50.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:50.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: pgmap v348: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:50.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:31:50.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:31:48] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:31:50.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:50.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-39"}]': finished 2021-10-08T19:31:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-33", "mode": "writeback"}]': finished 2021-10-08T19:31:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: osdmap e250: 8 total, 8 up, 8 in 2021-10-08T19:31:50.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2510175716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]: dispatch 2021-10-08T19:31:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:50.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:50.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:50.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:50.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:31:51.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:31:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:51.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:51.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:51.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:51.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:51.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:31:51.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:51.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:51.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:51.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:51.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:51 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-47"}]': finished 2021-10-08T19:31:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83033-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:31:51.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: osdmap e251: 8 total, 8 up, 8 in 2021-10-08T19:31:51.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:51.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:51.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:51.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]: dispatch 2021-10-08T19:31:51.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:51 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:31:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:52 smithi142 ceph-mon[33432]: pgmap v351: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]': finished 2021-10-08T19:31:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:52 smithi142 ceph-mon[33432]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:31:52.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3829344097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:52.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:52.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:52.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:52.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:52 smithi142 ceph-mon[33432]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:31:52.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[40655]: pgmap v351: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:52.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]': finished 2021-10-08T19:31:52.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[40655]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:31:52.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3829344097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:52.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:52.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:52.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:52.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[40655]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:31:52.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[31694]: pgmap v351: 228 pgs: 228 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:31:52.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-33"}]': finished 2021-10-08T19:31:52.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[31694]: osdmap e252: 8 total, 8 up, 8 in 2021-10-08T19:31:52.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3829344097' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:52.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:52.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83033-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:52.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-48","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:52.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:52 smithi112 ceph-mon[31694]: osdmap e253: 8 total, 8 up, 8 in 2021-10-08T19:31:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:31:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:31:53.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:53.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:53.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:53.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:31:53.827 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:31:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:31:53.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:31:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:54 smithi142 ceph-mon[33432]: pgmap v354: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:54 smithi142 ceph-mon[33432]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:31:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[40655]: pgmap v354: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[40655]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:31:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:54.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:54.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:54.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:54.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:54.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[31694]: pgmap v354: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 369 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:31:54.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[31694]: osdmap e254: 8 total, 8 up, 8 in 2021-10-08T19:31:54.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:54.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:31:54.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:54.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:54.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:31:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:31:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:31:55] "GET /metrics HTTP/1.1" 200 158644 "" "Prometheus/2.18.1" 2021-10-08T19:31:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[40655]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:31:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[31694]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:31:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:55.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:55.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:55.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:55.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:31:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:31:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:55 smithi142 ceph-mon[33432]: osdmap e255: 8 total, 8 up, 8 in 2021-10-08T19:31:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:55.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:55.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:55.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:55.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:31:56.098 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ]ndTrip 2021-10-08T19:31:56.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6954 ms) 2021-10-08T19:31:56.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2021-10-08T19:31:56.099 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7014 ms) 2021-10-08T19:31:56.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2021-10-08T19:31:56.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7042 ms) 2021-10-08T19:31:56.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2021-10-08T19:31:56.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7055 ms) 2021-10-08T19:31:56.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2021-10-08T19:31:56.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7046 ms) 2021-10-08T19:31:56.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2021-10-08T19:31:56.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7045 ms) 2021-10-08T19:31:56.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2021-10-08T19:31:56.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7023 ms) 2021-10-08T19:31:56.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2021-10-08T19:31:56.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6795 ms) 2021-10-08T19:31:56.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2021-10-08T19:31:56.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7014 ms) 2021-10-08T19:31:56.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2021-10-08T19:31:56.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7052 ms) 2021-10-08T19:31:56.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2021-10-08T19:31:56.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6942 ms) 2021-10-08T19:31:56.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2021-10-08T19:31:56.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (6982 ms) 2021-10-08T19:31:56.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2021-10-08T19:31:56.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7035 ms) 2021-10-08T19:31:56.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2021-10-08T19:31:56.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7017 ms) 2021-10-08T19:31:56.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (111844 ms total) 2021-10-08T19:31:56.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: 2021-10-08T19:31:56.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [----------] Global test environment tear-down 2021-10-08T19:31:56.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [==========] 40 tests from 2 test suites ran. (189933 ms total) 2021-10-08T19:31:56.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio: [ PASSED ] 40 tests. 2021-10-08T19:31:56.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:31:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:31:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: pgmap v357: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:31:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:31:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:31:56.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:31:56.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:56.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:31:56.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:31:56.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]: dispatch 2021-10-08T19:31:56.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]: dispatch 2021-10-08T19:31:56.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: pgmap v357: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:56.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:56.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:56.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:31:56.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:56.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:56.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:31:56.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:31:56.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:31:56.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:56.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:31:56.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:31:56.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]: dispatch 2021-10-08T19:31:56.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]: dispatch 2021-10-08T19:31:56.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: pgmap v357: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:56.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:56.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:31:56.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: osdmap e256: 8 total, 8 up, 8 in 2021-10-08T19:31:56.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2358789976' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:56.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]: dispatch 2021-10-08T19:31:56.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:31:56.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:31:56.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:31:56.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83033-40"}]': finished 2021-10-08T19:31:56.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:31:56.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: osdmap e257: 8 total, 8 up, 8 in 2021-10-08T19:31:56.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]: dispatch 2021-10-08T19:31:56.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]: dispatch 2021-10-08T19:31:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:57 smithi142 ceph-mon[33432]: pgmap v360: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:57 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]': finished 2021-10-08T19:31:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:57 smithi142 ceph-mon[33432]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:31:57.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:57.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[40655]: pgmap v360: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:57.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:57.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]': finished 2021-10-08T19:31:57.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[40655]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:31:57.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:31:57.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[31694]: pgmap v360: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:31:57.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:31:57.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-35", "mode": "writeback"}]': finished 2021-10-08T19:31:57.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:57 smithi112 ceph-mon[31694]: osdmap e258: 8 total, 8 up, 8 in 2021-10-08T19:31:59.354 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:59 smithi142 ceph-mon[33432]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:31:59.354 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:31:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:59.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:59 smithi112 ceph-mon[31694]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:31:59.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:31:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:31:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:59 smithi112 ceph-mon[40655]: osdmap e259: 8 total, 8 up, 8 in 2021-10-08T19:31:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:31:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:32:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:00 smithi142 ceph-mon[33432]: pgmap v363: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:32:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:32:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:00 smithi142 ceph-mon[33432]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:32:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:32:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:00.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:00 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:32:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[31694]: pgmap v363: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:32:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:32:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[31694]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:32:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:32:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[40655]: pgmap v363: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:32:00.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:32:00.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[40655]: osdmap e260: 8 total, 8 up, 8 in 2021-10-08T19:32:00.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]: dispatch 2021-10-08T19:32:00.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:00.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:32:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:01.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:32:01.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:01.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:01.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:01.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:01.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:01 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:32:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:32:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:01.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:01.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/46999066' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-49"}]': finished 2021-10-08T19:32:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: osdmap e261: 8 total, 8 up, 8 in 2021-10-08T19:32:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:01.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:01.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:01 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:02.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:02 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:02.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:02 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:32:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:02.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:02 smithi142 ceph-mon[33432]: pgmap v366: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:32:02.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:32:02.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:02.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:02 smithi142 ceph-mon[33432]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:32:02.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:32:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[40655]: pgmap v366: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:32:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:32:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[40655]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:32:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:02.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:02.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:32:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:02.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[31694]: pgmap v366: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:32:02.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:32:02.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:02.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[31694]: osdmap e262: 8 total, 8 up, 8 in 2021-10-08T19:32:02.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:03.511 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:03 smithi112 ceph-mon[40655]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:32:03.512 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:03.512 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:03.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:03 smithi112 ceph-mon[31694]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:32:03.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:03.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:32:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:03 smithi142 ceph-mon[33432]: osdmap e263: 8 total, 8 up, 8 in 2021-10-08T19:32:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:03.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:03.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:03.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:32:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:04 smithi142 ceph-mon[33432]: pgmap v369: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:04 smithi142 ceph-mon[33432]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:32:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[40655]: pgmap v369: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[40655]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:32:04.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:04.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[31694]: pgmap v369: 228 pgs: 228 active+clean; 4.6 MiB data, 373 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[31694]: osdmap e264: 8 total, 8 up, 8 in 2021-10-08T19:32:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]: dispatch 2021-10-08T19:32:05.389 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:05] "GET /metrics HTTP/1.1" 200 158644 "" "Prometheus/2.18.1" 2021-10-08T19:32:05.389 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:05.390 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:32:05.390 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[31694]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:32:05.390 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[31694]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:32:05.390 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:05.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:05 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:32:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:05 smithi142 ceph-mon[33432]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:32:05.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:05 smithi142 ceph-mon[33432]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:32:05.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:05.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:05.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-35"}]': finished 2021-10-08T19:32:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[40655]: osdmap e265: 8 total, 8 up, 8 in 2021-10-08T19:32:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[40655]: osdmap e266: 8 total, 8 up, 8 in 2021-10-08T19:32:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:06.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:32:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:32:06.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:06 smithi142 ceph-mon[33432]: pgmap v372: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2021-10-08T19:32:06.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:06.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:06 smithi142 ceph-mon[33432]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:32:06.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:06.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:06.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:06.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[40655]: pgmap v372: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2021-10-08T19:32:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[40655]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:32:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:06.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:06.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[31694]: pgmap v372: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2021-10-08T19:32:06.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[31694]: osdmap e267: 8 total, 8 up, 8 in 2021-10-08T19:32:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]: dispatch 2021-10-08T19:32:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: pgmap v375: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:32:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:32:08.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:08.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:08.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:08.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:08.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: pgmap v375: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:32:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:32:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:08.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:08.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:08.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: pgmap v375: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 358 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:32:08.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2213155910' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-50"}]': finished 2021-10-08T19:32:08.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:08.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: osdmap e268: 8 total, 8 up, 8 in 2021-10-08T19:32:08.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:08.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:08.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:08.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:08.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:09.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:09.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:09.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[31694]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:32:09.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:09.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:09.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:09.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:09.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:09.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:09.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[40655]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:32:09.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:09.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:09.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:09.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:09.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:09.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:09 smithi142 ceph-mon[33432]: osdmap e269: 8 total, 8 up, 8 in 2021-10-08T19:32:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:09.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:10.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: pgmap v378: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:32:10.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]': finished 2021-10-08T19:32:10.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]: dispatch 2021-10-08T19:32:10.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:32:10.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]: dispatch 2021-10-08T19:32:10.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:10.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:10.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]': finished 2021-10-08T19:32:10.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:32:10.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:10.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: pgmap v378: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:32:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]': finished 2021-10-08T19:32:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]: dispatch 2021-10-08T19:32:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:32:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]: dispatch 2021-10-08T19:32:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]': finished 2021-10-08T19:32:10.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:32:10.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:10.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:10.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: pgmap v378: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:32:10.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-37"}]': finished 2021-10-08T19:32:10.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]: dispatch 2021-10-08T19:32:10.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: osdmap e270: 8 total, 8 up, 8 in 2021-10-08T19:32:10.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]: dispatch 2021-10-08T19:32:10.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:10.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:10.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-37", "mode": "writeback"}]': finished 2021-10-08T19:32:10.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: osdmap e271: 8 total, 8 up, 8 in 2021-10-08T19:32:10.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:10.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:12.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[40655]: pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:12.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:12.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[40655]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:32:12.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:12.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:12.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[31694]: pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:12.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:12.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[31694]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:32:12.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:12.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:12 smithi142 ceph-mon[33432]: pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:12 smithi142 ceph-mon[33432]: osdmap e272: 8 total, 8 up, 8 in 2021-10-08T19:32:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]: dispatch 2021-10-08T19:32:13.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:13.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]': finished 2021-10-08T19:32:13.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[31694]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:32:13.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:13.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:13.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:13.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]': finished 2021-10-08T19:32:13.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[40655]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:32:13.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:13.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:32:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:13 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-37"}]': finished 2021-10-08T19:32:13.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:13 smithi142 ceph-mon[33432]: osdmap e273: 8 total, 8 up, 8 in 2021-10-08T19:32:13.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:13.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:13.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:13.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:13.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:13.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:13.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:13.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:32:14.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[40655]: pgmap v384: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:14.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:14.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[40655]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:32:14.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:14.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:14.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[31694]: pgmap v384: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:14.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:14.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[31694]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:32:14.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:14.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:14 smithi142 ceph-mon[33432]: pgmap v384: 228 pgs: 228 active+clean; 4.6 MiB data, 360 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:14 smithi142 ceph-mon[33432]: osdmap e274: 8 total, 8 up, 8 in 2021-10-08T19:32:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1788609038' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]: dispatch 2021-10-08T19:32:15.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:15] "GET /metrics HTTP/1.1" 200 157566 "" "Prometheus/2.18.1" 2021-10-08T19:32:15.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:15.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:32:15.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:15.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:15.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:15.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:15.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:15.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:32:15.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:15.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:15.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:15.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-51"}]': finished 2021-10-08T19:32:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: osdmap e275: 8 total, 8 up, 8 in 2021-10-08T19:32:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:15.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:15.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:15.821 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:15 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:32:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:16.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: pgmap v387: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 366 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:16.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:16.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:16.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:32:16.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:16.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:16.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:16.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:16.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:16.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: pgmap v387: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 366 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:16.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:16.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:16.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:32:16.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:16.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:16.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:16.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:16.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:16 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:16.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:32:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:32:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: pgmap v387: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 366 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: osdmap e276: 8 total, 8 up, 8 in 2021-10-08T19:32:16.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:16.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:16.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:16.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:16.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:16 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:17.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:32:17.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:32:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:17.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:17.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:32:17.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: pgmap v390: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 366 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]': finished 2021-10-08T19:32:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:32:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]: dispatch 2021-10-08T19:32:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]: dispatch 2021-10-08T19:32:17.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:32:17.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:32:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:17.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:17.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:32:17.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:17.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:17.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:17.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: pgmap v390: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 366 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:17.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:17.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]': finished 2021-10-08T19:32:17.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:32:17.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]: dispatch 2021-10-08T19:32:17.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]: dispatch 2021-10-08T19:32:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:32:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:32:15] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: osdmap e277: 8 total, 8 up, 8 in 2021-10-08T19:32:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:17.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:17.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: pgmap v390: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 366 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:17.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:17.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-39"}]': finished 2021-10-08T19:32:17.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: osdmap e278: 8 total, 8 up, 8 in 2021-10-08T19:32:17.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]: dispatch 2021-10-08T19:32:17.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]: dispatch 2021-10-08T19:32:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: poll took 247007.692 ms: 1 events 2021-10-08T19:32:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]': finished 2021-10-08T19:32:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:32:18.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:18.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: poll took 247007.692 ms: 1 events 2021-10-08T19:32:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:18.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:18.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]': finished 2021-10-08T19:32:18.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:32:18.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:18.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:32:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:32:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:32:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: poll took 247007.692 ms: 1 events 2021-10-08T19:32:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:32:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-39", "mode": "writeback"}]': finished 2021-10-08T19:32:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: osdmap e279: 8 total, 8 up, 8 in 2021-10-08T19:32:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:20.440 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:20 smithi142 ceph-mon[33432]: pgmap v393: 236 pgs: 236 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.9 MiB/s wr, 100 op/s 2021-10-08T19:32:20.441 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:20.441 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:20 smithi142 ceph-mon[33432]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:32:20.441 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:20.442 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:20.442 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:20.442 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:20.442 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:20 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:32:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[40655]: pgmap v393: 236 pgs: 236 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.9 MiB/s wr, 100 op/s 2021-10-08T19:32:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[40655]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:32:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:20.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:20.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:32:20.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[31694]: pgmap v393: 236 pgs: 236 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.9 MiB/s wr, 100 op/s 2021-10-08T19:32:20.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:32:20.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[31694]: osdmap e280: 8 total, 8 up, 8 in 2021-10-08T19:32:20.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:20.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:20.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:20.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]: dispatch 2021-10-08T19:32:20.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:20 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:32:21.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [==========] Running 76 tests from 4 test suites. 2021-10-08T19:32:21.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] Global test environment set-up. 2021-10-08T19:32:21.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2021-10-08T19:32:21.100 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: seed 83223 2021-10-08T19:32:21.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2021-10-08T19:32:21.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (22 ms) 2021-10-08T19:32:21.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2021-10-08T19:32:21.101 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (12938 ms) 2021-10-08T19:32:21.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2021-10-08T19:32:21.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (10 ms) 2021-10-08T19:32:21.102 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (12970 ms total) 2021-10-08T19:32:21.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: 2021-10-08T19:32:21.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] 47 tests from LibRadosTwoPoolsPP 2021-10-08T19:32:21.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2021-10-08T19:32:21.103 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7125 ms) 2021-10-08T19:32:21.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2021-10-08T19:32:21.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (7671 ms) 2021-10-08T19:32:21.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2021-10-08T19:32:21.104 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (10196 ms) 2021-10-08T19:32:21.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2021-10-08T19:32:21.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: my_snaps [4] 2021-10-08T19:32:21.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: my_snaps [5,4] 2021-10-08T19:32:21.105 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: my_snaps [6,5,4] 2021-10-08T19:32:21.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: my_snaps [7,6,5,4] 2021-10-08T19:32:21.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: promoting some heads 2021-10-08T19:32:21.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: promoting from clones for snap 7 2021-10-08T19:32:21.106 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: promoting from clones for snap 6 2021-10-08T19:32:21.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: promoting from clones for snap 5 2021-10-08T19:32:21.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: promoting from clones for snap 4 2021-10-08T19:32:21.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: waiting for scrubs... 2021-10-08T19:32:21.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: done waiting 2021-10-08T19:32:21.107 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46000 ms) 2021-10-08T19:32:21.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2021-10-08T19:32:21.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9764 ms) 2021-10-08T19:32:21.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2021-10-08T19:32:21.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8054 ms) 2021-10-08T19:32:21.108 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2021-10-08T19:32:21.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8066 ms) 2021-10-08T19:32:21.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2021-10-08T19:32:21.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8052 ms) 2021-10-08T19:32:21.109 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2021-10-08T19:32:21.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10034 ms) 2021-10-08T19:32:21.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2021-10-08T19:32:21.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8804 ms) 2021-10-08T19:32:21.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2021-10-08T19:32:21.110 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10286 ms) 2021-10-08T19:32:21.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2021-10-08T19:32:21.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12742 ms) 2021-10-08T19:32:21.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2021-10-08T19:32:21.111 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8233 ms) 2021-10-08T19:32:21.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2021-10-08T19:32:21.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7790 ms) 2021-10-08T19:32:21.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2021-10-08T19:32:21.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13056 ms) 2021-10-08T19:32:21.112 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2021-10-08T19:32:21.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7913 ms) 2021-10-08T19:32:21.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2021-10-08T19:32:21.113 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8047 ms) 2021-10-08T19:32:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:21 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:21.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]': finished 2021-10-08T19:32:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:21 smithi142 ceph-mon[33432]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:32:21.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:21.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:21.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:21.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:21.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]': finished 2021-10-08T19:32:21.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[40655]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:32:21.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:21.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:21.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:32:21.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:21.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-39"}]': finished 2021-10-08T19:32:21.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[31694]: osdmap e281: 8 total, 8 up, 8 in 2021-10-08T19:32:21.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1429967056' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:21.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]: dispatch 2021-10-08T19:32:22.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: pgmap v396: 228 pgs: 228 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 99 op/s 2021-10-08T19:32:22.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:22.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:32:22.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:22.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:22.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: pgmap v396: 228 pgs: 228 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 99 op/s 2021-10-08T19:32:22.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:22.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:32:22.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:22.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:22.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: pgmap v396: 228 pgs: 228 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 99 op/s 2021-10-08T19:32:22.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-52"}]': finished 2021-10-08T19:32:22.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: osdmap e282: 8 total, 8 up, 8 in 2021-10-08T19:32:22.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:22.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:22.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:23.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:23.512 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:32:23.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:23.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:23.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:23.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:23.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:23.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:23.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:23.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:32:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:23.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:32:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: osdmap e283: 8 total, 8 up, 8 in 2021-10-08T19:32:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:32:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:32:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:23.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:23.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:23.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:32:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:24 smithi142 ceph-mon[33432]: pgmap v399: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:24 smithi142 ceph-mon[33432]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:32:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[40655]: pgmap v399: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[40655]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:32:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[31694]: pgmap v399: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 371 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[31694]: osdmap e284: 8 total, 8 up, 8 in 2021-10-08T19:32:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:25.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:25.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:25.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:25 smithi142 ceph-mon[33432]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:32:25.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:25.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:25.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:25 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:32:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:25] "GET /metrics HTTP/1.1" 200 157584 "" "Prometheus/2.18.1" 2021-10-08T19:32:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[31694]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:32:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:25.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:25.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:32:25.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:25.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:25.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[40655]: osdmap e285: 8 total, 8 up, 8 in 2021-10-08T19:32:25.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:25.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:32:25.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:25 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:32:26.519 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:26 smithi142 ceph-mon[33432]: pgmap v402: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:26.519 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:26.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:26 smithi142 ceph-mon[33432]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:32:26.520 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:26.521 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:26.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[31694]: pgmap v402: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[31694]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:32:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:26.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[40655]: pgmap v402: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:26.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:32:26.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[40655]: osdmap e286: 8 total, 8 up, 8 in 2021-10-08T19:32:26.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:26.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:26.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:32:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:32:27.513 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:27.513 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[40655]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:32:27.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:27.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:32:27.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:27.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:32:27.516 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:27.516 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[31694]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:32:27.517 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:27.517 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:32:27.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:27.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:32:27.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:27.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:27 smithi142 ceph-mon[33432]: osdmap e287: 8 total, 8 up, 8 in 2021-10-08T19:32:27.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:27.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:32:27.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:27.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:32:27.821 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:27 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:32:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:28 smithi142 ceph-mon[33432]: pgmap v405: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:32:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:28 smithi142 ceph-mon[33432]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:32:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:28.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:28.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:28 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[40655]: pgmap v405: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:32:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[40655]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:32:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:28.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[31694]: pgmap v405: 228 pgs: 228 active+clean; 8.4 MiB data, 385 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-41","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:32:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[31694]: osdmap e288: 8 total, 8 up, 8 in 2021-10-08T19:32:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2846899032' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:28.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]: dispatch 2021-10-08T19:32:28.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:28 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:29.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:32:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:32:29.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:29.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:29.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]: dispatch 2021-10-08T19:32:29.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]: dispatch 2021-10-08T19:32:29.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:32:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:32:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:29.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:29.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]: dispatch 2021-10-08T19:32:29.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]: dispatch 2021-10-08T19:32:29.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:29.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:32:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-53"}]': finished 2021-10-08T19:32:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: osdmap e289: 8 total, 8 up, 8 in 2021-10-08T19:32:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:29.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:29.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:29.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:29.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]: dispatch 2021-10-08T19:32:29.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]: dispatch 2021-10-08T19:32:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:30 smithi142 ceph-mon[33432]: pgmap v408: 228 pgs: 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]': finished 2021-10-08T19:32:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:30 smithi142 ceph-mon[33432]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:32:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:30.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[40655]: pgmap v408: 228 pgs: 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:30.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:30.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]': finished 2021-10-08T19:32:30.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[40655]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:32:30.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:30.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:30.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[31694]: pgmap v408: 228 pgs: 228 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:30.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:30.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-41"}]': finished 2021-10-08T19:32:30.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[31694]: osdmap e290: 8 total, 8 up, 8 in 2021-10-08T19:32:30.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:30.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:31 smithi142 ceph-mon[33432]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:32:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:31 smithi142 ceph-mon[33432]: pgmap v411: 196 pgs: 196 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:31 smithi142 ceph-mon[33432]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:32:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:31.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[40655]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:32:31.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[40655]: pgmap v411: 196 pgs: 196 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:31.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:31.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[40655]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:32:31.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:31.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:31.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[31694]: osdmap e291: 8 total, 8 up, 8 in 2021-10-08T19:32:31.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[31694]: pgmap v411: 196 pgs: 196 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:31.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:31.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[31694]: osdmap e292: 8 total, 8 up, 8 in 2021-10-08T19:32:31.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:31.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:33.513 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:33.514 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[40655]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:32:33.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi112-83223-6","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:32:33.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:33.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:33.516 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:33.517 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[31694]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:32:33.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi112-83223-6","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:32:33.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:33.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-43","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:33 smithi142 ceph-mon[33432]: osdmap e293: 8 total, 8 up, 8 in 2021-10-08T19:32:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi112-83223-6","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:32:33.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:33.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:33.525 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:32:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:33.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:33.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:33.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:32:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:34 smithi142 ceph-mon[33432]: pgmap v414: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:34.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:34 smithi142 ceph-mon[33432]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:32:34.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:32:34.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:34.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:32:34.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[40655]: pgmap v414: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[40655]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:32:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:32:34.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:34.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:32:34.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:34.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[31694]: pgmap v414: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 386 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:34.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:34.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[31694]: osdmap e294: 8 total, 8 up, 8 in 2021-10-08T19:32:34.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:32:34.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:34.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]: dispatch 2021-10-08T19:32:34.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]': finished 2021-10-08T19:32:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:35 smithi142 ceph-mon[33432]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:32:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:35.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]': finished 2021-10-08T19:32:35.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:35.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[31694]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:32:35.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:35.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:35.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:35.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:35.575 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:35] "GET /metrics HTTP/1.1" 200 157584 "" "Prometheus/2.18.1" 2021-10-08T19:32:35.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_count","val": "8"}]': finished 2021-10-08T19:32:35.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:35.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[40655]: osdmap e295: 8 total, 8 up, 8 in 2021-10-08T19:32:35.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:35.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1565754600' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:35.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:32:35.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]: dispatch 2021-10-08T19:32:36.420 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2021-10-08T19:32:36.421 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: hmm, no HitSet yet 2021-10-08T19:32:36.421 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: ok, hit_set contains 186:602f83fe:::foo:head 2021-10-08T19:32:36.422 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9299 ms) 2021-10-08T19:32:36.422 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2021-10-08T19:32:36.423 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg_num = 32 2021-10-08T19:32:36.423 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 0 ls 1633721557,0 2021-10-08T19:32:36.424 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 1 ls 1633721557,0 2021-10-08T19:32:36.424 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 2 ls 1633721557,0 2021-10-08T19:32:36.424 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 3 ls 1633721557,0 2021-10-08T19:32:36.425 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 4 ls 1633721557,0 2021-10-08T19:32:36.425 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 5 ls 1633721557,0 2021-10-08T19:32:36.426 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 6 ls 1633721557,0 2021-10-08T19:32:36.426 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 7 ls 1633721557,0 2021-10-08T19:32:36.427 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 8 ls 1633721557,0 2021-10-08T19:32:36.427 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 9 ls 1633721557,0 2021-10-08T19:32:36.428 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 10 ls 1633721557,0 2021-10-08T19:32:36.428 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 11 ls 1633721557,0 2021-10-08T19:32:36.428 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 12 ls 1633721557,0 2021-10-08T19:32:36.429 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 13 ls 1633721557,0 2021-10-08T19:32:36.429 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 14 ls 1633721557,0 2021-10-08T19:32:36.430 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 15 ls 1633721557,0 2021-10-08T19:32:36.430 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 16 ls 1633721557,0 2021-10-08T19:32:36.430 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 17 ls 1633721557,0 2021-10-08T19:32:36.431 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 18 ls 1633721557,0 2021-10-08T19:32:36.431 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 19 ls 1633721557,0 2021-10-08T19:32:36.432 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 20 ls 1633721557,0 2021-10-08T19:32:36.432 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 21 ls 1633721557,0 2021-10-08T19:32:36.433 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 22 ls 1633721557,0 2021-10-08T19:32:36.433 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 23 ls 1633721557,0 2021-10-08T19:32:36.434 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 24 ls 1633721557,0 2021-10-08T19:32:36.434 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 25 ls 1633721557,0 2021-10-08T19:32:36.434 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 26 ls 1633721557,0 2021-10-08T19:32:36.435 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 27 ls 1633721557,0 2021-10-08T19:32:36.435 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 28 ls 1633721557,0 2021-10-08T19:32:36.436 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 29 ls 1633721557,0 2021-10-08T19:32:36.436 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 30 ls 1633721557,0 2021-10-08T19:32:36.437 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg 31 ls 1633721557,0 2021-10-08T19:32:36.437 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: pg_num = 32 2021-10-08T19:32:36.437 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:6cac518f:::0:head 2021-10-08T19:32:36.438 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:02547ec2:::1:head 2021-10-08T19:32:36.438 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f905c69b:::2:head 2021-10-08T19:32:36.438 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:cfc208b3:::3:head 2021-10-08T19:32:36.439 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d83876eb:::4:head 2021-10-08T19:32:36.439 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b29083e3:::5:head 2021-10-08T19:32:36.439 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c4fdafeb:::6:head 2021-10-08T19:32:36.440 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:5c6b0b28:::7:head 2021-10-08T19:32:36.440 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:bd63b0f1:::8:head 2021-10-08T19:32:36.440 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:e960b815:::9:head 2021-10-08T19:32:36.441 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:52ea6a34:::10:head 2021-10-08T19:32:36.441 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:89d3ae78:::11:head 2021-10-08T19:32:36.442 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:de5d7c5f:::12:head 2021-10-08T19:32:36.442 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:566253c9:::13:head 2021-10-08T19:32:36.442 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:62a1935d:::14:head 2021-10-08T19:32:36.442 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:863748b0:::15:head 2021-10-08T19:32:36.443 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:3958e169:::16:head 2021-10-08T19:32:36.443 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:4d4dabf9:::17:head 2021-10-08T19:32:36.443 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:8391935d:::18:head 2021-10-08T19:32:36.443 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:28883081:::19:head 2021-10-08T19:32:36.444 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:69259c59:::20:head 2021-10-08T19:32:36.444 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:4bdb80b7:::21:head 2021-10-08T19:32:36.444 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a11c5d71:::22:head 2021-10-08T19:32:36.444 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:271af37b:::23:head 2021-10-08T19:32:36.445 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:95b121be:::24:head 2021-10-08T19:32:36.445 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:58d1031b:::25:head 2021-10-08T19:32:36.445 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:0a050783:::26:head 2021-10-08T19:32:36.446 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c709704c:::27:head 2021-10-08T19:32:36.446 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:cbe56eaf:::28:head 2021-10-08T19:32:36.446 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:86b4b162:::29:head 2021-10-08T19:32:36.446 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:70d89383:::30:head 2021-10-08T19:32:36.447 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:dd450c7c:::31:head 2021-10-08T19:32:36.447 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:6d5729b1:::32:head 2021-10-08T19:32:36.447 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c388f3fb:::33:head 2021-10-08T19:32:36.448 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:56cfea31:::34:head 2021-10-08T19:32:36.448 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:9dbc1bf7:::35:head 2021-10-08T19:32:36.448 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:40b74ccd:::36:head 2021-10-08T19:32:36.448 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:4d5aaf42:::37:head 2021-10-08T19:32:36.449 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:920f362c:::38:head 2021-10-08T19:32:36.449 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:6cc53222:::39:head 2021-10-08T19:32:36.449 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:9cad833f:::40:head 2021-10-08T19:32:36.449 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:1ea84d41:::41:head 2021-10-08T19:32:36.450 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c4480ef6:::42:head 2021-10-08T19:32:36.450 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a694361e:::43:head 2021-10-08T19:32:36.450 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d1bd33e9:::44:head 2021-10-08T19:32:36.450 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:ddc2cd5d:::45:head 2021-10-08T19:32:36.451 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:2b782207:::46:head 2021-10-08T19:32:36.451 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:7b187fca:::47:head 2021-10-08T19:32:36.451 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:90ecdf6f:::48:head 2021-10-08T19:32:36.451 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a5ed95fe:::49:head 2021-10-08T19:32:36.451 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:ea0eaa55:::50:head 2021-10-08T19:32:36.452 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f33ef17b:::51:head 2021-10-08T19:32:36.452 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a0d1b2f6:::52:head 2021-10-08T19:32:36.452 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:60c5229e:::53:head 2021-10-08T19:32:36.452 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:edcbc575:::54:head 2021-10-08T19:32:36.453 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:102cf253:::55:head 2021-10-08T19:32:36.453 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:efb7fb0b:::56:head 2021-10-08T19:32:36.453 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:50d0a326:::57:head 2021-10-08T19:32:36.453 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d4dc5daf:::58:head 2021-10-08T19:32:36.453 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:3a130462:::59:head 2021-10-08T19:32:36.454 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:ec87ed71:::60:head 2021-10-08T19:32:36.454 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d5bc9454:::61:head 2021-10-08T19:32:36.454 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:3ddfe313:::62:head 2021-10-08T19:32:36.454 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:7c2816b9:::63:head 2021-10-08T19:32:36.455 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:47e00e4d:::64:head 2021-10-08T19:32:36.455 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c6410c18:::65:head 2021-10-08T19:32:36.455 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b48ed237:::66:head 2021-10-08T19:32:36.455 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:cd63ad31:::67:head 2021-10-08T19:32:36.456 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b179e92b:::68:head 2021-10-08T19:32:36.456 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:0d9f741a:::69:head 2021-10-08T19:32:36.456 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:6d3352ae:::70:head 2021-10-08T19:32:36.456 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c6d5c19e:::71:head 2021-10-08T19:32:36.456 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:bc4729c3:::72:head 2021-10-08T19:32:36.457 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:77e930b9:::73:head 2021-10-08T19:32:36.457 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:0abeecfd:::74:head 2021-10-08T19:32:36.457 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b7c37e15:::75:head 2021-10-08T19:32:36.457 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b6378398:::76:head 2021-10-08T19:32:36.458 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:02bd68de:::77:head 2021-10-08T19:32:36.458 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:cc795d2d:::78:head 2021-10-08T19:32:36.458 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:630d4fea:::79:head 2021-10-08T19:32:36.458 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:e0d29ef5:::80:head 2021-10-08T19:32:36.458 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:fd6f13d2:::81:head 2021-10-08T19:32:36.459 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:606461d5:::82:head 2021-10-08T19:32:36.459 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:eadbdc43:::83:head 2021-10-08T19:32:36.459 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:8761d0bb:::84:head 2021-10-08T19:32:36.459 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:9ef0186f:::85:head 2021-10-08T19:32:36.459 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:e0d41294:::86:head 2021-10-08T19:32:36.460 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:961de695:::87:head 2021-10-08T19:32:36.460 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:1423148f:::88:head 2021-10-08T19:32:36.460 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:633a8fa2:::89:head 2021-10-08T19:32:36.460 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a8653809:::90:head 2021-10-08T19:32:36.461 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:3dac8b33:::91:head 2021-10-08T19:32:36.461 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:35aad435:::92:head 2021-10-08T19:32:36.461 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f6dcc343:::93:head 2021-10-08T19:32:36.461 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:dbbdad87:::94:head 2021-10-08T19:32:36.461 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:1cb48ce0:::95:head 2021-10-08T19:32:36.462 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:03cd461c:::96:head 2021-10-08T19:32:36.462 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:17a4ea99:::97:head 2021-10-08T19:32:36.462 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:9993c9a7:::98:head 2021-10-08T19:32:36.462 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:6394211c:::99:head 2021-10-08T19:32:36.463 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:94c7ae57:::100:head 2021-10-08T19:32:36.463 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:6fdee5bb:::101:head 2021-10-08T19:32:36.463 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:9a477fd1:::102:head 2021-10-08T19:32:36.463 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:eb850916:::103:head 2021-10-08T19:32:36.464 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:affc56b9:::104:head 2021-10-08T19:32:36.464 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b42dc814:::105:head 2021-10-08T19:32:36.464 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f319f8f0:::106:head 2021-10-08T19:32:36.464 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:9a40b9de:::107:head 2021-10-08T19:32:36.464 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:8b524f28:::108:head 2021-10-08T19:32:36.465 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:e3de589f:::109:head 2021-10-08T19:32:36.465 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:90f90a5b:::110:head 2021-10-08T19:32:36.465 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a7b4f1d7:::111:head 2021-10-08T19:32:36.465 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:af51766e:::112:head 2021-10-08T19:32:36.465 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b6f90bd1:::113:head 2021-10-08T19:32:36.466 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:e0261208:::114:head 2021-10-08T19:32:36.466 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c9569ef7:::115:head 2021-10-08T19:32:36.466 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:61bebe50:::116:head 2021-10-08T19:32:36.466 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:fe93412b:::117:head 2021-10-08T19:32:36.467 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d3d38bee:::118:head 2021-10-08T19:32:36.467 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:3100ba0c:::119:head 2021-10-08T19:32:36.467 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d0560ada:::120:head 2021-10-08T19:32:36.467 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f0ea8b35:::121:head 2021-10-08T19:32:36.467 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:766f231a:::122:head 2021-10-08T19:32:36.468 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a07a2582:::123:head 2021-10-08T19:32:36.468 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:bd7c6b3a:::124:head 2021-10-08T19:32:36.468 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:fb2ddaff:::125:head 2021-10-08T19:32:36.468 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:4408e1fe:::126:head 2021-10-08T19:32:36.469 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:ee1df7a7:::127:head 2021-10-08T19:32:36.469 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c3002909:::128:head 2021-10-08T19:32:36.469 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:4f48ffa9:::129:head 2021-10-08T19:32:36.469 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:edf38733:::130:head 2021-10-08T19:32:36.470 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c08425c0:::131:head 2021-10-08T19:32:36.470 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:5f902d98:::132:head 2021-10-08T19:32:36.470 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:41ea2c93:::133:head 2021-10-08T19:32:36.470 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:813cee13:::134:head 2021-10-08T19:32:36.470 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:0131818d:::135:head 2021-10-08T19:32:36.471 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:26ba5a85:::136:head 2021-10-08T19:32:36.471 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:381b8a5a:::137:head 2021-10-08T19:32:36.471 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:28797e47:::138:head 2021-10-08T19:32:36.471 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:bfca7f22:::139:head 2021-10-08T19:32:36.472 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:36807075:::140:head 2021-10-08T19:32:36.472 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:80b03975:::141:head 2021-10-08T19:32:36.472 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:5c15709b:::142:head 2021-10-08T19:32:36.472 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f39ea15e:::143:head 2021-10-08T19:32:36.472 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:ea992956:::144:head 2021-10-08T19:32:36.473 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:48887b1c:::145:head 2021-10-08T19:32:36.473 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:9f24a9dd:::146:head 2021-10-08T19:32:36.473 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:987f100b:::147:head 2021-10-08T19:32:36.473 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d2dd3581:::148:head 2021-10-08T19:32:36.473 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:7fed1808:::149:head 2021-10-08T19:32:36.474 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c80b70e9:::150:head 2021-10-08T19:32:36.474 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:85ed90f9:::151:head 2021-10-08T19:32:36.474 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:36428b24:::152:head 2021-10-08T19:32:36.474 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d044c34a:::153:head 2021-10-08T19:32:36.475 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:7c18bf58:::154:head 2021-10-08T19:32:36.475 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d1c21232:::155:head 2021-10-08T19:32:36.475 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a7a3c575:::156:head 2021-10-08T19:32:36.475 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:87da0633:::157:head 2021-10-08T19:32:36.475 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d5ac3822:::158:head 2021-10-08T19:32:36.476 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:3f20522d:::159:head 2021-10-08T19:32:36.476 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:6ca26563:::160:head 2021-10-08T19:32:36.476 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:532ce135:::161:head 2021-10-08T19:32:36.476 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:c78863e6:::162:head 2021-10-08T19:32:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: pgmap v417: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:36.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:32:36.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:32:36.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:32:36.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:36.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:36.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: pgmap v417: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:32:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:32:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:32:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:36.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: pgmap v417: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:32:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-54"}]': finished 2021-10-08T19:32:36.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: osdmap e296: 8 total, 8 up, 8 in 2021-10-08T19:32:36.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:32:36.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2021-10-08T19:32:36.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:36.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:36.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:37.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:32:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:32:37.475 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-10-08T19:32:37.475 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:37.476 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:32:37.476 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:37.476 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi112-83223-43","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:32:37.476 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:37.476 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:37.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]: dispatch 2021-10-08T19:32:37.477 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]: dispatch 2021-10-08T19:32:37.478 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-10-08T19:32:37.478 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:37.478 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:32:37.478 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:37.479 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi112-83223-43","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:32:37.479 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:37.479 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:37.479 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]: dispatch 2021-10-08T19:32:37.480 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]: dispatch 2021-10-08T19:32:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2021-10-08T19:32:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: osdmap e297: 8 total, 8 up, 8 in 2021-10-08T19:32:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi112-83223-43","var": "pg_num","format": "json"}]: dispatch 2021-10-08T19:32:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:37.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]: dispatch 2021-10-08T19:32:37.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]: dispatch 2021-10-08T19:32:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:38 smithi142 ceph-mon[33432]: pgmap v420: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]': finished 2021-10-08T19:32:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:38 smithi142 ceph-mon[33432]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:32:38.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:38.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:38 smithi112 ceph-mon[40655]: pgmap v420: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:38.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]': finished 2021-10-08T19:32:38.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:38 smithi112 ceph-mon[40655]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:32:38.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:38.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:38 smithi112 ceph-mon[31694]: pgmap v420: 228 pgs: 228 active+clean; 8.4 MiB data, 392 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:38.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-43"}]': finished 2021-10-08T19:32:38.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:38 smithi112 ceph-mon[31694]: osdmap e298: 8 total, 8 up, 8 in 2021-10-08T19:32:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:39 smithi142 ceph-mon[33432]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:32:39.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:39.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:39 smithi112 ceph-mon[40655]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:32:39.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:39.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:39 smithi112 ceph-mon[31694]: osdmap e299: 8 total, 8 up, 8 in 2021-10-08T19:32:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:40 smithi142 ceph-mon[33432]: pgmap v423: 204 pgs: 8 creating+peering, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:40 smithi142 ceph-mon[33432]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:32:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:40 smithi112 ceph-mon[40655]: pgmap v423: 204 pgs: 8 creating+peering, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:40 smithi112 ceph-mon[40655]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:32:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:40 smithi112 ceph-mon[31694]: pgmap v423: 204 pgs: 8 creating+peering, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:40 smithi112 ceph-mon[31694]: osdmap e300: 8 total, 8 up, 8 in 2021-10-08T19:32:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:41.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:41.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:41 smithi142 ceph-mon[33432]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:32:41.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:41.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:41.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[40655]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:32:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-45","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[31694]: osdmap e301: 8 total, 8 up, 8 in 2021-10-08T19:32:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:32:42.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:42 smithi142 ceph-mon[33432]: pgmap v426: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:42.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:42.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:42.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:42 smithi142 ceph-mon[33432]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:32:42.530 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:42.531 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:32:42.531 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:32:42.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:42 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:32:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[40655]: pgmap v426: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[40655]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:32:42.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:42.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:32:42.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:32:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[31694]: pgmap v426: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:32:42.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[31694]: osdmap e302: 8 total, 8 up, 8 in 2021-10-08T19:32:42.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]: dispatch 2021-10-08T19:32:42.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:32:42.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:32:43.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:43.513 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:32:43.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:32:43.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:32:43.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:32:43.514 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:43.515 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:43.515 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:43.515 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:43.515 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:32:43.515 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:32:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:43.516 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[31694]: pgmap v429: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:43.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:43.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:32:43.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:32:43.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:32:43.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:32:43.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:43.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:43.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:43.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:43.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:32:43.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:32:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:43.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:43 smithi112 ceph-mon[40655]: pgmap v429: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:32:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:43.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3795776574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-55"}]': finished 2021-10-08T19:32:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:32:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: osdmap e303: 8 total, 8 up, 8 in 2021-10-08T19:32:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:32:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:32:43.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:43.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:43.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:43.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:32:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:32:42] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:43 smithi142 ceph-mon[33432]: pgmap v429: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 398 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:43.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:43.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:43.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:43.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:32:44.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:32:44.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:44.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:44 smithi142 ceph-mon[33432]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:32:44.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:44.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:44.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:44.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:32:44.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:44.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[40655]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:32:44.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:44.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:44.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:44.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:32:44.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:44.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[31694]: osdmap e304: 8 total, 8 up, 8 in 2021-10-08T19:32:44.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:44.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:44.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:32:45.491 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:45] "GET /metrics HTTP/1.1" 200 157617 "" "Prometheus/2.18.1" 2021-10-08T19:32:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:45 smithi142 ceph-mon[33432]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:32:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:32:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:32:45.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:45 smithi142 ceph-mon[33432]: pgmap v432: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:45.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:45.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:32:45.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:45 smithi142 ceph-mon[33432]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:32:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[40655]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:32:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:32:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:32:45.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[40655]: pgmap v432: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:45.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:45.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:32:45.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[40655]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:32:45.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:32:45.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[31694]: osdmap e305: 8 total, 8 up, 8 in 2021-10-08T19:32:45.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:32:45.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:32:45.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[31694]: pgmap v432: 228 pgs: 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:45.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:45.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-45","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:32:45.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:45 smithi112 ceph-mon[31694]: osdmap e306: 8 total, 8 up, 8 in 2021-10-08T19:32:47.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:32:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:32:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:47 smithi142 ceph-mon[33432]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:32:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:47 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:47 smithi142 ceph-mon[33432]: pgmap v435: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:47 smithi112 ceph-mon[40655]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:32:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:47 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:47 smithi112 ceph-mon[40655]: pgmap v435: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:47 smithi112 ceph-mon[31694]: osdmap e307: 8 total, 8 up, 8 in 2021-10-08T19:32:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:47 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:47 smithi112 ceph-mon[31694]: pgmap v435: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 399 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:48 smithi142 ceph-mon[33432]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:32:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:48 smithi112 ceph-mon[40655]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:32:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:48 smithi112 ceph-mon[31694]: osdmap e308: 8 total, 8 up, 8 in 2021-10-08T19:32:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:49 smithi142 ceph-mon[33432]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:32:49.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:49.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:49 smithi142 ceph-mon[33432]: pgmap v438: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:49.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:49.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:49 smithi112 ceph-mon[31694]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:32:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:49 smithi112 ceph-mon[31694]: pgmap v438: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:49 smithi112 ceph-mon[40655]: osdmap e309: 8 total, 8 up, 8 in 2021-10-08T19:32:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]: dispatch 2021-10-08T19:32:49.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:49 smithi112 ceph-mon[40655]: pgmap v438: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:50 smithi142 ceph-mon[33432]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:32:50.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:50.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:50 smithi112 ceph-mon[31694]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:32:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3955404236' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-56"}]': finished 2021-10-08T19:32:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:50 smithi112 ceph-mon[40655]: osdmap e310: 8 total, 8 up, 8 in 2021-10-08T19:32:51.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:51 smithi112 ceph-mon[40655]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:32:51.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3726518254' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:51 smithi112 ceph-mon[40655]: pgmap v441: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:51 smithi112 ceph-mon[31694]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:32:51.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3726518254' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:51.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:51 smithi112 ceph-mon[31694]: pgmap v441: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:51 smithi142 ceph-mon[33432]: osdmap e311: 8 total, 8 up, 8 in 2021-10-08T19:32:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3726518254' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:32:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:51 smithi142 ceph-mon[33432]: pgmap v441: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:32:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3726518254' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:52 smithi112 ceph-mon[40655]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:32:52.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3726518254' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:52.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:52 smithi112 ceph-mon[31694]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:32:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3726518254' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83041-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:32:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:52 smithi142 ceph-mon[33432]: osdmap e312: 8 total, 8 up, 8 in 2021-10-08T19:32:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:32:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:32:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:53 smithi142 ceph-mon[33432]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:32:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:53 smithi142 ceph-mon[33432]: pgmap v444: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:53.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:53.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:53.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:53.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:32:53.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:32:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:32:53.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:32:53.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[40655]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:32:53.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:53.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:53.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[40655]: pgmap v444: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:53.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[31694]: osdmap e313: 8 total, 8 up, 8 in 2021-10-08T19:32:53.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:53.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:53.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:32:53.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:53 smithi112 ceph-mon[31694]: pgmap v444: 228 pgs: 228 active+clean; 8.4 MiB data, 401 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:32:54.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:54.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:54 smithi112 ceph-mon[31694]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:32:54.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:54.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:54.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:54.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:54 smithi112 ceph-mon[40655]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:32:54.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:54.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:55.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:32:55.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:54 smithi142 ceph-mon[33432]: osdmap e314: 8 total, 8 up, 8 in 2021-10-08T19:32:55.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:55.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:55.543 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:32:55] "GET /metrics HTTP/1.1" 200 157633 "" "Prometheus/2.18.1" 2021-10-08T19:32:55.543 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:32:55 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:32:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:55.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[40655]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:32:55.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[40655]: pgmap v447: 228 pgs: 228 active+clean; 8.4 MiB data, 407 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:32:55.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:55.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:55.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:32:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:55.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:32:55.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[40655]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:55.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[31694]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:32:55.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[31694]: pgmap v447: 228 pgs: 228 active+clean; 8.4 MiB data, 407 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:32:55.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:55.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:55.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:32:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:55.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:32:55.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:55 smithi112 ceph-mon[31694]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:56.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:55 smithi142 ceph-mon[33432]: osdmap e315: 8 total, 8 up, 8 in 2021-10-08T19:32:56.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:55 smithi142 ceph-mon[33432]: pgmap v447: 228 pgs: 228 active+clean; 8.4 MiB data, 407 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:32:56.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:55 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:32:56.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:55 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:32:56.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:55 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:32:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:32:56.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:32:56.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:55 smithi142 ceph-mon[33432]: osdmap e316: 8 total, 8 up, 8 in 2021-10-08T19:32:57.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:32:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:32:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[31694]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[31694]: pgmap v450: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 407 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:32:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]: dispatch 2021-10-08T19:32:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]: dispatch 2021-10-08T19:32:57.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[40655]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[40655]: pgmap v450: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 407 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:32:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:57.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]: dispatch 2021-10-08T19:32:57.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]: dispatch 2021-10-08T19:32:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:57 smithi142 ceph-mon[33432]: osdmap e317: 8 total, 8 up, 8 in 2021-10-08T19:32:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:32:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:57 smithi142 ceph-mon[33432]: pgmap v450: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 407 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:32:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:32:57.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]: dispatch 2021-10-08T19:32:57.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]: dispatch 2021-10-08T19:32:58.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]': finished 2021-10-08T19:32:58.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:58 smithi142 ceph-mon[33432]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:58.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:58.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:58.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]': finished 2021-10-08T19:32:58.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:58 smithi112 ceph-mon[40655]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:58.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:58.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:58.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-45"}]': finished 2021-10-08T19:32:58.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:58 smithi112 ceph-mon[31694]: osdmap e318: 8 total, 8 up, 8 in 2021-10-08T19:32:58.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:58.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:32:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:59 smithi142 ceph-mon[33432]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:59.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:32:59 smithi142 ceph-mon[33432]: pgmap v453: 196 pgs: 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:32:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[40655]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[40655]: pgmap v453: 196 pgs: 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:32:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:32:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[31694]: osdmap e319: 8 total, 8 up, 8 in 2021-10-08T19:32:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/695924015' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:59.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]: dispatch 2021-10-08T19:32:59.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:32:59 smithi112 ceph-mon[31694]: pgmap v453: 196 pgs: 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:00.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:33:00.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:00 smithi142 ceph-mon[33432]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:33:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:00.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:00.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:33:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[40655]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:33:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:00.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:00.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:00.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-58"}]': finished 2021-10-08T19:33:00.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[31694]: osdmap e320: 8 total, 8 up, 8 in 2021-10-08T19:33:00.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:00.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:00.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:00.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:00.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:02.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:02.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:02.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:01 smithi142 ceph-mon[33432]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:33:02.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:02.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:02.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:02.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:01 smithi142 ceph-mon[33432]: pgmap v456: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:02.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:02.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:02.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[40655]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:33:02.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:02.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:02.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:02.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[40655]: pgmap v456: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:02.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:02.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:02.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[31694]: osdmap e321: 8 total, 8 up, 8 in 2021-10-08T19:33:02.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:02.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:02.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:02.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:01 smithi112 ceph-mon[31694]: pgmap v456: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:02.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:02.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:33:02.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:02.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:02.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:02.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]': finished 2021-10-08T19:33:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:33:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]: dispatch 2021-10-08T19:33:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]: dispatch 2021-10-08T19:33:02.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:02.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:33:02.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:02.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:02.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:02.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]': finished 2021-10-08T19:33:02.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:33:02.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]: dispatch 2021-10-08T19:33:02.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]: dispatch 2021-10-08T19:33:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: osdmap e322: 8 total, 8 up, 8 in 2021-10-08T19:33:03.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:03.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:03.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:03.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-47"}]': finished 2021-10-08T19:33:03.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: osdmap e323: 8 total, 8 up, 8 in 2021-10-08T19:33:03.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]: dispatch 2021-10-08T19:33:03.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]: dispatch 2021-10-08T19:33:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:33:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:03.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:03.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:03.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:03.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:03.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:03.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:33:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[40655]: pgmap v459: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:03.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:03.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]': finished 2021-10-08T19:33:03.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[40655]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:33:03.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:03.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:03.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[31694]: pgmap v459: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:03.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:03.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]': finished 2021-10-08T19:33:03.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[31694]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:33:03.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:03.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:03 smithi142 ceph-mon[33432]: pgmap v459: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 412 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:04.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:03 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:04.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-47", "mode": "writeback"}]': finished 2021-10-08T19:33:04.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:03 smithi142 ceph-mon[33432]: osdmap e324: 8 total, 8 up, 8 in 2021-10-08T19:33:04.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:04.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:05.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:05] "GET /metrics HTTP/1.1" 200 157633 "" "Prometheus/2.18.1" 2021-10-08T19:33:05.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:33:05.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:05 smithi142 ceph-mon[33432]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:33:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:05 smithi142 ceph-mon[33432]: pgmap v462: 228 pgs: 228 active+clean; 8.4 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:33:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:33:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[40655]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:33:05.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:05.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:05.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:05.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[40655]: pgmap v462: 228 pgs: 228 active+clean; 8.4 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:33:05.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:33:05.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[31694]: osdmap e325: 8 total, 8 up, 8 in 2021-10-08T19:33:05.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:05.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:05.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:05.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:05 smithi112 ceph-mon[31694]: pgmap v462: 228 pgs: 228 active+clean; 8.4 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:33:06.360 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:7462ddf6:::1 LibRadosAio.RoundTripCmpExtPP (3043 ms) 2021-10-08T19:33:06.360 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2021-10-08T19:33:06.360 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3015 ms) 2021-10-08T19:33:06.360 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2021-10-08T19:33:06.361 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: setting pool EIO 2021-10-08T19:33:06.361 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: max_success 1657, min_failed 1658 2021-10-08T19:33:06.361 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4049 ms) 2021-10-08T19:33:06.361 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] 29 tests from LibRadosAio (115965 ms total) 2021-10-08T19:33:06.362 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: 2021-10-08T19:33:06.362 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2021-10-08T19:33:06.362 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2021-10-08T19:33:06.362 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3007 ms) 2021-10-08T19:33:06.363 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2021-10-08T19:33:06.363 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9047 ms) 2021-10-08T19:33:06.363 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2021-10-08T19:33:06.363 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15317 ms) 2021-10-08T19:33:06.363 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2021-10-08T19:33:06.364 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (2531 ms) 2021-10-08T19:33:06.364 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29902 ms total) 2021-10-08T19:33:06.364 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: 2021-10-08T19:33:06.364 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2021-10-08T19:33:06.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2021-10-08T19:33:06.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3004 ms) 2021-10-08T19:33:06.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3004 ms total) 2021-10-08T19:33:06.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: 2021-10-08T19:33:06.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2021-10-08T19:33:06.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2021-10-08T19:33:06.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (14087 ms) 2021-10-08T19:33:06.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2021-10-08T19:33:06.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6943 ms) 2021-10-08T19:33:06.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2021-10-08T19:33:06.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6984 ms) 2021-10-08T19:33:06.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2021-10-08T19:33:06.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7026 ms) 2021-10-08T19:33:06.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2021-10-08T19:33:06.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3025 ms) 2021-10-08T19:33:06.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2021-10-08T19:33:06.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7002 ms) 2021-10-08T19:33:06.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2021-10-08T19:33:06.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7041 ms) 2021-10-08T19:33:06.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2021-10-08T19:33:06.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6922 ms) 2021-10-08T19:33:06.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2021-10-08T19:33:06.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7035 ms) 2021-10-08T19:33:06.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2021-10-08T19:33:06.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7047 ms) 2021-10-08T19:33:06.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2021-10-08T19:33:06.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7045 ms) 2021-10-08T19:33:06.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2021-10-08T19:33:06.371 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7046 ms) 2021-10-08T19:33:06.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2021-10-08T19:33:06.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7021 ms) 2021-10-08T19:33:06.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2021-10-08T19:33:06.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3033 ms) 2021-10-08T19:33:06.372 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2021-10-08T19:33:06.373 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7047 ms) 2021-10-08T19:33:06.373 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2021-10-08T19:33:06.373 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7012 ms) 2021-10-08T19:33:06.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:33:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:33:06.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:33:06.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:06.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:06 smithi142 ceph-mon[33432]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:33:06.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:06.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:06.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:06.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:33:06.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:06.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[31694]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:33:06.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:06.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:06.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:33:06.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:06.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[40655]: osdmap e326: 8 total, 8 up, 8 in 2021-10-08T19:33:06.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:06.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:06.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]: dispatch 2021-10-08T19:33:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:33:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:33:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:07.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:07.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:07.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:07.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:07 smithi142 ceph-mon[33432]: pgmap v465: 228 pgs: 228 active+clean; 8.4 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:33:07.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:07.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:33:07.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:07.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:33:07.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:07.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:07.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:07.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:07.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:07.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:07.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[40655]: pgmap v465: 228 pgs: 228 active+clean; 8.4 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:33:07.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:07.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:33:07.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2628752602' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-59"}]': finished 2021-10-08T19:33:07.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: osdmap e327: 8 total, 8 up, 8 in 2021-10-08T19:33:07.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:07.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:07.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:07.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:07.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:07.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:07.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:07 smithi112 ceph-mon[31694]: pgmap v465: 228 pgs: 228 active+clean; 8.4 MiB data, 418 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:33:08.917 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:33:08.917 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:08.917 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[40655]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:33:08.918 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:08.918 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:33:08.918 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:33:08.919 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:33:08.919 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:08.919 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[31694]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:33:08.919 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:08.920 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:33:08.920 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:33:09.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:33:09.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:09.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:08 smithi142 ceph-mon[33432]: osdmap e328: 8 total, 8 up, 8 in 2021-10-08T19:33:09.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:09.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:33:09.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:33:09.322 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:08 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:33:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:10.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:33:10.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:33:10.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:33:10.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:33:10.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: pgmap v468: 228 pgs: 228 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:10.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:10.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:33:10.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:33:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:10.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:10.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:33:10.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:33:10.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:10.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:10.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:33:10.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:33:10.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:33:10.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:33:10.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: pgmap v468: 228 pgs: 228 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:10.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:10.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:33:10.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:33:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:10.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:10.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:33:10.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:33:10.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:10.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:10.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:33:10.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: osdmap e329: 8 total, 8 up, 8 in 2021-10-08T19:33:10.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:33:10.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:33:10.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: pgmap v468: 228 pgs: 228 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:10.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:10.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:33:10.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:33:08] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:10.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:10.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-47","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:33:10.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: osdmap e330: 8 total, 8 up, 8 in 2021-10-08T19:33:10.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:10.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:11 smithi142 ceph-mon[33432]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:33:11.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:11.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:11.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:11 smithi142 ceph-mon[33432]: pgmap v471: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[40655]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:33:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[40655]: pgmap v471: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:11.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:11.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[31694]: osdmap e331: 8 total, 8 up, 8 in 2021-10-08T19:33:11.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:11.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:11.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:11 smithi112 ceph-mon[31694]: pgmap v471: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]': finished 2021-10-08T19:33:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:12 smithi142 ceph-mon[33432]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:33:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:12.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:12.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]': finished 2021-10-08T19:33:12.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[40655]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:33:12.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:12.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]': finished 2021-10-08T19:33:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[31694]: osdmap e332: 8 total, 8 up, 8 in 2021-10-08T19:33:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:12.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:12.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:12.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-47"}]: dispatch 2021-10-08T19:33:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:33:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:13 smithi142 ceph-mon[33432]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:33:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:13 smithi142 ceph-mon[33432]: pgmap v474: 196 pgs: 196 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:13.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:13.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:13 smithi112 ceph-mon[40655]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:33:13.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:13.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:13 smithi112 ceph-mon[40655]: pgmap v474: 196 pgs: 196 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:13.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:13.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:13.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:13.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:13.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:13.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:33:13.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:13.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:13 smithi112 ceph-mon[31694]: osdmap e333: 8 total, 8 up, 8 in 2021-10-08T19:33:13.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]: dispatch 2021-10-08T19:33:13.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:13 smithi112 ceph-mon[31694]: pgmap v474: 196 pgs: 196 active+clean; 8.4 MiB data, 419 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:14 smithi142 ceph-mon[33432]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:33:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:14.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[40655]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:33:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:14.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/759891292' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-60"}]': finished 2021-10-08T19:33:14.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[31694]: osdmap e334: 8 total, 8 up, 8 in 2021-10-08T19:33:14.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:14.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:14.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:14.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:14.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:15.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:15] "GET /metrics HTTP/1.1" 200 157606 "" "Prometheus/2.18.1" 2021-10-08T19:33:15.648 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:15.648 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:15.648 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:15 smithi142 ceph-mon[33432]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:33:15.648 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:15.650 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:15.650 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:15.650 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:15 smithi142 ceph-mon[33432]: pgmap v477: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:33:16.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:16.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:16.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[40655]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:33:16.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:16.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:16.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:16.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[40655]: pgmap v477: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:33:16.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-49","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:16.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:16.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[31694]: osdmap e335: 8 total, 8 up, 8 in 2021-10-08T19:33:16.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:16.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:16.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:16.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:15 smithi112 ceph-mon[31694]: pgmap v477: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:33:16.891 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:33:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:33:16.891 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:16.892 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:33:16.892 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:16.892 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:16.892 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:16.893 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]': finished 2021-10-08T19:33:16.893 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:33:16.893 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:33:16.893 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:33:17.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:17.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:33:17.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:17.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:17.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:17.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]': finished 2021-10-08T19:33:17.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:33:17.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:33:17.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:33:17.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:17.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: osdmap e336: 8 total, 8 up, 8 in 2021-10-08T19:33:17.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:17.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:17.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:17.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-49"}]': finished 2021-10-08T19:33:17.079 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: osdmap e337: 8 total, 8 up, 8 in 2021-10-08T19:33:17.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:33:17.080 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]: dispatch 2021-10-08T19:33:17.987 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:17.988 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:17 smithi142 ceph-mon[33432]: pgmap v480: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:33:17.988 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:17 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:17.988 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]': finished 2021-10-08T19:33:17.988 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:17 smithi142 ceph-mon[33432]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:33:18.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:18.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[40655]: pgmap v480: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:33:18.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:18.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]': finished 2021-10-08T19:33:18.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[40655]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:33:18.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:18.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[31694]: pgmap v480: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 8.4 MiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:33:18.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:18.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-49", "mode": "readproxy"}]': finished 2021-10-08T19:33:18.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:17 smithi112 ceph-mon[31694]: osdmap e338: 8 total, 8 up, 8 in 2021-10-08T19:33:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:18 smithi142 ceph-mon[33432]: poll took 60020.248 ms: 1 events 2021-10-08T19:33:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:18 smithi142 ceph-mon[33432]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:33:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:18.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:19.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:19.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:19.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:19.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[40655]: poll took 60020.248 ms: 1 events 2021-10-08T19:33:19.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[40655]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:33:19.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:19.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:19.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:19.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:33:19.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:33:19.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:33:19.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[31694]: poll took 60020.248 ms: 1 events 2021-10-08T19:33:19.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[31694]: osdmap e339: 8 total, 8 up, 8 in 2021-10-08T19:33:19.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:19.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:19.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:20.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:19 smithi142 ceph-mon[33432]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:20.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:20.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:19 smithi142 ceph-mon[33432]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:33:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:20.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:19 smithi112 ceph-mon[40655]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:20.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:20.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:19 smithi112 ceph-mon[40655]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:33:20.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:20.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:19 smithi112 ceph-mon[31694]: pgmap v483: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:20.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:20.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:19 smithi112 ceph-mon[31694]: osdmap e340: 8 total, 8 up, 8 in 2021-10-08T19:33:20.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]: dispatch 2021-10-08T19:33:21.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:21.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:33:21.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:21.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:21.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:21 smithi142 ceph-mon[33432]: pgmap v486: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:33:21.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:21.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:21.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[40655]: pgmap v486: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:21.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3341920364' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-61"}]': finished 2021-10-08T19:33:21.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: osdmap e341: 8 total, 8 up, 8 in 2021-10-08T19:33:21.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:21.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:21.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:21.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:21 smithi112 ceph-mon[31694]: pgmap v486: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:33:22.710 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:22.711 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:22 smithi112 ceph-mon[40655]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:33:22.711 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:22.711 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:22.712 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:22.712 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:22 smithi112 ceph-mon[31694]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:33:22.712 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:22.712 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:22.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:22.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:22 smithi142 ceph-mon[33432]: osdmap e342: 8 total, 8 up, 8 in 2021-10-08T19:33:22.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:22.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:23.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:22 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:33:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:33:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:33:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:33:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:33:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: pgmap v489: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]: dispatch 2021-10-08T19:33:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]: dispatch 2021-10-08T19:33:23.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]: dispatch 2021-10-08T19:33:23.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]: dispatch 2021-10-08T19:33:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:23.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:23.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:23.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:23.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:33:23.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:33:23.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:23.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:33:23.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:33:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:23.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:23.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:23.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:23.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:23.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: pgmap v489: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:23.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]: dispatch 2021-10-08T19:33:23.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]: dispatch 2021-10-08T19:33:23.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]: dispatch 2021-10-08T19:33:23.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]: dispatch 2021-10-08T19:33:23.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: osdmap e343: 8 total, 8 up, 8 in 2021-10-08T19:33:23.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:23.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:33:23.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:33:22] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:23.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:23.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:33:23.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:23.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:33:23.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: pgmap v489: 228 pgs: 228 active+clean; 8.4 MiB data, 426 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:23.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]: dispatch 2021-10-08T19:33:23.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]: dispatch 2021-10-08T19:33:23.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]: dispatch 2021-10-08T19:33:23.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]: dispatch 2021-10-08T19:33:24.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:24.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]': finished 2021-10-08T19:33:24.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]': finished 2021-10-08T19:33:24.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:24 smithi142 ceph-mon[33432]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:33:24.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:24.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]': finished 2021-10-08T19:33:24.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]': finished 2021-10-08T19:33:24.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:24 smithi112 ceph-mon[40655]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:33:24.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:24.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.8", "id": [1, 5]}]': finished 2021-10-08T19:33:24.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "198.1c", "id": [1, 7]}]': finished 2021-10-08T19:33:24.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:24 smithi112 ceph-mon[31694]: osdmap e344: 8 total, 8 up, 8 in 2021-10-08T19:33:25.453 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:25] "GET /metrics HTTP/1.1" 200 157623 "" "Prometheus/2.18.1" 2021-10-08T19:33:25.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:25 smithi142 ceph-mon[33432]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:33:25.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:25 smithi142 ceph-mon[33432]: pgmap v492: 236 pgs: 5 creating+peering, 2 peering, 3 unknown, 226 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:25.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:25 smithi112 ceph-mon[40655]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:33:25.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:25 smithi112 ceph-mon[40655]: pgmap v492: 236 pgs: 5 creating+peering, 2 peering, 3 unknown, 226 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:25.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:25 smithi112 ceph-mon[31694]: osdmap e345: 8 total, 8 up, 8 in 2021-10-08T19:33:25.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:25 smithi112 ceph-mon[31694]: pgmap v492: 236 pgs: 5 creating+peering, 2 peering, 3 unknown, 226 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:26.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:33:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:33:26.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:26 smithi142 ceph-mon[33432]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:33:26.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:26.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:26.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:26 smithi112 ceph-mon[40655]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:33:26.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:26.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:26.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:26 smithi112 ceph-mon[31694]: osdmap e346: 8 total, 8 up, 8 in 2021-10-08T19:33:26.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:26.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:27 smithi142 ceph-mon[33432]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:33:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:27 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:27 smithi142 ceph-mon[33432]: pgmap v495: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:27.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:27.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[40655]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:33:27.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:27.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:27.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:27.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[40655]: pgmap v495: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:27.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:27.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[31694]: osdmap e347: 8 total, 8 up, 8 in 2021-10-08T19:33:27.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3579286716' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:27.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]: dispatch 2021-10-08T19:33:27.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:27.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:27 smithi112 ceph-mon[31694]: pgmap v495: 228 pgs: 2 peering, 226 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:28.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:28.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:28 smithi142 ceph-mon[33432]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:33:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:28.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:28.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[40655]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:33:28.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:28.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:28.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:28.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-62"}]': finished 2021-10-08T19:33:28.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[31694]: osdmap e348: 8 total, 8 up, 8 in 2021-10-08T19:33:28.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:28.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:28.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:33:29.481 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:29.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:29 smithi142 ceph-mon[33432]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:33:29.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:29.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:29.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:29.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:29 smithi142 ceph-mon[33432]: pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:29.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83041-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:33:29.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[40655]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:33:29.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:29.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:29.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:29.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[40655]: pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:29.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[31694]: osdmap e349: 8 total, 8 up, 8 in 2021-10-08T19:33:29.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:29.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:29.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:29.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:29 smithi112 ceph-mon[31694]: pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:30.742 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:30.743 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:30 smithi112 ceph-mon[40655]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:33:30.743 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:30.743 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:30.744 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:30.744 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:30 smithi112 ceph-mon[31694]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:33:30.744 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:30.744 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:30 smithi142 ceph-mon[33432]: osdmap e350: 8 total, 8 up, 8 in 2021-10-08T19:33:30.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:30.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:31.508 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN 63:head 2021-10-08T19:33:31.508 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:5d165639:::164:head 2021-10-08T19:33:31.508 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f43765fc:::165:head 2021-10-08T19:33:31.509 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b4c720e9:::166:head 2021-10-08T19:33:31.509 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:e694b040:::167:head 2021-10-08T19:33:31.509 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:afa38db2:::168:head 2021-10-08T19:33:31.509 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:77ba9f53:::169:head 2021-10-08T19:33:31.510 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:87495034:::170:head 2021-10-08T19:33:31.510 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:7c96bf0e:::171:head 2021-10-08T19:33:31.510 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:dbe346cc:::172:head 2021-10-08T19:33:31.510 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:e943ec24:::173:head 2021-10-08T19:33:31.511 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f97a9c0c:::174:head 2021-10-08T19:33:31.511 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:6f26e74d:::175:head 2021-10-08T19:33:31.511 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:4f95e106:::176:head 2021-10-08T19:33:31.511 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:0e6f2f8f:::177:head 2021-10-08T19:33:31.511 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:05db05f1:::178:head 2021-10-08T19:33:31.512 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:38a78d66:::179:head 2021-10-08T19:33:31.512 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:d095610b:::180:head 2021-10-08T19:33:31.512 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:a1a9d709:::181:head 2021-10-08T19:33:31.512 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:1e5d39db:::182:head 2021-10-08T19:33:31.513 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:f7df4fb9:::183:head 2021-10-08T19:33:31.513 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:03a7f161:::184:head 2021-10-08T19:33:31.513 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:ba70721e:::185:head 2021-10-08T19:33:31.513 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:28e5662d:::186:head 2021-10-08T19:33:31.513 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:973d52de:::187:head 2021-10-08T19:33:31.514 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:4303eb1c:::188:head 2021-10-08T19:33:31.514 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:b990b48e:::189:head 2021-10-08T19:33:31.516 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:29b8165b:::190:head 2021-10-08T19:33:31.516 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:3547f197:::191:head 2021-10-08T19:33:31.516 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:7e260936:::192:head 2021-10-08T19:33:31.516 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:1abec7b1:::193:head 2021-10-08T19:33:31.516 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:10fdda93:::194:head 2021-10-08T19:33:31.517 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:15817eea:::195:head 2021-10-08T19:33:31.517 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:770bab57:::196:head 2021-10-08T19:33:31.517 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:ed9e13e7:::197:head 2021-10-08T19:33:31.518 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:71471a8f:::198:head 2021-10-08T19:33:31.518 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: checking for 189:10fb1d02:::199:head 2021-10-08T19:33:31.519 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (7811 ms) 2021-10-08T19:33:31.519 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2021-10-08T19:33:31.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,0 2021-10-08T19:33:31.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: first is 1633721566 2021-10-08T19:33:31.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,0 2021-10-08T19:33:31.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,0 2021-10-08T19:33:31.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,0 2021-10-08T19:33:31.521 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,0 2021-10-08T19:33:31.521 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,0 2021-10-08T19:33:31.521 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,1633721571,1633721572,0 2021-10-08T19:33:31.521 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,1633721571,1633721572,0 2021-10-08T19:33:31.522 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,1633721571,1633721572,0 2021-10-08T19:33:31.522 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,1633721571,1633721572,1633721574,1633721575,0 2021-10-08T19:33:31.522 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,1633721571,1633721572,1633721574,1633721575,0 2021-10-08T19:33:31.522 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721566,1633721568,1633721569,1633721571,1633721572,1633721574,1633721575,0 2021-10-08T19:33:31.523 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633721569,1633721571,1633721572,1633721574,1633721575,1633721577,1633721578,0 2021-10-08T19:33:31.523 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: first now 1633721569, trimmed 2021-10-08T19:33:31.523 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (20111 ms) 2021-10-08T19:33:31.523 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2021-10-08T19:33:31.524 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: foo0 2021-10-08T19:33:31.524 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: verifying foo0 is eventually promoted 2021-10-08T19:33:31.524 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14073 ms) 2021-10-08T19:33:31.524 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2021-10-08T19:33:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]': finished 2021-10-08T19:33:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:33:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:31.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:31.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:31.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:31.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:31 smithi142 ceph-mon[33432]: pgmap v501: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:31.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:31.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:31.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]': finished 2021-10-08T19:33:31.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:33:31.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:31.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:31.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:31.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:31.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[31694]: pgmap v501: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:31.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:31.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83041-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:31.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]': finished 2021-10-08T19:33:31.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: osdmap e351: 8 total, 8 up, 8 in 2021-10-08T19:33:31.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:31.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:31.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:31.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-49"}]: dispatch 2021-10-08T19:33:31.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:31 smithi112 ceph-mon[40655]: pgmap v501: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:33:32.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:32 smithi142 ceph-mon[33432]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:33:32.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:32 smithi112 ceph-mon[31694]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:33:32.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:32 smithi112 ceph-mon[40655]: osdmap e352: 8 total, 8 up, 8 in 2021-10-08T19:33:33.514 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:33:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:33.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:33 smithi142 ceph-mon[33432]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:33:33.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:33.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:33.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:33.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:33 smithi142 ceph-mon[33432]: pgmap v504: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:33.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:33.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:33.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:33:33.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[40655]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:33:33.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:33.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:33.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:33.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[40655]: pgmap v504: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:33.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[31694]: osdmap e353: 8 total, 8 up, 8 in 2021-10-08T19:33:33.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:33.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:33.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:33.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:33 smithi112 ceph-mon[31694]: pgmap v504: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 429 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:33:34.518 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ ] LibRadosAioEC.StatRemovePP 2021-10-08T19:33:34.519 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7050 ms) 2021-10-08T19:33:34.519 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2021-10-08T19:33:34.519 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7011 ms) 2021-10-08T19:33:34.519 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2021-10-08T19:33:34.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7056 ms) 2021-10-08T19:33:34.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2021-10-08T19:33:34.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7046 ms) 2021-10-08T19:33:34.520 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139479 ms total) 2021-10-08T19:33:34.521 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: 2021-10-08T19:33:34.521 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [----------] Global test environment tear-down 2021-10-08T19:33:34.521 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [==========] 54 tests from 4 test suites ran. (288350 ms total) 2021-10-08T19:33:34.521 INFO:tasks.workunit.client.0.smithi112.stdout: api_aio_pp: [ PASSED ] 54 tests. 2021-10-08T19:33:34.525 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.525 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83052 2021-10-08T19:33:34.525 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83052 2021-10-08T19:33:34.525 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.526 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83543 2021-10-08T19:33:34.526 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83543 2021-10-08T19:33:34.526 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.526 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83246 2021-10-08T19:33:34.527 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83246 2021-10-08T19:33:34.527 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.527 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83167 2021-10-08T19:33:34.527 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83167 2021-10-08T19:33:34.527 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.528 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83076 2021-10-08T19:33:34.528 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83076 2021-10-08T19:33:34.528 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.528 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83407 2021-10-08T19:33:34.528 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83407 2021-10-08T19:33:34.529 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.529 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83044 2021-10-08T19:33:34.529 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83044 2021-10-08T19:33:34.529 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.530 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83474 2021-10-08T19:33:34.530 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83474 2021-10-08T19:33:34.530 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.530 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83309 2021-10-08T19:33:34.530 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83309 2021-10-08T19:33:34.531 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.531 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83562 2021-10-08T19:33:34.531 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83562 2021-10-08T19:33:34.531 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.532 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83429 2021-10-08T19:33:34.532 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83429 2021-10-08T19:33:34.532 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.533 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83618 2021-10-08T19:33:34.534 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83618 2021-10-08T19:33:34.534 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.534 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83028 2021-10-08T19:33:34.534 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83028 2021-10-08T19:33:34.535 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.535 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83597 2021-10-08T19:33:34.535 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83597 2021-10-08T19:33:34.535 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.535 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83505 2021-10-08T19:33:34.536 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83505 2021-10-08T19:33:34.536 INFO:tasks.workunit.client.0.smithi112.stderr:+ for t in "${!pids[@]}" 2021-10-08T19:33:34.536 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=83217 2021-10-08T19:33:34.536 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 83217 2021-10-08T19:33:34.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:34.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:34.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:34 smithi142 ceph-mon[33432]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:33:34.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:34.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:34.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:34.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:34.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:34.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[40655]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:33:34.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:34.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:34.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:34.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:34.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-51","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:34.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[31694]: osdmap e354: 8 total, 8 up, 8 in 2021-10-08T19:33:34.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]: dispatch 2021-10-08T19:33:34.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:34.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:33:35.472 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:35] "GET /metrics HTTP/1.1" 200 157623 "" "Prometheus/2.18.1" 2021-10-08T19:33:35.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:35.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:35.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:35 smithi142 ceph-mon[33432]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:33:35.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:35.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:35.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:35 smithi142 ceph-mon[33432]: pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:33:35.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:35 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:35.822 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:35 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:33:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:35.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:35.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:35.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[40655]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:33:35.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:35.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:35.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[40655]: pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:33:35.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:35.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/202863892' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83041-63"}]': finished 2021-10-08T19:33:35.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:33:35.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[31694]: osdmap e355: 8 total, 8 up, 8 in 2021-10-08T19:33:35.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:35.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:35.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[31694]: pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:33:35.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:35 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:36.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:33:36.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:33:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:36.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]': finished 2021-10-08T19:33:36.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[40655]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:33:36.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]: dispatch 2021-10-08T19:33:36.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]: dispatch 2021-10-08T19:33:36.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:33:36.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:33:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:36.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]': finished 2021-10-08T19:33:36.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[31694]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:33:36.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]: dispatch 2021-10-08T19:33:36.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]: dispatch 2021-10-08T19:33:37.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:33:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:33:37.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:36 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:33:37.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:36 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:33:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:37.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-51"}]': finished 2021-10-08T19:33:37.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:36 smithi142 ceph-mon[33432]: osdmap e356: 8 total, 8 up, 8 in 2021-10-08T19:33:37.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]: dispatch 2021-10-08T19:33:37.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]: dispatch 2021-10-08T19:33:37.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:37.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]': finished 2021-10-08T19:33:37.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[40655]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:33:37.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:37.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:37.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:37.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[40655]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:33:37.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:37.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]': finished 2021-10-08T19:33:37.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[31694]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:33:37.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:37.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:37.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:37.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:37 smithi112 ceph-mon[31694]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:33:38.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:37 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:33:38.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-51", "mode": "writeback"}]': finished 2021-10-08T19:33:38.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:37 smithi142 ceph-mon[33432]: osdmap e357: 8 total, 8 up, 8 in 2021-10-08T19:33:38.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:38.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:33:38.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:37 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:38.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:37 smithi142 ceph-mon[33432]: pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:33:38.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:33:38.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:38 smithi112 ceph-mon[31694]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:33:38.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:38.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:38.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:33:38.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:38 smithi112 ceph-mon[40655]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:33:38.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:38 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:38.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:39.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:33:39.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:38 smithi142 ceph-mon[33432]: osdmap e358: 8 total, 8 up, 8 in 2021-10-08T19:33:39.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:38 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:39.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:33:39.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:33:39.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[40655]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:33:39.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:39.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:39.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[40655]: pgmap v513: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:39.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:33:39.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[31694]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:33:39.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:39.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:39.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:39 smithi112 ceph-mon[31694]: pgmap v513: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:40.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:33:40.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:39 smithi142 ceph-mon[33432]: osdmap e359: 8 total, 8 up, 8 in 2021-10-08T19:33:40.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:40.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:33:40.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:39 smithi142 ceph-mon[33432]: pgmap v513: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:40.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:40.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:33:40.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[31694]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:33:40.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:40.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:40.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:40.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:33:40.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[40655]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:33:40.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:40.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:41.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:40 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:33:41.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:33:41.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:40 smithi142 ceph-mon[33432]: osdmap e360: 8 total, 8 up, 8 in 2021-10-08T19:33:41.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:41.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:33:41.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:33:41.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[31694]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:33:41.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:33:41.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:33:41.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[31694]: pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:41.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:33:41.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[40655]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:33:41.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:33:41.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:33:41.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:41 smithi112 ceph-mon[40655]: pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:42.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:33:42.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:41 smithi142 ceph-mon[33432]: osdmap e361: 8 total, 8 up, 8 in 2021-10-08T19:33:42.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:33:42.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:33:42.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:41 smithi142 ceph-mon[33432]: pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:42.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:33:42.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:42 smithi112 ceph-mon[31694]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:33:42.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:33:42.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:42 smithi112 ceph-mon[40655]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:33:42.902 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-51","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:33:42.902 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:42 smithi142 ceph-mon[33432]: osdmap e362: 8 total, 8 up, 8 in 2021-10-08T19:33:43.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:33:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:43.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:43 smithi112 ceph-mon[40655]: pgmap v518: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:43.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:43 smithi112 ceph-mon[31694]: pgmap v518: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:43.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:43.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:43.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:43.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:43.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:43.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:33:44.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:43 smithi142 ceph-mon[33432]: pgmap v518: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:33:44.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:44 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:33:44.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:44 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:33:44.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:44 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:33:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:45] "GET /metrics HTTP/1.1" 200 157632 "" "Prometheus/2.18.1" 2021-10-08T19:33:46.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:46 smithi112 ceph-mon[40655]: pgmap v519: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:46.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:46 smithi112 ceph-mon[31694]: pgmap v519: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:46 smithi142 ceph-mon[33432]: pgmap v519: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:47.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:33:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:33:48.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:48.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:48 smithi112 ceph-mon[40655]: pgmap v520: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 710 B/s rd, 0 B/s wr, 0 op/s 2021-10-08T19:33:48.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:48.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:48 smithi112 ceph-mon[31694]: pgmap v520: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 710 B/s rd, 0 B/s wr, 0 op/s 2021-10-08T19:33:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:48 smithi142 ceph-mon[33432]: pgmap v520: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 710 B/s rd, 0 B/s wr, 0 op/s 2021-10-08T19:33:50.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:50 smithi112 ceph-mon[40655]: pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:50.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:50 smithi112 ceph-mon[31694]: pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:50.322 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:50 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:33:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:50 smithi142 ceph-mon[33432]: pgmap v521: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:51 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:51 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:33:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:51 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:33:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:51 smithi142 ceph-mon[33432]: pgmap v522: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:51.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:51 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:51 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:33:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:51 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:33:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:51 smithi112 ceph-mon[40655]: pgmap v522: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:51 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:33:51.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:51 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:33:51.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:51 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:33:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:33:51.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:51 smithi112 ceph-mon[31694]: pgmap v522: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:52.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:52.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:52.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:33:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:33:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:53 smithi142 ceph-mon[33432]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:33:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:53 smithi142 ceph-mon[33432]: pgmap v524: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:53.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:53.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:53.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:53.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:33:53.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:33:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:33:53.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:33:53.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:53.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[31694]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:33:53.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:53.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:53.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[31694]: pgmap v524: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:53.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:33:53.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[40655]: osdmap e363: 8 total, 8 up, 8 in 2021-10-08T19:33:53.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:53.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:53.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:53 smithi112 ceph-mon[40655]: pgmap v524: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:33:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]': finished 2021-10-08T19:33:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:54 smithi142 ceph-mon[33432]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:33:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]': finished 2021-10-08T19:33:54.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[31694]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:33:54.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:54.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:54.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:54.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:54.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]': finished 2021-10-08T19:33:54.580 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[40655]: osdmap e364: 8 total, 8 up, 8 in 2021-10-08T19:33:54.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:54.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:54.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:54.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-51"}]: dispatch 2021-10-08T19:33:55.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:55 smithi112 ceph-mon[40655]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:33:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:55 smithi112 ceph-mon[40655]: pgmap v527: 196 pgs: 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2021-10-08T19:33:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:55 smithi112 ceph-mon[31694]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:33:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:55 smithi112 ceph-mon[31694]: pgmap v527: 196 pgs: 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2021-10-08T19:33:55.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:33:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:33:55] "GET /metrics HTTP/1.1" 200 157656 "" "Prometheus/2.18.1" 2021-10-08T19:33:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:55 smithi142 ceph-mon[33432]: osdmap e365: 8 total, 8 up, 8 in 2021-10-08T19:33:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:55 smithi142 ceph-mon[33432]: pgmap v527: 196 pgs: 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2021-10-08T19:33:56.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:56 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:33:56.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:56 smithi112 ceph-mon[40655]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:33:56.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:56.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:56.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:56 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:33:56.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:56 smithi112 ceph-mon[31694]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:33:56.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:56.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:56.592 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:56 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:33:56.593 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:56 smithi142 ceph-mon[33432]: osdmap e366: 8 total, 8 up, 8 in 2021-10-08T19:33:56.593 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:56.593 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:57.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:33:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:33:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[31694]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:33:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-53"}]: dispatch 2021-10-08T19:33:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-53"}]: dispatch 2021-10-08T19:33:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[31694]: pgmap v530: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:33:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[40655]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:33:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:57.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-53"}]: dispatch 2021-10-08T19:33:57.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-53"}]: dispatch 2021-10-08T19:33:57.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:57.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:57 smithi112 ceph-mon[40655]: pgmap v530: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:33:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-53","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:33:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:57 smithi142 ceph-mon[33432]: osdmap e367: 8 total, 8 up, 8 in 2021-10-08T19:33:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:33:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-53"}]: dispatch 2021-10-08T19:33:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-53"}]: dispatch 2021-10-08T19:33:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:33:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:57 smithi142 ceph-mon[33432]: pgmap v530: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:33:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:58 smithi112 ceph-mon[40655]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:33:58.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:58 smithi112 ceph-mon[31694]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:33:58.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:58 smithi142 ceph-mon[33432]: osdmap e368: 8 total, 8 up, 8 in 2021-10-08T19:33:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:59 smithi112 ceph-mon[40655]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:33:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:33:59 smithi112 ceph-mon[40655]: pgmap v533: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:33:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:59 smithi112 ceph-mon[31694]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:33:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:59.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:59.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:33:59 smithi112 ceph-mon[31694]: pgmap v533: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:33:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:59 smithi142 ceph-mon[33432]: osdmap e369: 8 total, 8 up, 8 in 2021-10-08T19:33:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:33:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:33:59 smithi142 ceph-mon[33432]: pgmap v533: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[40655]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:34:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-55"}]: dispatch 2021-10-08T19:34:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-55"}]: dispatch 2021-10-08T19:34:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[31694]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:34:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-55"}]: dispatch 2021-10-08T19:34:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-55"}]: dispatch 2021-10-08T19:34:00.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-55","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:00.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:00 smithi142 ceph-mon[33432]: osdmap e370: 8 total, 8 up, 8 in 2021-10-08T19:34:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-55"}]: dispatch 2021-10-08T19:34:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-55"}]: dispatch 2021-10-08T19:34:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:01 smithi142 ceph-mon[33432]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:34:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:01 smithi142 ceph-mon[33432]: pgmap v536: 196 pgs: 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:01.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:01 smithi112 ceph-mon[40655]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:34:01.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:01 smithi112 ceph-mon[40655]: pgmap v536: 196 pgs: 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:01.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:01 smithi112 ceph-mon[31694]: osdmap e371: 8 total, 8 up, 8 in 2021-10-08T19:34:01.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:01 smithi112 ceph-mon[31694]: pgmap v536: 196 pgs: 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:34:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:02 smithi142 ceph-mon[33432]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:34:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:02 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:02 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:02 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:34:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:02.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:02 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:34:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[31694]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:34:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:02.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:02.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:02.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:34:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[40655]: osdmap e372: 8 total, 8 up, 8 in 2021-10-08T19:34:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:02.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:02.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:02 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:34:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:34:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:03.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:03 smithi142 ceph-mon[33432]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:34:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-57"}]: dispatch 2021-10-08T19:34:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-57"}]: dispatch 2021-10-08T19:34:03.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:03 smithi142 ceph-mon[33432]: pgmap v539: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:03.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:03.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:03.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:34:03.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[31694]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:34:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-57"}]: dispatch 2021-10-08T19:34:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-57"}]: dispatch 2021-10-08T19:34:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[31694]: pgmap v539: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:03.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-57","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:03.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[40655]: osdmap e373: 8 total, 8 up, 8 in 2021-10-08T19:34:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-57"}]: dispatch 2021-10-08T19:34:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-57"}]: dispatch 2021-10-08T19:34:03.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:03 smithi112 ceph-mon[40655]: pgmap v539: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:04 smithi142 ceph-mon[33432]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:34:04.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:04 smithi112 ceph-mon[40655]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:34:04.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:04 smithi112 ceph-mon[31694]: osdmap e374: 8 total, 8 up, 8 in 2021-10-08T19:34:05.377 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:05] "GET /metrics HTTP/1.1" 200 157656 "" "Prometheus/2.18.1" 2021-10-08T19:34:05.378 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[31694]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:34:05.378 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:05.378 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:05.379 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[31694]: pgmap v542: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:34:05.379 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:05.379 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[31694]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:34:05.379 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:05.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:05 smithi142 ceph-mon[33432]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:34:05.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:05 smithi142 ceph-mon[33432]: pgmap v542: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:34:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:05.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:05 smithi142 ceph-mon[33432]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:34:05.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:05.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[40655]: osdmap e375: 8 total, 8 up, 8 in 2021-10-08T19:34:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[40655]: pgmap v542: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:34:05.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-59","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:05.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[40655]: osdmap e376: 8 total, 8 up, 8 in 2021-10-08T19:34:05.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:07.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:34:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:34:07.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:07.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:07.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-59"}]: dispatch 2021-10-08T19:34:07.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-59"}]: dispatch 2021-10-08T19:34:07.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:06 smithi142 ceph-mon[33432]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:34:07.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:07.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:07.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-59"}]: dispatch 2021-10-08T19:34:07.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-59"}]: dispatch 2021-10-08T19:34:07.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[40655]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:34:07.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:07.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:07.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-59"}]: dispatch 2021-10-08T19:34:07.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-59"}]: dispatch 2021-10-08T19:34:07.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:06 smithi112 ceph-mon[31694]: osdmap e377: 8 total, 8 up, 8 in 2021-10-08T19:34:08.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:08.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:07 smithi142 ceph-mon[33432]: pgmap v545: 196 pgs: 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:34:08.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:07 smithi142 ceph-mon[33432]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:34:08.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:08.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[40655]: pgmap v545: 196 pgs: 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:34:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[40655]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:34:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[31694]: pgmap v545: 196 pgs: 196 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:34:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[31694]: osdmap e378: 8 total, 8 up, 8 in 2021-10-08T19:34:08.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:08.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:09 smithi142 ceph-mon[33432]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:34:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:09 smithi142 ceph-mon[33432]: pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:09.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:09.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[31694]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:34:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[31694]: pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:09.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-61","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:09.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[40655]: osdmap e379: 8 total, 8 up, 8 in 2021-10-08T19:34:09.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:09.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:09.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:09.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:09 smithi112 ceph-mon[40655]: pgmap v548: 228 pgs: 228 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:10.663 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:10.663 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:10 smithi142 ceph-mon[33432]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:34:10.663 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:10.664 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:10.664 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-61"}]: dispatch 2021-10-08T19:34:10.664 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-61"}]: dispatch 2021-10-08T19:34:10.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:10.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[31694]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:34:10.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:10.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:10.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-61"}]: dispatch 2021-10-08T19:34:10.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-61"}]: dispatch 2021-10-08T19:34:10.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:10.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[40655]: osdmap e380: 8 total, 8 up, 8 in 2021-10-08T19:34:10.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:10.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:10.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-61"}]: dispatch 2021-10-08T19:34:10.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-61"}]: dispatch 2021-10-08T19:34:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:11 smithi142 ceph-mon[33432]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:34:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:11 smithi142 ceph-mon[33432]: pgmap v551: 196 pgs: 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:11 smithi112 ceph-mon[40655]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:34:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:11 smithi112 ceph-mon[40655]: pgmap v551: 196 pgs: 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:11.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:11 smithi112 ceph-mon[31694]: osdmap e381: 8 total, 8 up, 8 in 2021-10-08T19:34:11.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:11 smithi112 ceph-mon[31694]: pgmap v551: 196 pgs: 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:34:12.392 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:12 smithi142 ceph-mon[33432]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:34:12.392 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:12.393 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:12.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:12 smithi112 ceph-mon[40655]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:34:12.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:12.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:12.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:12 smithi112 ceph-mon[31694]: osdmap e382: 8 total, 8 up, 8 in 2021-10-08T19:34:12.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:12.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:13 smithi142 ceph-mon[33432]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:34:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:13.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:13.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:13 smithi142 ceph-mon[33432]: pgmap v554: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:13.528 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:34:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:13.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:13.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[40655]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:34:13.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:13.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:13.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:13.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[40655]: pgmap v554: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:13.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:13.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:13.826 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:13.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:13.826 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:13.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:34:13.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-63","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:13.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[31694]: osdmap e383: 8 total, 8 up, 8 in 2021-10-08T19:34:13.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:13.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:13.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:13.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:13 smithi112 ceph-mon[31694]: pgmap v554: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 443 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:14 smithi142 ceph-mon[33432]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:34:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:14 smithi112 ceph-mon[40655]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:34:14.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:14.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:14 smithi112 ceph-mon[31694]: osdmap e384: 8 total, 8 up, 8 in 2021-10-08T19:34:15.413 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:15] "GET /metrics HTTP/1.1" 200 157586 "" "Prometheus/2.18.1" 2021-10-08T19:34:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:15 smithi142 ceph-mon[33432]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:34:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:15 smithi142 ceph-mon[33432]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:34:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:15 smithi112 ceph-mon[31694]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:34:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:15 smithi112 ceph-mon[31694]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:34:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:15 smithi112 ceph-mon[40655]: osdmap e385: 8 total, 8 up, 8 in 2021-10-08T19:34:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:15 smithi112 ceph-mon[40655]: pgmap v557: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:34:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:16 smithi142 ceph-mon[33432]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:34:16.773 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:34:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:34:16.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:16 smithi112 ceph-mon[40655]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:34:16.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:16 smithi112 ceph-mon[31694]: osdmap e386: 8 total, 8 up, 8 in 2021-10-08T19:34:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:17 smithi142 ceph-mon[33432]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:34:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:17 smithi142 ceph-mon[33432]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:34:17.808 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:17 smithi112 ceph-mon[40655]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:34:17.808 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:17.809 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:17 smithi112 ceph-mon[40655]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:34:17.809 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:17 smithi112 ceph-mon[31694]: osdmap e387: 8 total, 8 up, 8 in 2021-10-08T19:34:17.809 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:17.809 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:17 smithi112 ceph-mon[31694]: pgmap v560: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2021-10-08T19:34:18.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:17 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:34:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:18 smithi142 ceph-mon[33432]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:34:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:18 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:34:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:18 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:34:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:18.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:18 smithi112 ceph-mon[40655]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:34:18.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:18.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:18 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:34:18.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:18 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:34:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:18.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:18 smithi112 ceph-mon[31694]: osdmap e388: 8 total, 8 up, 8 in 2021-10-08T19:34:18.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:18.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:18 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:34:18.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:18 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:34:17] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:19 smithi142 ceph-mon[33432]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2021-10-08T19:34:19.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:19.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:19.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:19.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:19.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[40655]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2021-10-08T19:34:19.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:34:19.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:34:19.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:34:19.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:19.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:19 smithi112 ceph-mon[31694]: pgmap v562: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2021-10-08T19:34:21.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:21 smithi112 ceph-mon[40655]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:34:21.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:21 smithi112 ceph-mon[31694]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:34:21.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:21 smithi142 ceph-mon[33432]: osdmap e389: 8 total, 8 up, 8 in 2021-10-08T19:34:22.335 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:22 smithi112 ceph-mon[40655]: pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2021-10-08T19:34:22.336 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:22 smithi112 ceph-mon[31694]: pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2021-10-08T19:34:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:22 smithi142 ceph-mon[33432]: pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2021-10-08T19:34:23.515 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:23.516 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:23.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:23.517 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:23.517 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:23.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:23.518 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:34:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:34:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:34:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:23.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:23.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:23.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:34:24.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:24 smithi112 ceph-mon[40655]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 967 B/s wr, 3 op/s 2021-10-08T19:34:24.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:24 smithi112 ceph-mon[31694]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 967 B/s wr, 3 op/s 2021-10-08T19:34:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:24 smithi142 ceph-mon[33432]: pgmap v565: 228 pgs: 228 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 967 B/s wr, 3 op/s 2021-10-08T19:34:25.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:25] "GET /metrics HTTP/1.1" 200 157655 "" "Prometheus/2.18.1" 2021-10-08T19:34:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:26 smithi142 ceph-mon[33432]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:34:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:26 smithi112 ceph-mon[40655]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:34:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:26 smithi112 ceph-mon[31694]: pgmap v566: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:34:27.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:34:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:34:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:28 smithi142 ceph-mon[33432]: pgmap v567: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 657 B/s wr, 2 op/s 2021-10-08T19:34:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:28 smithi112 ceph-mon[40655]: pgmap v567: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 657 B/s wr, 2 op/s 2021-10-08T19:34:28.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:28.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:28 smithi112 ceph-mon[31694]: pgmap v567: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 657 B/s wr, 2 op/s 2021-10-08T19:34:29.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:28 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:34:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:29.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:29 smithi142 ceph-mon[33432]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:34:29.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:29 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:29.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:29 smithi112 ceph-mon[40655]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:34:29.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:29 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:29.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:29 smithi112 ceph-mon[31694]: osdmap e390: 8 total, 8 up, 8 in 2021-10-08T19:34:29.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:29 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:30 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:30 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:34:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:30 smithi142 ceph-mon[33432]: pgmap v569: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:30 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:30 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:34:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:30 smithi112 ceph-mon[40655]: pgmap v569: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:30.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:30 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:30.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:30 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:34:28] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:30.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:30 smithi112 ceph-mon[31694]: pgmap v569: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:32 smithi142 ceph-mon[33432]: pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:32 smithi112 ceph-mon[40655]: pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:32.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:32 smithi112 ceph-mon[31694]: pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:34:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:33.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:33.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:33.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:33.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:33.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:33.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:34:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:34 smithi142 ceph-mon[33432]: pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:34.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:34 smithi112 ceph-mon[31694]: pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:34 smithi112 ceph-mon[40655]: pgmap v571: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:35] "GET /metrics HTTP/1.1" 200 157655 "" "Prometheus/2.18.1" 2021-10-08T19:34:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:36 smithi142 ceph-mon[33432]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:36 smithi112 ceph-mon[40655]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:36 smithi112 ceph-mon[31694]: pgmap v572: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:37.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:34:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:34:38.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:38.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:38 smithi142 ceph-mon[33432]: pgmap v573: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:38 smithi112 ceph-mon[40655]: pgmap v573: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:38.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:38.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:38 smithi112 ceph-mon[31694]: pgmap v573: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:39 smithi142 ceph-mon[33432]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:34:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:39 smithi112 ceph-mon[40655]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:34:39.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:39 smithi112 ceph-mon[31694]: osdmap e391: 8 total, 8 up, 8 in 2021-10-08T19:34:40.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:40 smithi142 ceph-mon[33432]: pgmap v575: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:34:40.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:40 smithi142 ceph-mon[33432]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:34:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:40 smithi112 ceph-mon[40655]: pgmap v575: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:34:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:40 smithi112 ceph-mon[40655]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:34:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:40 smithi112 ceph-mon[31694]: pgmap v575: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:34:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:40 smithi112 ceph-mon[31694]: osdmap e392: 8 total, 8 up, 8 in 2021-10-08T19:34:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:42 smithi142 ceph-mon[33432]: pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:34:42.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:42 smithi112 ceph-mon[31694]: pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:34:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:42 smithi112 ceph-mon[40655]: pgmap v577: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:34:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:34:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:43.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:43.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:43.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:34:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:44 smithi142 ceph-mon[33432]: pgmap v578: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:34:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:44 smithi112 ceph-mon[40655]: pgmap v578: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:34:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:44 smithi112 ceph-mon[31694]: pgmap v578: 228 pgs: 228 active+clean; 8.4 MiB data, 451 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:34:45.124 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:44 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:34:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:45] "GET /metrics HTTP/1.1" 200 157655 "" "Prometheus/2.18.1" 2021-10-08T19:34:46.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:45 smithi142 ceph-mon[33432]: pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:34:46.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:45 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:46.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:45 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:34:46.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:45 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:34:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:46.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:45 smithi112 ceph-mon[40655]: pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:34:46.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:45 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:45 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:34:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:45 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:34:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:46.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:45 smithi112 ceph-mon[31694]: pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:34:46.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:45 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:46.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:45 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:34:46.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:45 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:34:44] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:47.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:34:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:34:48.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:47 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:48.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:47 smithi142 ceph-mon[33432]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:34:48.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:47 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:48.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:47 smithi112 ceph-mon[40655]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:34:48.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:47 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:48.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:47 smithi112 ceph-mon[31694]: pgmap v580: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:34:49.270 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:49.271 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:49.271 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-63"}]: dispatch 2021-10-08T19:34:49.271 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-63"}]: dispatch 2021-10-08T19:34:49.272 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:49.272 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:49.272 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-63"}]: dispatch 2021-10-08T19:34:49.272 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-63"}]: dispatch 2021-10-08T19:34:49.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:49.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:34:49.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-63"}]: dispatch 2021-10-08T19:34:49.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-63"}]: dispatch 2021-10-08T19:34:50.124 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:49 smithi112 ceph-mon[40655]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:50.124 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:49 smithi112 ceph-mon[40655]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:34:50.124 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:49 smithi112 ceph-mon[31694]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:50.125 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:49 smithi112 ceph-mon[31694]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:34:50.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:49 smithi142 ceph-mon[33432]: pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:34:50.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:49 smithi142 ceph-mon[33432]: osdmap e393: 8 total, 8 up, 8 in 2021-10-08T19:34:51.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:50 smithi142 ceph-mon[33432]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:34:51.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:51.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:51.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:50 smithi112 ceph-mon[40655]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:34:51.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:51.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:51.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:50 smithi112 ceph-mon[31694]: osdmap e394: 8 total, 8 up, 8 in 2021-10-08T19:34:51.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:51.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:34:52.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:51 smithi142 ceph-mon[33432]: pgmap v584: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:52.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:52.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:51 smithi142 ceph-mon[33432]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:34:52.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:52.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:52.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:52.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:52.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:51 smithi142 ceph-mon[33432]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:34:52.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[40655]: pgmap v584: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:52.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:52.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[40655]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:34:52.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:52.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:52.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:52.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:52.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[40655]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:34:52.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[31694]: pgmap v584: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:52.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-65","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:34:52.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[31694]: osdmap e395: 8 total, 8 up, 8 in 2021-10-08T19:34:52.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:34:52.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:52.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:34:52.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:34:52.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:51 smithi112 ceph-mon[31694]: osdmap e396: 8 total, 8 up, 8 in 2021-10-08T19:34:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:34:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:34:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:53.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:53.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:34:53.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:34:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:34:53.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:34:54.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:53 smithi142 ceph-mon[33432]: pgmap v587: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:54.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:53 smithi142 ceph-mon[33432]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:34:54.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:53 smithi112 ceph-mon[31694]: pgmap v587: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:54.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:53 smithi112 ceph-mon[31694]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:34:54.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:53 smithi112 ceph-mon[40655]: pgmap v587: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:34:54.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:53 smithi112 ceph-mon[40655]: osdmap e397: 8 total, 8 up, 8 in 2021-10-08T19:34:55.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:54 smithi142 ceph-mon[33432]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:34:55.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:54 smithi112 ceph-mon[40655]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:34:55.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:54 smithi112 ceph-mon[31694]: osdmap e398: 8 total, 8 up, 8 in 2021-10-08T19:34:55.323 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:55 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:34:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:55.323 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:34:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:34:55] "GET /metrics HTTP/1.1" 200 157586 "" "Prometheus/2.18.1" 2021-10-08T19:34:56.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:55 smithi142 ceph-mon[33432]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2021-10-08T19:34:56.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:55 smithi142 ceph-mon[33432]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:34:56.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:55 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:56.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:55 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:56.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:55 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:34:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:56.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[40655]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2021-10-08T19:34:56.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[40655]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:34:56.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:56.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:56.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:34:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:56.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[31694]: pgmap v590: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2021-10-08T19:34:56.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[31694]: osdmap e399: 8 total, 8 up, 8 in 2021-10-08T19:34:56.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:34:56.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:34:56.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:55 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:34:55] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:34:57.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:34:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:34:58.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:58.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:57 smithi142 ceph-mon[33432]: pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2021-10-08T19:34:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:57 smithi112 ceph-mon[40655]: pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2021-10-08T19:34:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:34:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:57 smithi112 ceph-mon[31694]: pgmap v592: 228 pgs: 228 active+clean; 8.4 MiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2021-10-08T19:35:00.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:34:59 smithi142 ceph-mon[33432]: pgmap v593: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2021-10-08T19:35:00.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:34:59 smithi112 ceph-mon[31694]: pgmap v593: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2021-10-08T19:35:00.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:34:59 smithi112 ceph-mon[40655]: pgmap v593: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2021-10-08T19:35:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:01 smithi142 ceph-mon[33432]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:35:01.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:01 smithi112 ceph-mon[31694]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:35:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:01 smithi112 ceph-mon[40655]: osdmap e400: 8 total, 8 up, 8 in 2021-10-08T19:35:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:02 smithi142 ceph-mon[33432]: pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 297 B/s wr, 3 op/s 2021-10-08T19:35:02.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:02 smithi112 ceph-mon[31694]: pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 297 B/s wr, 3 op/s 2021-10-08T19:35:02.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:02 smithi112 ceph-mon[40655]: pgmap v595: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 297 B/s wr, 3 op/s 2021-10-08T19:35:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:35:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:03.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:03.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:03.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:35:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:04 smithi142 ceph-mon[33432]: pgmap v596: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:04 smithi112 ceph-mon[40655]: pgmap v596: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:04.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:04 smithi112 ceph-mon[31694]: pgmap v596: 228 pgs: 228 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:05.389 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:05.389 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:05.389 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-65"}]: dispatch 2021-10-08T19:35:05.389 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-65"}]: dispatch 2021-10-08T19:35:05.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:05.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:05.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-65"}]: dispatch 2021-10-08T19:35:05.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-65"}]: dispatch 2021-10-08T19:35:05.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:05] "GET /metrics HTTP/1.1" 200 157586 "" "Prometheus/2.18.1" 2021-10-08T19:35:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-65"}]: dispatch 2021-10-08T19:35:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-65"}]: dispatch 2021-10-08T19:35:06.364 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:06 smithi142 ceph-mon[33432]: pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 207 B/s wr, 2 op/s 2021-10-08T19:35:06.364 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:06 smithi142 ceph-mon[33432]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:35:06.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:06 smithi112 ceph-mon[31694]: pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 207 B/s wr, 2 op/s 2021-10-08T19:35:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:06 smithi112 ceph-mon[31694]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:35:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:06 smithi112 ceph-mon[40655]: pgmap v597: 228 pgs: 228 active+clean; 8.4 MiB data, 463 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 207 B/s wr, 2 op/s 2021-10-08T19:35:06.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:06 smithi112 ceph-mon[40655]: osdmap e401: 8 total, 8 up, 8 in 2021-10-08T19:35:07.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:35:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:35:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:07 smithi142 ceph-mon[33432]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:35:07.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:07.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:07.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:07 smithi112 ceph-mon[31694]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:35:07.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:07.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:07.584 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:07 smithi112 ceph-mon[40655]: osdmap e402: 8 total, 8 up, 8 in 2021-10-08T19:35:07.584 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:07.584 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:08 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:08 smithi142 ceph-mon[33432]: pgmap v600: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 463 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:08 smithi142 ceph-mon[33432]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:35:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:08.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:08.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[31694]: pgmap v600: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 463 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[31694]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:35:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[40655]: pgmap v600: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 463 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-67","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[40655]: osdmap e403: 8 total, 8 up, 8 in 2021-10-08T19:35:08.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:09.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:09 smithi142 ceph-mon[33432]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:35:09.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:09.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-67"}]: dispatch 2021-10-08T19:35:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-67"}]: dispatch 2021-10-08T19:35:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[40655]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:35:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-67"}]: dispatch 2021-10-08T19:35:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-67"}]: dispatch 2021-10-08T19:35:09.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[31694]: osdmap e404: 8 total, 8 up, 8 in 2021-10-08T19:35:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-67"}]: dispatch 2021-10-08T19:35:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-67"}]: dispatch 2021-10-08T19:35:10.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:10 smithi142 ceph-mon[33432]: pgmap v603: 228 pgs: 228 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:10.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:10 smithi142 ceph-mon[33432]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:35:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:10 smithi112 ceph-mon[40655]: pgmap v603: 228 pgs: 228 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:10 smithi112 ceph-mon[40655]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:35:10.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:10 smithi112 ceph-mon[31694]: pgmap v603: 228 pgs: 228 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:10.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:10 smithi112 ceph-mon[31694]: osdmap e405: 8 total, 8 up, 8 in 2021-10-08T19:35:11.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:11 smithi142 ceph-mon[33432]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:35:11.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:11.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:11.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:11.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:11 smithi142 ceph-mon[33432]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:35:11.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[40655]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:35:11.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:11.581 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:11.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:11.582 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[40655]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:35:11.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[31694]: osdmap e406: 8 total, 8 up, 8 in 2021-10-08T19:35:11.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:11.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:11.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-69","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:11.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:11 smithi112 ceph-mon[31694]: osdmap e407: 8 total, 8 up, 8 in 2021-10-08T19:35:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:12 smithi142 ceph-mon[33432]: pgmap v606: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:35:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-69"}]: dispatch 2021-10-08T19:35:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-69"}]: dispatch 2021-10-08T19:35:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:12 smithi142 ceph-mon[33432]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:35:12.821 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:12 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:35:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:12.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[40655]: pgmap v606: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:35:12.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:12.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-69"}]: dispatch 2021-10-08T19:35:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-69"}]: dispatch 2021-10-08T19:35:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[40655]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:35:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[31694]: pgmap v606: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:35:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:12.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-69"}]: dispatch 2021-10-08T19:35:12.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-69"}]: dispatch 2021-10-08T19:35:12.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:12 smithi112 ceph-mon[31694]: osdmap e408: 8 total, 8 up, 8 in 2021-10-08T19:35:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:35:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:13 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:13 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:35:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:13 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:35:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:13 smithi142 ceph-mon[33432]: pgmap v609: 196 pgs: 196 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:13 smithi142 ceph-mon[33432]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:35:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:13.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:13.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:13.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:35:13.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:13.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:35:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:35:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[31694]: pgmap v609: 196 pgs: 196 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[31694]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:35:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:13.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:13.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:13.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:35:13.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:35:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:13.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[40655]: pgmap v609: 196 pgs: 196 active+clean; 8.4 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:13.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[40655]: osdmap e409: 8 total, 8 up, 8 in 2021-10-08T19:35:13.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:13.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:15.455 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:15.455 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[40655]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:35:15.455 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:15.456 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:15.456 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:15.456 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:15.457 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[31694]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:35:15.457 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:15.457 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:15.457 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:15.458 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:15] "GET /metrics HTTP/1.1" 200 157596 "" "Prometheus/2.18.1" 2021-10-08T19:35:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-71","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:15 smithi142 ceph-mon[33432]: osdmap e410: 8 total, 8 up, 8 in 2021-10-08T19:35:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:35:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:16 smithi142 ceph-mon[33432]: pgmap v612: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:35:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:16.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:16 smithi142 ceph-mon[33432]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:35:16.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:16 smithi112 ceph-mon[40655]: pgmap v612: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:35:16.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:16.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:16 smithi112 ceph-mon[40655]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:35:16.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:16 smithi112 ceph-mon[31694]: pgmap v612: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:35:16.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:35:16.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:16 smithi112 ceph-mon[31694]: osdmap e411: 8 total, 8 up, 8 in 2021-10-08T19:35:17.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:35:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:35:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:17 smithi142 ceph-mon[33432]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:35:17.548 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:17 smithi112 ceph-mon[40655]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:35:17.549 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:17 smithi112 ceph-mon[31694]: osdmap e412: 8 total, 8 up, 8 in 2021-10-08T19:35:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:18 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:18 smithi142 ceph-mon[33432]: pgmap v615: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:35:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:18 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:18 smithi112 ceph-mon[40655]: pgmap v615: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:35:18.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:18 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:18.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:18 smithi112 ceph-mon[31694]: pgmap v615: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:35:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:19.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:35:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:35:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:35:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:20.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:20 smithi142 ceph-mon[33432]: pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2021-10-08T19:35:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:20 smithi112 ceph-mon[40655]: pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2021-10-08T19:35:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:20 smithi112 ceph-mon[31694]: pgmap v616: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2021-10-08T19:35:22.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:21 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:35:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:22 smithi142 ceph-mon[33432]: pgmap v617: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 922 B/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:35:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:22.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:22 smithi112 ceph-mon[31694]: pgmap v617: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 922 B/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:35:22.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:22.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:22 smithi112 ceph-mon[40655]: pgmap v617: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 922 B/s rd, 2.0 KiB/s wr, 4 op/s 2021-10-08T19:35:22.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:23.517 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:35:23.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:35:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:23.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:23.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:23.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:23.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:23.519 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:35:23.519 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:35:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:23.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:23.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:23.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:23.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:35:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:23 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:35:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:23 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:35:21] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:35:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:35:23.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:23.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:23.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:23.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:23.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:23.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:35:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:24 smithi142 ceph-mon[33432]: pgmap v618: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2021-10-08T19:35:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:24 smithi112 ceph-mon[40655]: pgmap v618: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2021-10-08T19:35:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:24 smithi112 ceph-mon[31694]: pgmap v618: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2021-10-08T19:35:25.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:25] "GET /metrics HTTP/1.1" 200 157668 "" "Prometheus/2.18.1" 2021-10-08T19:35:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:26 smithi142 ceph-mon[33432]: pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:35:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:26 smithi112 ceph-mon[40655]: pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:35:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:26 smithi112 ceph-mon[31694]: pgmap v619: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:35:27.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:35:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:35:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:28 smithi142 ceph-mon[33432]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:35:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:28 smithi112 ceph-mon[40655]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:35:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:28 smithi112 ceph-mon[31694]: pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:35:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:30 smithi142 ceph-mon[33432]: pgmap v621: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:35:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:30 smithi112 ceph-mon[40655]: pgmap v621: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:35:30.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:30 smithi112 ceph-mon[31694]: pgmap v621: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:35:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:32 smithi142 ceph-mon[33432]: pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:32 smithi112 ceph-mon[40655]: pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:32.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:32 smithi112 ceph-mon[31694]: pgmap v622: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:33.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:35:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:33.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:33.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:33.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:35:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:34 smithi142 ceph-mon[33432]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:34 smithi112 ceph-mon[40655]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:34.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:34 smithi112 ceph-mon[31694]: pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:35] "GET /metrics HTTP/1.1" 200 157668 "" "Prometheus/2.18.1" 2021-10-08T19:35:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:36 smithi142 ceph-mon[33432]: pgmap v624: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:36.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:36 smithi112 ceph-mon[31694]: pgmap v624: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:36 smithi112 ceph-mon[40655]: pgmap v624: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:37.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:35:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:35:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-71"}]: dispatch 2021-10-08T19:35:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-71"}]: dispatch 2021-10-08T19:35:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:37.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:37.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-71"}]: dispatch 2021-10-08T19:35:37.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-71"}]: dispatch 2021-10-08T19:35:37.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:37.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:37.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-71"}]: dispatch 2021-10-08T19:35:37.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-71"}]: dispatch 2021-10-08T19:35:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:38 smithi142 ceph-mon[33432]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:38 smithi142 ceph-mon[33432]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:35:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:38 smithi112 ceph-mon[40655]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:38 smithi112 ceph-mon[40655]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:35:38.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:38.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:38 smithi112 ceph-mon[31694]: pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 435 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:35:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:38 smithi112 ceph-mon[31694]: osdmap e413: 8 total, 8 up, 8 in 2021-10-08T19:35:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:39 smithi142 ceph-mon[33432]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:35:39.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:39.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:39.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:39.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:39 smithi142 ceph-mon[33432]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:35:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[40655]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:35:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:39.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:39.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[40655]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:35:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[31694]: osdmap e414: 8 total, 8 up, 8 in 2021-10-08T19:35:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-73","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:39 smithi112 ceph-mon[31694]: osdmap e415: 8 total, 8 up, 8 in 2021-10-08T19:35:40.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:39 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:35:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:40 smithi142 ceph-mon[33432]: pgmap v628: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:40 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:40 smithi142 ceph-mon[33432]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:35:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:40 smithi112 ceph-mon[40655]: pgmap v628: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:40 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:40 smithi112 ceph-mon[40655]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:35:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:40 smithi112 ceph-mon[31694]: pgmap v628: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:40 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:40 smithi112 ceph-mon[31694]: osdmap e416: 8 total, 8 up, 8 in 2021-10-08T19:35:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:41 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:35:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:41 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:35:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:41 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:35:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:41 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:35:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:41 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:35:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:41 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:35:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:42 smithi142 ceph-mon[33432]: pgmap v631: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:42 smithi142 ceph-mon[33432]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:35:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:42 smithi112 ceph-mon[40655]: pgmap v631: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:42 smithi112 ceph-mon[40655]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:35:42.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:42 smithi112 ceph-mon[31694]: pgmap v631: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:42.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:42 smithi112 ceph-mon[31694]: osdmap e417: 8 total, 8 up, 8 in 2021-10-08T19:35:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:35:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:43.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:43.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:43.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:35:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:44 smithi142 ceph-mon[33432]: pgmap v633: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:35:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:44 smithi112 ceph-mon[31694]: pgmap v633: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:35:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:44 smithi112 ceph-mon[40655]: pgmap v633: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:35:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:45] "GET /metrics HTTP/1.1" 200 156514 "" "Prometheus/2.18.1" 2021-10-08T19:35:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:46 smithi142 ceph-mon[33432]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2021-10-08T19:35:46.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:46 smithi112 ceph-mon[40655]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2021-10-08T19:35:46.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:46 smithi112 ceph-mon[31694]: pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2021-10-08T19:35:47.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:35:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:35:48.244 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:47 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:35:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:48 smithi142 ceph-mon[33432]: pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 943 B/s wr, 3 op/s 2021-10-08T19:35:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:48 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:48 smithi112 ceph-mon[40655]: pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 943 B/s wr, 3 op/s 2021-10-08T19:35:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:48 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:48 smithi112 ceph-mon[31694]: pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 943 B/s wr, 3 op/s 2021-10-08T19:35:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:48 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:35:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:49 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:35:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:49 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:35:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:49 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:35:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:49 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:35:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:49 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:35:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:49 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:35:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:35:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:50 smithi142 ceph-mon[33432]: pgmap v636: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 835 B/s wr, 3 op/s 2021-10-08T19:35:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:50 smithi112 ceph-mon[40655]: pgmap v636: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 835 B/s wr, 3 op/s 2021-10-08T19:35:50.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:50 smithi112 ceph-mon[31694]: pgmap v636: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 835 B/s wr, 3 op/s 2021-10-08T19:35:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:52 smithi142 ceph-mon[33432]: pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2021-10-08T19:35:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-73"}]: dispatch 2021-10-08T19:35:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-73"}]: dispatch 2021-10-08T19:35:52.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[31694]: pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2021-10-08T19:35:52.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:52.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:52.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-73"}]: dispatch 2021-10-08T19:35:52.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-73"}]: dispatch 2021-10-08T19:35:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[40655]: pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 716 B/s wr, 3 op/s 2021-10-08T19:35:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-73"}]: dispatch 2021-10-08T19:35:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-73"}]: dispatch 2021-10-08T19:35:53.518 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:53 smithi112 ceph-mon[40655]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:35:53.519 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:53 smithi112 ceph-mon[40655]: pgmap v639: 196 pgs: 196 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 307 B/s wr, 1 op/s 2021-10-08T19:35:53.519 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:53.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:53.520 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:53.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:35:53.520 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:35:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:35:53.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:35:53.520 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:53 smithi112 ceph-mon[31694]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:35:53.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:53 smithi112 ceph-mon[31694]: pgmap v639: 196 pgs: 196 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 307 B/s wr, 1 op/s 2021-10-08T19:35:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:35:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:35:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:53 smithi142 ceph-mon[33432]: osdmap e418: 8 total, 8 up, 8 in 2021-10-08T19:35:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:53 smithi142 ceph-mon[33432]: pgmap v639: 196 pgs: 196 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 307 B/s wr, 1 op/s 2021-10-08T19:35:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:54 smithi112 ceph-mon[40655]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:35:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:54 smithi112 ceph-mon[31694]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:35:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:54.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:54 smithi142 ceph-mon[33432]: osdmap e419: 8 total, 8 up, 8 in 2021-10-08T19:35:54.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:54.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:35:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:35:55] "GET /metrics HTTP/1.1" 200 156518 "" "Prometheus/2.18.1" 2021-10-08T19:35:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:55 smithi112 ceph-mon[40655]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:35:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:55 smithi112 ceph-mon[40655]: pgmap v642: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:55 smithi112 ceph-mon[31694]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:35:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:55 smithi112 ceph-mon[31694]: pgmap v642: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-75","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:35:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:55 smithi142 ceph-mon[33432]: osdmap e420: 8 total, 8 up, 8 in 2021-10-08T19:35:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:35:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:55 smithi142 ceph-mon[33432]: pgmap v642: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:35:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:56 smithi112 ceph-mon[40655]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:35:56.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:56 smithi112 ceph-mon[31694]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:35:56.572 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:35:56 smithi112 conmon[45343]: 2021-10-08T19:35:56.328+0000 7f0dc666b700 -1 snap_mapper.add_oid found existing snaps mapped on 64:abad8bd3:test-rados-api-smithi112-83223-76::foo:28, removing 2021-10-08T19:35:56.573 INFO:journalctl@ceph.osd.2.smithi112.stdout:Oct 08 19:35:56 smithi112 conmon[53645]: 2021-10-08T19:35:56.328+0000 7f276d1b0700 -1 snap_mapper.add_oid found existing snaps mapped on 64:abad8bd3:test-rados-api-smithi112-83223-76::foo:28, removing 2021-10-08T19:35:56.573 INFO:journalctl@ceph.osd.3.smithi112.stdout:Oct 08 19:35:56 smithi112 conmon[57287]: 2021-10-08T19:35:56.328+0000 7f6608c8d700 -1 snap_mapper.add_oid found existing snaps mapped on 64:abad8bd3:test-rados-api-smithi112-83223-76::foo:28, removing 2021-10-08T19:35:56.689 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:56 smithi142 ceph-mon[33432]: osdmap e421: 8 total, 8 up, 8 in 2021-10-08T19:35:57.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:35:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:35:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[31694]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:35:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-75"}]: dispatch 2021-10-08T19:35:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-75"}]: dispatch 2021-10-08T19:35:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[31694]: pgmap v645: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:57.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[40655]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:35:57.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-75"}]: dispatch 2021-10-08T19:35:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-75"}]: dispatch 2021-10-08T19:35:57.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:57.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:57 smithi112 ceph-mon[40655]: pgmap v645: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:57 smithi142 ceph-mon[33432]: osdmap e422: 8 total, 8 up, 8 in 2021-10-08T19:35:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:35:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-75"}]: dispatch 2021-10-08T19:35:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-75"}]: dispatch 2021-10-08T19:35:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:35:57.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:57 smithi142 ceph-mon[33432]: pgmap v645: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:35:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:58 smithi112 ceph-mon[40655]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:35:58.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:58 smithi112 ceph-mon[31694]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:35:58.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:58 smithi142 ceph-mon[33432]: osdmap e423: 8 total, 8 up, 8 in 2021-10-08T19:35:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:59 smithi142 ceph-mon[33432]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:35:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:35:59 smithi142 ceph-mon[33432]: pgmap v648: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:35:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:59 smithi112 ceph-mon[40655]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:35:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:35:59 smithi112 ceph-mon[40655]: pgmap v648: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:35:59.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:59 smithi112 ceph-mon[31694]: osdmap e424: 8 total, 8 up, 8 in 2021-10-08T19:35:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:59.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:35:59.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:35:59 smithi112 ceph-mon[31694]: pgmap v648: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:36:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:00 smithi142 ceph-mon[33432]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:36:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:00.524 INFO:journalctl@ceph.osd.7.smithi142.stdout:Oct 08 19:36:00 smithi142 conmon[52630]: 2021-10-08T19:36:00.342+0000 7fe044337700 -1 snap_mapper.add_oid found existing snaps mapped on 64:22d7af05:test-rados-api-smithi112-83223-78::foo:29, removing 2021-10-08T19:36:00.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:00.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:00 smithi112 ceph-mon[40655]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:36:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:00.822 INFO:journalctl@ceph.osd.1.smithi112.stdout:Oct 08 19:36:00 smithi112 conmon[49444]: 2021-10-08T19:36:00.343+0000 7f8c293b5700 -1 snap_mapper.add_oid found existing snaps mapped on 64:22d7af05:test-rados-api-smithi112-83223-78::foo:29, removing 2021-10-08T19:36:00.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-77","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:00.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:00 smithi112 ceph-mon[31694]: osdmap e425: 8 total, 8 up, 8 in 2021-10-08T19:36:00.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:00.824 INFO:journalctl@ceph.osd.3.smithi112.stdout:Oct 08 19:36:00 smithi112 conmon[57287]: 2021-10-08T19:36:00.343+0000 7f660948e700 -1 snap_mapper.add_oid found existing snaps mapped on 64:22d7af05:test-rados-api-smithi112-83223-78::foo:29, removing 2021-10-08T19:36:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:01 smithi142 ceph-mon[33432]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:36:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-77"}]: dispatch 2021-10-08T19:36:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-77"}]: dispatch 2021-10-08T19:36:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:01 smithi142 ceph-mon[33432]: pgmap v651: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:36:01.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[40655]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:36:01.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:01.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:01.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-77"}]: dispatch 2021-10-08T19:36:01.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-77"}]: dispatch 2021-10-08T19:36:01.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[40655]: pgmap v651: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:36:01.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[31694]: osdmap e426: 8 total, 8 up, 8 in 2021-10-08T19:36:01.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:01.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:01.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-77"}]: dispatch 2021-10-08T19:36:01.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-77"}]: dispatch 2021-10-08T19:36:01.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:01 smithi112 ceph-mon[31694]: pgmap v651: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2021-10-08T19:36:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:02 smithi142 ceph-mon[33432]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:36:02.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:02 smithi112 ceph-mon[31694]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:36:02.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:02 smithi112 ceph-mon[40655]: osdmap e427: 8 total, 8 up, 8 in 2021-10-08T19:36:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:36:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:03.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:03 smithi142 ceph-mon[33432]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:36:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:03 smithi142 ceph-mon[33432]: pgmap v654: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:03.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:03 smithi112 ceph-mon[40655]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:36:03.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:03.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:03.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:03 smithi112 ceph-mon[40655]: pgmap v654: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:03.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:03.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:03.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:03.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:03.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:36:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:03 smithi112 ceph-mon[31694]: osdmap e428: 8 total, 8 up, 8 in 2021-10-08T19:36:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:03 smithi112 ceph-mon[31694]: pgmap v654: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:04 smithi142 ceph-mon[33432]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:36:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:04.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:04.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:04 smithi112 ceph-mon[40655]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:36:04.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:04.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-79","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:04.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:04 smithi112 ceph-mon[31694]: osdmap e429: 8 total, 8 up, 8 in 2021-10-08T19:36:04.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:05] "GET /metrics HTTP/1.1" 200 156518 "" "Prometheus/2.18.1" 2021-10-08T19:36:05.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:05 smithi112 ceph-mon[31694]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:36:05.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:05 smithi112 ceph-mon[31694]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:36:05.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:05 smithi112 ceph-mon[40655]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:36:05.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:05 smithi112 ceph-mon[40655]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:36:05.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:05 smithi142 ceph-mon[33432]: osdmap e430: 8 total, 8 up, 8 in 2021-10-08T19:36:05.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:05 smithi142 ceph-mon[33432]: pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-10-08T19:36:06.700 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:06 smithi142 ceph-mon[33432]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:36:06.700 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.12"}]: dispatch 2021-10-08T19:36:06.700 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:06 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.12"}]: dispatch 2021-10-08T19:36:06.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:06 smithi112 ceph-mon[31694]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:36:06.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.12"}]: dispatch 2021-10-08T19:36:06.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:06 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.12"}]: dispatch 2021-10-08T19:36:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:06 smithi112 ceph-mon[40655]: osdmap e431: 8 total, 8 up, 8 in 2021-10-08T19:36:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.12"}]: dispatch 2021-10-08T19:36:06.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:06 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "216.12"}]: dispatch 2021-10-08T19:36:07.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:36:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:36:07.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:06 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:36:06] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:08.216 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.217 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[40655]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:36:08.217 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:08.217 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:36:08.217 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:36:06] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:08.218 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.218 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[31694]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:36:08.218 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:08.219 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:36:08.219 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:07 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:36:06] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:08.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:08.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:07 smithi142 ceph-mon[33432]: pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:36:08.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:07 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:08.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:07 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:36:08.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:07 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:36:06] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:09.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:08 smithi142 ceph-mon[33432]: 216.12 deep-scrub ok 2021-10-08T19:36:09.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:08 smithi112 ceph-mon[40655]: 216.12 deep-scrub ok 2021-10-08T19:36:09.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:08 smithi112 ceph-mon[31694]: 216.12 deep-scrub ok 2021-10-08T19:36:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:09 smithi142 ceph-mon[33432]: pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:36:10.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:09 smithi112 ceph-mon[40655]: pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:36:10.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:09 smithi112 ceph-mon[31694]: pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:36:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:12 smithi142 ceph-mon[33432]: pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2021-10-08T19:36:12.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:12 smithi112 ceph-mon[40655]: pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2021-10-08T19:36:12.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:12 smithi112 ceph-mon[31694]: pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2021-10-08T19:36:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:36:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:13.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:13.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:13.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:36:14.390 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:14 smithi112 ceph-mon[40655]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 242 B/s wr, 1 op/s 2021-10-08T19:36:14.391 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:14 smithi112 ceph-mon[31694]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 242 B/s wr, 1 op/s 2021-10-08T19:36:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:14 smithi142 ceph-mon[33432]: pgmap v662: 228 pgs: 228 active+clean; 8.4 MiB data, 442 MiB used, 715 GiB / 715 GiB avail; 606 B/s rd, 242 B/s wr, 1 op/s 2021-10-08T19:36:14.821 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:14 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:36:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:15.397 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:15] "GET /metrics HTTP/1.1" 200 157668 "" "Prometheus/2.18.1" 2021-10-08T19:36:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:15 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:15 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:36:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:15 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:36:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:15 smithi142 ceph-mon[33432]: pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 204 B/s wr, 73 op/s 2021-10-08T19:36:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:15 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:15.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:15 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:36:15.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:15 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:36:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:15.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:15 smithi112 ceph-mon[31694]: pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 204 B/s wr, 73 op/s 2021-10-08T19:36:15.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:15 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:15.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:15 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:36:15.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:15 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:36:14] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:15.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:15 smithi112 ceph-mon[40655]: pgmap v663: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 204 B/s wr, 73 op/s 2021-10-08T19:36:17.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:36:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:36:18.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:17 smithi142 ceph-mon[33432]: pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 179 B/s wr, 63 op/s 2021-10-08T19:36:18.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:17 smithi112 ceph-mon[31694]: pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 179 B/s wr, 63 op/s 2021-10-08T19:36:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:17 smithi112 ceph-mon[40655]: pgmap v664: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 179 B/s wr, 63 op/s 2021-10-08T19:36:19.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:19.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:19.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:19.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:19.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:19.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:19.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:19.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:19.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:36:19.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:36:19.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:36:19.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:20.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:19 smithi142 ceph-mon[33432]: pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 61 op/s 2021-10-08T19:36:20.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:19 smithi112 ceph-mon[40655]: pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 61 op/s 2021-10-08T19:36:20.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:19 smithi112 ceph-mon[31694]: pgmap v665: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 170 B/s wr, 61 op/s 2021-10-08T19:36:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:22 smithi142 ceph-mon[33432]: pgmap v666: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:22.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:22 smithi112 ceph-mon[31694]: pgmap v666: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:22 smithi112 ceph-mon[40655]: pgmap v666: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:23.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:23.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:23.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:23.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:23.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:23.522 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:23.522 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:23.522 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:36:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:36:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:36:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:23.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:23.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:23.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:36:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:24 smithi142 ceph-mon[33432]: pgmap v667: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:24 smithi112 ceph-mon[31694]: pgmap v667: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:24 smithi112 ceph-mon[40655]: pgmap v667: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:25] "GET /metrics HTTP/1.1" 200 157667 "" "Prometheus/2.18.1" 2021-10-08T19:36:25.773 INFO:journalctl@ceph.osd.4.smithi142.stdout:Oct 08 19:36:25 smithi142 conmon[40749]: 2021-10-08T19:36:25.404+0000 7f6809215700 -1 snap_mapper.add_oid found existing snaps mapped on 216:49b85251:test-rados-api-smithi112-83223-80::foo:2, removing 2021-10-08T19:36:25.773 INFO:journalctl@ceph.osd.5.smithi142.stdout:Oct 08 19:36:25 smithi142 conmon[44867]: 2021-10-08T19:36:25.404+0000 7fe536f91700 -1 snap_mapper.add_oid found existing snaps mapped on 216:49b85251:test-rados-api-smithi112-83223-80::foo:2, removing 2021-10-08T19:36:25.774 INFO:journalctl@ceph.osd.7.smithi142.stdout:Oct 08 19:36:25 smithi142 conmon[52630]: 2021-10-08T19:36:25.404+0000 7fe040b30700 -1 snap_mapper.add_oid found existing snaps mapped on 216:49b85251:test-rados-api-smithi112-83223-80::foo:2, removing 2021-10-08T19:36:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:26 smithi142 ceph-mon[33432]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:26.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:26.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:26.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-79"}]: dispatch 2021-10-08T19:36:26.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-79"}]: dispatch 2021-10-08T19:36:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[40655]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:26.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-79"}]: dispatch 2021-10-08T19:36:26.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-79"}]: dispatch 2021-10-08T19:36:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[31694]: pgmap v668: 228 pgs: 228 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2021-10-08T19:36:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-79"}]: dispatch 2021-10-08T19:36:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-79"}]: dispatch 2021-10-08T19:36:27.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:36:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:36:27.388 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:27 smithi142 ceph-mon[33432]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:36:27.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:27 smithi112 ceph-mon[40655]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:36:27.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:27 smithi112 ceph-mon[31694]: osdmap e432: 8 total, 8 up, 8 in 2021-10-08T19:36:28.474 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:28.475 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:28 smithi142 ceph-mon[33432]: pgmap v670: 196 pgs: 196 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:36:28.475 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:28 smithi142 ceph-mon[33432]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:36:28.475 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:28.475 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[40655]: pgmap v670: 196 pgs: 196 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:36:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[40655]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:36:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:28.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:28.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[31694]: pgmap v670: 196 pgs: 196 active+clean; 8.4 MiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:36:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[31694]: osdmap e433: 8 total, 8 up, 8 in 2021-10-08T19:36:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:28.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:29.424 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:29.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:29 smithi142 ceph-mon[33432]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:36:29.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:29.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:29.425 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:29.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[40655]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:36:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:29.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:29.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:29.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-81","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:29.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[31694]: osdmap e434: 8 total, 8 up, 8 in 2021-10-08T19:36:29.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:29.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:29.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:30 smithi142 ceph-mon[33432]: pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2021-10-08T19:36:30.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:30.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:30 smithi142 ceph-mon[33432]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:36:30.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:30.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:30 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[40655]: pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2021-10-08T19:36:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[40655]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:36:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:30.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[31694]: pgmap v673: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2021-10-08T19:36:30.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:30.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[31694]: osdmap e435: 8 total, 8 up, 8 in 2021-10-08T19:36:30.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:30.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:30 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:31.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:31.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:31 smithi142 ceph-mon[33432]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:36:31.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:31.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:31.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:31.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:31 smithi112 ceph-mon[40655]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:36:31.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:31.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:31.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:31.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:31 smithi112 ceph-mon[31694]: osdmap e436: 8 total, 8 up, 8 in 2021-10-08T19:36:31.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:31.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:32 smithi142 ceph-mon[33432]: pgmap v676: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:36:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:32 smithi142 ceph-mon[33432]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:36:32.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:32 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:32.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[40655]: pgmap v676: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:36:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:32.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[40655]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:36:32.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:32.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:32.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[31694]: pgmap v676: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:36:32.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:32.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[31694]: osdmap e437: 8 total, 8 up, 8 in 2021-10-08T19:36:32.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:32.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:33.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:33.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:33 smithi112 ceph-mon[40655]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:36:33.520 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:36:33.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:36:33.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:33.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:33 smithi112 ceph-mon[31694]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:36:33.521 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:36:33.522 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:36:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:36:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:33.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:33.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:33 smithi142 ceph-mon[33432]: osdmap e438: 8 total, 8 up, 8 in 2021-10-08T19:36:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:36:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2021-10-08T19:36:33.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:33.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:33.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:33.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:33.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:33.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:36:34.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:34 smithi142 ceph-mon[33432]: pgmap v679: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:34.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2021-10-08T19:36:34.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:34 smithi142 ceph-mon[33432]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:36:34.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:36:34.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:36:34.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:34 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:36:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[40655]: pgmap v679: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2021-10-08T19:36:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[40655]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:36:34.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:36:34.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:36:34.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[31694]: pgmap v679: 228 pgs: 228 active+clean; 8.4 MiB data, 428 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:34.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2021-10-08T19:36:34.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[31694]: osdmap e439: 8 total, 8 up, 8 in 2021-10-08T19:36:34.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:36:34.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2021-10-08T19:36:35.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:35] "GET /metrics HTTP/1.1" 200 157667 "" "Prometheus/2.18.1" 2021-10-08T19:36:35.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2021-10-08T19:36:35.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[31694]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:36:35.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:35.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:35.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:35.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:36:35.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:36:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:35.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2021-10-08T19:36:35.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[40655]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:36:35.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:35.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:35.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:35.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:36:35.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:35 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:36:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2021-10-08T19:36:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:35 smithi142 ceph-mon[33432]: osdmap e440: 8 total, 8 up, 8 in 2021-10-08T19:36:35.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:35.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:35.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:35 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:35.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:35 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:36:35.532 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:35 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:36:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:36.533 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:36 smithi142 ceph-mon[33432]: pgmap v682: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2021-10-08T19:36:36.534 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:36.534 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:36 smithi142 ceph-mon[33432]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:36:36.535 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:36.535 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:36.536 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-81"}]: dispatch 2021-10-08T19:36:36.536 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-81"}]: dispatch 2021-10-08T19:36:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[40655]: pgmap v682: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2021-10-08T19:36:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[40655]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:36:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-81"}]: dispatch 2021-10-08T19:36:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-81"}]: dispatch 2021-10-08T19:36:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[31694]: pgmap v682: 228 pgs: 228 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2021-10-08T19:36:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[31694]: osdmap e441: 8 total, 8 up, 8 in 2021-10-08T19:36:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-81"}]: dispatch 2021-10-08T19:36:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-81"}]: dispatch 2021-10-08T19:36:37.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:36:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:36:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:37 smithi142 ceph-mon[33432]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:36:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:37 smithi112 ceph-mon[40655]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:36:37.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:37 smithi112 ceph-mon[31694]: osdmap e442: 8 total, 8 up, 8 in 2021-10-08T19:36:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:38 smithi142 ceph-mon[33432]: pgmap v685: 196 pgs: 196 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2021-10-08T19:36:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:38 smithi142 ceph-mon[33432]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:36:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:38 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[40655]: pgmap v685: 196 pgs: 196 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2021-10-08T19:36:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[40655]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:36:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:38.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[31694]: pgmap v685: 196 pgs: 196 active+clean; 8.4 MiB data, 430 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 7.0 KiB/s wr, 21 op/s 2021-10-08T19:36:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[31694]: osdmap e443: 8 total, 8 up, 8 in 2021-10-08T19:36:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:39.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:39.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:39 smithi142 ceph-mon[33432]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:36:39.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:39.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:39.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[40655]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:36:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:39.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:39.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-83","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[31694]: osdmap e444: 8 total, 8 up, 8 in 2021-10-08T19:36:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:40 smithi142 ceph-mon[33432]: pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2021-10-08T19:36:40.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:40 smithi142 ceph-mon[33432]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:36:40.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:40.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[40655]: pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2021-10-08T19:36:40.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:40.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[40655]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:36:40.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:40.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:40.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[31694]: pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 18 op/s 2021-10-08T19:36:40.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:40.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[31694]: osdmap e445: 8 total, 8 up, 8 in 2021-10-08T19:36:40.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:40.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:41.252 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:40 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:36:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:41 smithi142 ceph-mon[33432]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:36:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:41 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:41 smithi142 ceph-mon[33432]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:36:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[40655]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:36:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[40655]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:36:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[31694]: osdmap e446: 8 total, 8 up, 8 in 2021-10-08T19:36:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:36:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:41.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:41 smithi112 ceph-mon[31694]: osdmap e447: 8 total, 8 up, 8 in 2021-10-08T19:36:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:42 smithi142 ceph-mon[33432]: pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2021-10-08T19:36:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:42 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:36:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:42 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:36:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:42.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:42 smithi142 ceph-mon[33432]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:36:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[40655]: pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2021-10-08T19:36:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:36:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:36:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:42.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:42.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[40655]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:36:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[31694]: pgmap v691: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 19 op/s 2021-10-08T19:36:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:36:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:36:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:36:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:42.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:42.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:42 smithi112 ceph-mon[31694]: osdmap e448: 8 total, 8 up, 8 in 2021-10-08T19:36:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:36:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:43.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:43.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:43.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:43.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:36:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:44 smithi142 ceph-mon[33432]: pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:44 smithi142 ceph-mon[33432]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:36:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:44 smithi112 ceph-mon[40655]: pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:44 smithi112 ceph-mon[40655]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:36:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:44 smithi112 ceph-mon[31694]: pgmap v694: 228 pgs: 228 active+clean; 8.4 MiB data, 432 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:44 smithi112 ceph-mon[31694]: osdmap e449: 8 total, 8 up, 8 in 2021-10-08T19:36:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:45] "GET /metrics HTTP/1.1" 200 157627 "" "Prometheus/2.18.1" 2021-10-08T19:36:45.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[31694]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:36:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-83"}]: dispatch 2021-10-08T19:36:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-83"}]: dispatch 2021-10-08T19:36:45.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[31694]: pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2021-10-08T19:36:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[40655]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:36:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-83"}]: dispatch 2021-10-08T19:36:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-83"}]: dispatch 2021-10-08T19:36:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:45 smithi112 ceph-mon[40655]: pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2021-10-08T19:36:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:45 smithi142 ceph-mon[33432]: osdmap e450: 8 total, 8 up, 8 in 2021-10-08T19:36:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-83"}]: dispatch 2021-10-08T19:36:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-83"}]: dispatch 2021-10-08T19:36:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:45 smithi142 ceph-mon[33432]: pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2021-10-08T19:36:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:46 smithi112 ceph-mon[40655]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:36:46.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:46 smithi112 ceph-mon[31694]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:36:46.741 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:46 smithi142 ceph-mon[33432]: osdmap e451: 8 total, 8 up, 8 in 2021-10-08T19:36:47.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:36:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:36:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[40655]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:36:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[40655]: pgmap v700: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[31694]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:36:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:47 smithi112 ceph-mon[31694]: pgmap v700: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:47.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:47 smithi142 ceph-mon[33432]: osdmap e452: 8 total, 8 up, 8 in 2021-10-08T19:36:47.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:47.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:47.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:47 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:47.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:47 smithi142 ceph-mon[33432]: pgmap v700: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 433 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:36:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[40655]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:36:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:48.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:48.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[31694]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:36:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:48.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-85","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:48.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:48 smithi142 ceph-mon[33432]: osdmap e453: 8 total, 8 up, 8 in 2021-10-08T19:36:48.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:48.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:48.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[40655]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:36:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[40655]: pgmap v703: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2021-10-08T19:36:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[31694]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:36:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:49.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:49 smithi112 ceph-mon[31694]: pgmap v703: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2021-10-08T19:36:49.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:49.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:49 smithi142 ceph-mon[33432]: osdmap e454: 8 total, 8 up, 8 in 2021-10-08T19:36:49.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:49 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:49.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:49.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:49 smithi142 ceph-mon[33432]: pgmap v703: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2021-10-08T19:36:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:50.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:50 smithi112 ceph-mon[31694]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:36:50.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:50.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:50.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:50.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:50 smithi112 ceph-mon[40655]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:36:50.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:50.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:50.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_tier","val": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:36:50.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:50 smithi142 ceph-mon[33432]: osdmap e455: 8 total, 8 up, 8 in 2021-10-08T19:36:50.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:50.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:36:51.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:51.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:51 smithi142 ceph-mon[33432]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:36:51.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:51.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:51.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:51 smithi142 ceph-mon[33432]: pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2021-10-08T19:36:51.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:51.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[40655]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:36:51.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:51.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:51.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[40655]: pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2021-10-08T19:36:51.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:36:51.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[31694]: osdmap e456: 8 total, 8 up, 8 in 2021-10-08T19:36:51.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:51.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:36:51.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:51 smithi112 ceph-mon[31694]: pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2021-10-08T19:36:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:52 smithi142 ceph-mon[33432]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:36:52.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:52.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:52 smithi112 ceph-mon[40655]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:36:52.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:36:52.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:52 smithi112 ceph-mon[31694]: osdmap e457: 8 total, 8 up, 8 in 2021-10-08T19:36:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:36:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:36:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:53 smithi142 ceph-mon[33432]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:36:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:53 smithi142 ceph-mon[33432]: pgmap v709: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:53.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:53 smithi112 ceph-mon[31694]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:36:53.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:53 smithi112 ceph-mon[31694]: pgmap v709: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:53.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:53 smithi112 ceph-mon[40655]: osdmap e458: 8 total, 8 up, 8 in 2021-10-08T19:36:53.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:53 smithi112 ceph-mon[40655]: pgmap v709: 228 pgs: 228 active+clean; 8.4 MiB data, 434 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:36:53.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:53.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:53.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:36:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:36:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:36:53.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:36:54.354 INFO:tasks.workunit.client.0.smithi112.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (19114 ms) 2021-10-08T19:36:54.354 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2021-10-08T19:36:54.355 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22776 ms) 2021-10-08T19:36:54.355 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2021-10-08T19:36:54.355 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3022 ms) 2021-10-08T19:36:54.356 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2021-10-08T19:36:54.356 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.356 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3012 ms) 2021-10-08T19:36:54.356 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2021-10-08T19:36:54.356 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3034 ms) 2021-10-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2021-10-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3005 ms) 2021-10-08T19:36:54.357 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2021-10-08T19:36:54.358 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.358 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4022 ms) 2021-10-08T19:36:54.358 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2021-10-08T19:36:54.358 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.359 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38483 ms) 2021-10-08T19:36:54.359 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2021-10-08T19:36:54.359 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.359 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16241 ms) 2021-10-08T19:36:54.360 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2021-10-08T19:36:54.360 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.360 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4030 ms) 2021-10-08T19:36:54.360 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2021-10-08T19:36:54.361 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.361 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (2999 ms) 2021-10-08T19:36:54.361 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2021-10-08T19:36:54.361 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.362 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (25077 ms) 2021-10-08T19:36:54.362 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2021-10-08T19:36:54.363 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.363 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15057 ms) 2021-10-08T19:36:54.364 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2021-10-08T19:36:54.364 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.364 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5051 ms) 2021-10-08T19:36:54.365 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2021-10-08T19:36:54.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.366 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4035 ms) 2021-10-08T19:36:54.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2021-10-08T19:36:54.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: waiting for scrubs... 2021-10-08T19:36:54.367 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: done waiting 2021-10-08T19:36:54.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24768 ms) 2021-10-08T19:36:54.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2021-10-08T19:36:54.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10106 ms) 2021-10-08T19:36:54.368 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2021-10-08T19:36:54.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9060 ms) 2021-10-08T19:36:54.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2021-10-08T19:36:54.369 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:36:54.370 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9068 ms) 2021-10-08T19:36:54.645 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:54 smithi142 ceph-mon[33432]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:36:54.645 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:54.645 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:54.646 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-85"}]: dispatch 2021-10-08T19:36:54.646 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-85"}]: dispatch 2021-10-08T19:36:54.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[40655]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:36:54.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:54.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:54.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-85"}]: dispatch 2021-10-08T19:36:54.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-85"}]: dispatch 2021-10-08T19:36:54.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[31694]: osdmap e459: 8 total, 8 up, 8 in 2021-10-08T19:36:54.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:54.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:36:54.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-85"}]: dispatch 2021-10-08T19:36:54.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-85"}]: dispatch 2021-10-08T19:36:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:36:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:36:55] "GET /metrics HTTP/1.1" 200 157660 "" "Prometheus/2.18.1" 2021-10-08T19:36:55.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:55 smithi112 ceph-mon[40655]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:36:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:55 smithi112 ceph-mon[40655]: pgmap v712: 196 pgs: 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:55 smithi112 ceph-mon[31694]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:36:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:55 smithi112 ceph-mon[31694]: pgmap v712: 196 pgs: 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:55 smithi142 ceph-mon[33432]: osdmap e460: 8 total, 8 up, 8 in 2021-10-08T19:36:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:55 smithi142 ceph-mon[33432]: pgmap v712: 196 pgs: 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:56.629 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:56 smithi142 ceph-mon[33432]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:36:56.630 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:56.630 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:56.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:56 smithi112 ceph-mon[40655]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:36:56.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:56.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:56.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:56 smithi112 ceph-mon[31694]: osdmap e461: 8 total, 8 up, 8 in 2021-10-08T19:36:56.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:56.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:36:57.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:36:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:36:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:57 smithi142 ceph-mon[33432]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:36:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:57 smithi142 ceph-mon[33432]: pgmap v715: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:57.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:57.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[40655]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:36:57.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:57.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:57.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[40655]: pgmap v715: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:57.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-87","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:36:57.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[31694]: osdmap e462: 8 total, 8 up, 8 in 2021-10-08T19:36:57.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:36:57.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:36:57.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:57 smithi112 ceph-mon[31694]: pgmap v715: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 436 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2021-10-08T19:36:58.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:58 smithi142 ceph-mon[33432]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:36:58.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:58.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:58.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:58 smithi112 ceph-mon[40655]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:36:58.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:58.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:58.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:58 smithi112 ceph-mon[31694]: osdmap e463: 8 total, 8 up, 8 in 2021-10-08T19:36:58.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:58.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:36:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:59 smithi142 ceph-mon[33432]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:36:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]: dispatch 2021-10-08T19:36:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]: dispatch 2021-10-08T19:36:59.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:36:59 smithi142 ceph-mon[33432]: pgmap v718: 260 pgs: 260 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:36:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[40655]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:36:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]: dispatch 2021-10-08T19:36:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]: dispatch 2021-10-08T19:36:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[40655]: pgmap v718: 260 pgs: 260 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:36:59.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:36:59.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[31694]: osdmap e464: 8 total, 8 up, 8 in 2021-10-08T19:36:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]: dispatch 2021-10-08T19:36:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]: dispatch 2021-10-08T19:36:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:36:59 smithi112 ceph-mon[31694]: pgmap v718: 260 pgs: 260 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:00.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]': finished 2021-10-08T19:37:00.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:00 smithi142 ceph-mon[33432]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:37:00.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:37:00.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:37:00.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]': finished 2021-10-08T19:37:00.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:00 smithi112 ceph-mon[40655]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:37:00.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:37:00.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:37:00.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_tier","val": "test-rados-api-smithi112-83223-89-test-flush"}]': finished 2021-10-08T19:37:00.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:00 smithi112 ceph-mon[31694]: osdmap e465: 8 total, 8 up, 8 in 2021-10-08T19:37:00.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:37:00.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2021-10-08T19:37:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:37:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:01 smithi142 ceph-mon[33432]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:37:01.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:37:01.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:37:01.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:01 smithi142 ceph-mon[33432]: pgmap v721: 260 pgs: 260 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:01.823 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:01 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:37:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:01.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:37:01.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[31694]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:37:01.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:37:01.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:37:01.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[31694]: pgmap v721: 260 pgs: 260 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:01.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2021-10-08T19:37:01.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[40655]: osdmap e466: 8 total, 8 up, 8 in 2021-10-08T19:37:01.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:37:01.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2021-10-08T19:37:01.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:01 smithi112 ceph-mon[40655]: pgmap v721: 260 pgs: 260 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:37:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:37:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:02 smithi142 ceph-mon[33432]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:37:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:02 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:02.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:02 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:02.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:02 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:37:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:02.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:37:02.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[31694]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:37:02.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:02.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:02.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:37:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:02.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2021-10-08T19:37:02.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[40655]: osdmap e467: 8 total, 8 up, 8 in 2021-10-08T19:37:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:02.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:02 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:37:01] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:03.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[40655]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:37:03.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:03.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:03.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-87"}]: dispatch 2021-10-08T19:37:03.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-87"}]: dispatch 2021-10-08T19:37:03.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[40655]: pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:03.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[31694]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:37:03.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:03.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:03.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-87"}]: dispatch 2021-10-08T19:37:03.541 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-87"}]: dispatch 2021-10-08T19:37:03.541 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:03 smithi112 ceph-mon[31694]: pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:03.542 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:37:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:03.542 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:03 smithi142 ceph-mon[33432]: osdmap e468: 8 total, 8 up, 8 in 2021-10-08T19:37:03.542 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:03.543 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:03.543 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-87"}]: dispatch 2021-10-08T19:37:03.544 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-87"}]: dispatch 2021-10-08T19:37:03.545 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:03 smithi142 ceph-mon[33432]: pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 441 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:03.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:03.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:03.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:37:04.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:04 smithi142 ceph-mon[33432]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:37:04.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:04 smithi112 ceph-mon[40655]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:37:04.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:04 smithi112 ceph-mon[31694]: osdmap e469: 8 total, 8 up, 8 in 2021-10-08T19:37:05.429 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:05] "GET /metrics HTTP/1.1" 200 157660 "" "Prometheus/2.18.1" 2021-10-08T19:37:05.430 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:05 smithi112 ceph-mon[40655]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:37:05.430 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:05.430 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:05.430 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:05 smithi112 ceph-mon[40655]: pgmap v727: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:37:05.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:05 smithi142 ceph-mon[33432]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:37:05.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:05.782 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:05.783 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:05 smithi142 ceph-mon[33432]: pgmap v727: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:37:05.820 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:05 smithi112 ceph-mon[31694]: osdmap e470: 8 total, 8 up, 8 in 2021-10-08T19:37:05.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:05.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:05.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:05 smithi112 ceph-mon[31694]: pgmap v727: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:37:06.755 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:06.755 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:06 smithi142 ceph-mon[33432]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:37:06.756 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:06.756 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:37:06.756 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:37:06.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:06.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[40655]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:37:06.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:06.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:37:06.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:37:06.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-90","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:06.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[31694]: osdmap e471: 8 total, 8 up, 8 in 2021-10-08T19:37:06.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:06.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:37:06.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2021-10-08T19:37:07.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:37:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:37:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:37:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:07 smithi142 ceph-mon[33432]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:37:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:07 smithi142 ceph-mon[33432]: pgmap v730: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:37:07.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:07 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:07.827 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:07 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:37:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:07.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:37:07.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[31694]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:37:07.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:07.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[31694]: pgmap v730: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:37:07.828 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:07.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2021-10-08T19:37:07.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[40655]: osdmap e472: 8 total, 8 up, 8 in 2021-10-08T19:37:07.829 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:07.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[40655]: pgmap v730: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:37:07.830 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:07 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:08.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:08 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:37:08.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:08 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:37:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:08.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:08 smithi142 ceph-mon[33432]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:37:08.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:08 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:37:08.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:08 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:37:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:08.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:08 smithi112 ceph-mon[40655]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:37:08.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:08 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:37:08.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:08 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:37:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:08.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:08 smithi112 ceph-mon[31694]: osdmap e473: 8 total, 8 up, 8 in 2021-10-08T19:37:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:09 smithi142 ceph-mon[33432]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:37:09.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:09.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:09.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-90"}]: dispatch 2021-10-08T19:37:09.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-90"}]: dispatch 2021-10-08T19:37:09.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:09 smithi142 ceph-mon[33432]: pgmap v733: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2021-10-08T19:37:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[40655]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:37:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:09.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-90"}]: dispatch 2021-10-08T19:37:09.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-90"}]: dispatch 2021-10-08T19:37:09.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[40655]: pgmap v733: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2021-10-08T19:37:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[31694]: osdmap e474: 8 total, 8 up, 8 in 2021-10-08T19:37:09.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:09.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:09.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-90"}]: dispatch 2021-10-08T19:37:09.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-90"}]: dispatch 2021-10-08T19:37:09.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:09 smithi112 ceph-mon[31694]: pgmap v733: 228 pgs: 228 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2021-10-08T19:37:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:10 smithi142 ceph-mon[33432]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:37:10.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:10 smithi112 ceph-mon[40655]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:37:10.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:10 smithi112 ceph-mon[31694]: osdmap e475: 8 total, 8 up, 8 in 2021-10-08T19:37:11.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:11 smithi142 ceph-mon[33432]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:37:11.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:11.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:11.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:11 smithi142 ceph-mon[33432]: pgmap v736: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:37:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:11 smithi112 ceph-mon[40655]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:37:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:11 smithi112 ceph-mon[40655]: pgmap v736: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:37:11.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:11 smithi112 ceph-mon[31694]: osdmap e476: 8 total, 8 up, 8 in 2021-10-08T19:37:11.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:11.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:11.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:11 smithi112 ceph-mon[31694]: pgmap v736: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-10-08T19:37:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:12 smithi142 ceph-mon[33432]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:37:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:12.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:12 smithi112 ceph-mon[40655]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:37:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:12.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-92","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:12.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:12 smithi112 ceph-mon[31694]: osdmap e477: 8 total, 8 up, 8 in 2021-10-08T19:37:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:13.484 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:37:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:13.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:13 smithi142 ceph-mon[33432]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:37:13.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:13 smithi142 ceph-mon[33432]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:13.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:13 smithi112 ceph-mon[40655]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:37:13.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:13 smithi112 ceph-mon[40655]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:13.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:13.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:13.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:37:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:13 smithi112 ceph-mon[31694]: osdmap e478: 8 total, 8 up, 8 in 2021-10-08T19:37:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:13 smithi112 ceph-mon[31694]: pgmap v739: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 449 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:14 smithi142 ceph-mon[33432]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:37:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-92"}]: dispatch 2021-10-08T19:37:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-92"}]: dispatch 2021-10-08T19:37:14.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[31694]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:37:14.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:14.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:14.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-92"}]: dispatch 2021-10-08T19:37:14.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-92"}]: dispatch 2021-10-08T19:37:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[40655]: osdmap e479: 8 total, 8 up, 8 in 2021-10-08T19:37:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-92"}]: dispatch 2021-10-08T19:37:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-92"}]: dispatch 2021-10-08T19:37:15.499 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:15] "GET /metrics HTTP/1.1" 200 157625 "" "Prometheus/2.18.1" 2021-10-08T19:37:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:15 smithi142 ceph-mon[33432]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:37:15.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:15 smithi142 ceph-mon[33432]: pgmap v742: 196 pgs: 196 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:37:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:15 smithi112 ceph-mon[31694]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:37:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:15 smithi112 ceph-mon[31694]: pgmap v742: 196 pgs: 196 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:37:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:15 smithi112 ceph-mon[40655]: osdmap e480: 8 total, 8 up, 8 in 2021-10-08T19:37:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:15 smithi112 ceph-mon[40655]: pgmap v742: 196 pgs: 196 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:37:16.765 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:16 smithi142 ceph-mon[33432]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:37:16.766 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:16.766 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:16.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:16 smithi112 ceph-mon[40655]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:37:16.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:16.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:16.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:16 smithi112 ceph-mon[31694]: osdmap e481: 8 total, 8 up, 8 in 2021-10-08T19:37:16.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:16.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:17.024 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:37:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:37:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:17 smithi142 ceph-mon[33432]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:37:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:17 smithi142 ceph-mon[33432]: pgmap v745: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:37:17.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:17.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[40655]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:37:17.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:17.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:17.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[40655]: pgmap v745: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:37:17.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-94","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:17.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[31694]: osdmap e482: 8 total, 8 up, 8 in 2021-10-08T19:37:17.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:17.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:17.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:17 smithi112 ceph-mon[31694]: pgmap v745: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-10-08T19:37:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:18 smithi142 ceph-mon[33432]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:37:18.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:18 smithi112 ceph-mon[40655]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:37:18.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:18 smithi112 ceph-mon[31694]: osdmap e483: 8 total, 8 up, 8 in 2021-10-08T19:37:19.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:37:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:19.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:19.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi112 to 3013M 2021-10-08T19:37:19.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: Adjusting osd_memory_target on smithi142 to 3013M 2021-10-08T19:37:19.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:19.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:19.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:19.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[40655]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2021-10-08T19:37:19.829 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:37:19.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:19.830 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:19.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:19.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.831 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.832 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:19.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi112 to 3013M 2021-10-08T19:37:19.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: Adjusting osd_memory_target on smithi142 to 3013M 2021-10-08T19:37:19.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:19.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:19.837 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:19.838 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:19 smithi112 ceph-mon[31694]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2021-10-08T19:37:20.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: osdmap e484: 8 total, 8 up, 8 in 2021-10-08T19:37:20.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:37:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:37:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:37:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-10-08T19:37:20.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi112 to 3013M 2021-10-08T19:37:20.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: Adjusting osd_memory_target on smithi142 to 3013M 2021-10-08T19:37:20.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:20.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:20.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:20.030 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:19 smithi142 ceph-mon[33432]: pgmap v748: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2021-10-08T19:37:22.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:22 smithi142 ceph-mon[33432]: pgmap v749: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2021-10-08T19:37:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:22 smithi112 ceph-mon[40655]: pgmap v749: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2021-10-08T19:37:22.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:22 smithi112 ceph-mon[31694]: pgmap v749: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2021-10-08T19:37:23.362 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:37:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:23.363 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:23.363 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:23.363 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:23.363 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:23.521 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:23.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:23.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:23.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:23.523 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:23.523 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:37:23.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:23.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:37:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:23.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:23.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:23.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:23.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:23.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:37:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:24 smithi142 ceph-mon[33432]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:37:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:24 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:24 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[40655]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:37:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[31694]: pgmap v750: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2021-10-08T19:37:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]: dispatch 2021-10-08T19:37:24.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]: dispatch 2021-10-08T19:37:25.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:25 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]': finished 2021-10-08T19:37:25.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:25 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]': finished 2021-10-08T19:37:25.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:25 smithi142 ceph-mon[33432]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:37:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:25] "GET /metrics HTTP/1.1" 200 157696 "" "Prometheus/2.18.1" 2021-10-08T19:37:25.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:25 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]': finished 2021-10-08T19:37:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:25 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]': finished 2021-10-08T19:37:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:25 smithi112 ceph-mon[40655]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:37:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:25 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.f", "id": [2, 6]}]': finished 2021-10-08T19:37:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:25 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "224.1b", "id": [2, 6]}]': finished 2021-10-08T19:37:25.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:25 smithi112 ceph-mon[31694]: osdmap e485: 8 total, 8 up, 8 in 2021-10-08T19:37:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:26 smithi142 ceph-mon[33432]: pgmap v752: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2021-10-08T19:37:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:26 smithi142 ceph-mon[33432]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:37:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:26 smithi112 ceph-mon[40655]: pgmap v752: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2021-10-08T19:37:26.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:26 smithi112 ceph-mon[40655]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:37:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:26 smithi112 ceph-mon[31694]: pgmap v752: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2021-10-08T19:37:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:26 smithi112 ceph-mon[31694]: osdmap e486: 8 total, 8 up, 8 in 2021-10-08T19:37:27.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:37:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:37:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:28 smithi142 ceph-mon[33432]: pgmap v754: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:37:28.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:28.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:28 smithi112 ceph-mon[40655]: pgmap v754: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:37:28.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:28.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:28 smithi112 ceph-mon[31694]: pgmap v754: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:37:29.259 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:29 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:37:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:30.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:30 smithi142 ceph-mon[33432]: pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:30.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:30 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:30.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:30 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:30.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:30 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:37:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:30.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:30 smithi142 ceph-mon[33432]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:37:30.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[40655]: pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:30.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:30.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:30.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:37:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:30.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[40655]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:37:30.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[31694]: pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:30.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:30.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:30.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:37:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:30.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:29 smithi112 ceph-mon[31694]: osdmap e487: 8 total, 8 up, 8 in 2021-10-08T19:37:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:32 smithi142 ceph-mon[33432]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 762 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:32 smithi112 ceph-mon[40655]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 762 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:32.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:32 smithi112 ceph-mon[31694]: pgmap v757: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 762 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:33.528 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:37:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:33.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:33.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:33.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:37:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:34 smithi142 ceph-mon[33432]: pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:34.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:34 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:37:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:34 smithi112 ceph-mon[40655]: pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:34.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:34 smithi112 ceph-mon[31694]: pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 445 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:35 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:35 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:37:35.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:35 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:37:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:35] "GET /metrics HTTP/1.1" 200 157696 "" "Prometheus/2.18.1" 2021-10-08T19:37:35.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:35 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:35.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:35 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:37:35.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:35 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:37:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:35.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:35 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:35.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:35 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:37:35.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:35 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:37:34] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:36 smithi142 ceph-mon[33432]: pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:36 smithi112 ceph-mon[40655]: pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:36.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:36 smithi112 ceph-mon[31694]: pgmap v759: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2021-10-08T19:37:37.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:37:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:37:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:38 smithi142 ceph-mon[33432]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:37:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:38 smithi112 ceph-mon[40655]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:37:38.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:38.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:38 smithi112 ceph-mon[31694]: pgmap v760: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2021-10-08T19:37:40.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:40 smithi142 ceph-mon[33432]: pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:40.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:40.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:40.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-94"}]: dispatch 2021-10-08T19:37:40.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-94"}]: dispatch 2021-10-08T19:37:40.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:40 smithi142 ceph-mon[33432]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:37:40.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[40655]: pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:40.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:40.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:40.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-94"}]: dispatch 2021-10-08T19:37:40.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-94"}]: dispatch 2021-10-08T19:37:40.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[40655]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:37:40.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[31694]: pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:37:40.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:40.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:40.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-94"}]: dispatch 2021-10-08T19:37:40.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-94"}]: dispatch 2021-10-08T19:37:40.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:40 smithi112 ceph-mon[31694]: osdmap e488: 8 total, 8 up, 8 in 2021-10-08T19:37:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:42 smithi142 ceph-mon[33432]: pgmap v763: 196 pgs: 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 614 B/s rd, 0 op/s 2021-10-08T19:37:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:42 smithi142 ceph-mon[33432]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:37:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:42.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:42 smithi112 ceph-mon[40655]: pgmap v763: 196 pgs: 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 614 B/s rd, 0 op/s 2021-10-08T19:37:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:42 smithi112 ceph-mon[40655]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:37:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:42 smithi112 ceph-mon[31694]: pgmap v763: 196 pgs: 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 614 B/s rd, 0 op/s 2021-10-08T19:37:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:42 smithi112 ceph-mon[31694]: osdmap e489: 8 total, 8 up, 8 in 2021-10-08T19:37:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:43.524 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:37:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:43.525 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:43.525 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:43 smithi112 ceph-mon[40655]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:37:43.525 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:43 smithi142 ceph-mon[33432]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:37:43.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:43.527 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-96","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:43.527 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:43 smithi112 ceph-mon[31694]: osdmap e490: 8 total, 8 up, 8 in 2021-10-08T19:37:43.527 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2021-10-08T19:37:43.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:43.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:43.826 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:43.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:43.826 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:43.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:37:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:44 smithi142 ceph-mon[33432]: pgmap v766: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:44 smithi142 ceph-mon[33432]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:37:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:44 smithi112 ceph-mon[40655]: pgmap v766: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:44 smithi112 ceph-mon[40655]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:37:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:44 smithi112 ceph-mon[31694]: pgmap v766: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 446 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:37:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:44 smithi112 ceph-mon[31694]: osdmap e491: 8 total, 8 up, 8 in 2021-10-08T19:37:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:45] "GET /metrics HTTP/1.1" 200 157705 "" "Prometheus/2.18.1" 2021-10-08T19:37:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:46 smithi142 ceph-mon[33432]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:37:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:46 smithi112 ceph-mon[40655]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:37:46.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:46 smithi112 ceph-mon[31694]: pgmap v768: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2021-10-08T19:37:47.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:37:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:37:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:48 smithi142 ceph-mon[33432]: pgmap v769: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:37:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:48 smithi112 ceph-mon[40655]: pgmap v769: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:37:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:48 smithi112 ceph-mon[31694]: pgmap v769: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:37:50.428 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:50 smithi142 ceph-mon[33432]: pgmap v770: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 795 B/s wr, 2 op/s 2021-10-08T19:37:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:50 smithi112 ceph-mon[40655]: pgmap v770: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 795 B/s wr, 2 op/s 2021-10-08T19:37:50.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:50 smithi112 ceph-mon[31694]: pgmap v770: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 795 B/s wr, 2 op/s 2021-10-08T19:37:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:52 smithi142 ceph-mon[33432]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 705 B/s wr, 2 op/s 2021-10-08T19:37:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:52 smithi112 ceph-mon[40655]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 705 B/s wr, 2 op/s 2021-10-08T19:37:52.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:52 smithi112 ceph-mon[31694]: pgmap v771: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 705 B/s wr, 2 op/s 2021-10-08T19:37:53.521 INFO:journalctl@ceph.osd.0.smithi112.stdout:Oct 08 19:37:53 smithi112 conmon[45343]: 2021-10-08T19:37:53.165+0000 7f0dc7e6e700 -1 snap_mapper.add_oid found existing snaps mapped on 64:4c1994a1:test-rados-api-smithi112-83223-97::foo:31, removing 2021-10-08T19:37:53.522 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:37:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:37:53.523 INFO:journalctl@ceph.osd.5.smithi142.stdout:Oct 08 19:37:53 smithi142 conmon[44867]: 2021-10-08T19:37:53.165+0000 7fe536f91700 -1 snap_mapper.add_oid found existing snaps mapped on 64:4c1994a1:test-rados-api-smithi112-83223-97::foo:31, removing 2021-10-08T19:37:53.523 INFO:journalctl@ceph.osd.6.smithi142.stdout:Oct 08 19:37:53 smithi142 conmon[48464]: 2021-10-08T19:37:53.165+0000 7fbcf164b700 -1 snap_mapper.add_oid found existing snaps mapped on 64:4c1994a1:test-rados-api-smithi112-83223-97::foo:31, removing 2021-10-08T19:37:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:53.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:53.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:53.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:37:53.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:37:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:37:53.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:37:54.416 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[40655]: pgmap v772: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 614 B/s wr, 2 op/s 2021-10-08T19:37:54.417 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:54.417 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:54.417 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-96"}]: dispatch 2021-10-08T19:37:54.418 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-96"}]: dispatch 2021-10-08T19:37:54.419 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[31694]: pgmap v772: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 614 B/s wr, 2 op/s 2021-10-08T19:37:54.419 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:54.419 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:54.419 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-96"}]: dispatch 2021-10-08T19:37:54.420 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-96"}]: dispatch 2021-10-08T19:37:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:54 smithi142 ceph-mon[33432]: pgmap v772: 228 pgs: 228 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 614 B/s wr, 2 op/s 2021-10-08T19:37:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:37:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-96"}]: dispatch 2021-10-08T19:37:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-96"}]: dispatch 2021-10-08T19:37:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:55 smithi142 ceph-mon[33432]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:37:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:55 smithi112 ceph-mon[40655]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:37:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:55 smithi112 ceph-mon[31694]: osdmap e492: 8 total, 8 up, 8 in 2021-10-08T19:37:55.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:37:55] "GET /metrics HTTP/1.1" 200 157700 "" "Prometheus/2.18.1" 2021-10-08T19:37:56.450 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[40655]: pgmap v774: 196 pgs: 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2021-10-08T19:37:56.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[40655]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:37:56.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:56.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:56.451 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:56.452 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[31694]: pgmap v774: 196 pgs: 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2021-10-08T19:37:56.452 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[31694]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:37:56.452 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:56.453 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:56.453 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:56 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:56.453 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:37:56 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:56.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:56 smithi142 ceph-mon[33432]: pgmap v774: 196 pgs: 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2021-10-08T19:37:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:56 smithi142 ceph-mon[33432]: osdmap e493: 8 total, 8 up, 8 in 2021-10-08T19:37:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:37:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:56 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:37:57.191 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:37:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:37:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:57 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:57 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:57 smithi142 ceph-mon[33432]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:37:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[40655]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:37:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:37:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:37:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:37:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-98","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:37:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[31694]: osdmap e494: 8 total, 8 up, 8 in 2021-10-08T19:37:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:57.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:37:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:58 smithi142 ceph-mon[33432]: pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:37:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:37:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:58 smithi142 ceph-mon[33432]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:37:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[40655]: pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:37:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:37:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[40655]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:37:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:37:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[31694]: pgmap v777: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 447 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:37:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:37:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[31694]: osdmap e495: 8 total, 8 up, 8 in 2021-10-08T19:37:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:58.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]: dispatch 2021-10-08T19:37:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:59 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]': finished 2021-10-08T19:37:59.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:59 smithi142 ceph-mon[33432]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:37:59.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:37:59.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:37:59.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]': finished 2021-10-08T19:37:59.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:37:59 smithi142 ceph-mon[33432]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:37:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:59.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]': finished 2021-10-08T19:37:59.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[31694]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:37:59.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:37:59.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:37:59.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]': finished 2021-10-08T19:37:59.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[31694]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:37:59.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:37:59.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-98", "mode": "writeback"}]': finished 2021-10-08T19:37:59.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[40655]: osdmap e496: 8 total, 8 up, 8 in 2021-10-08T19:37:59.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:37:59.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:37:59.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-98"}]': finished 2021-10-08T19:37:59.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:37:59 smithi112 ceph-mon[40655]: osdmap e497: 8 total, 8 up, 8 in 2021-10-08T19:38:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:00 smithi142 ceph-mon[33432]: pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:38:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:38:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:00 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:00 smithi112 ceph-mon[40655]: pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:38:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:38:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:00 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:00 smithi112 ceph-mon[31694]: pgmap v780: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:38:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:38:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:00 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:01.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:00 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:38:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:38:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:01 smithi142 ceph-mon[33432]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:38:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:38:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:38:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:01 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:01.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:38:01.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[31694]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:38:01.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:38:01.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:38:01.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:38:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[40655]: osdmap e498: 8 total, 8 up, 8 in 2021-10-08T19:38:01.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:38:01.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]: dispatch 2021-10-08T19:38:01.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:01 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:02 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:02 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:38:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:02 smithi142 ceph-mon[33432]: pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]': finished 2021-10-08T19:38:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:02 smithi142 ceph-mon[33432]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:38:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:02.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:02.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:02.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:38:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:02.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[40655]: pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:02.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]': finished 2021-10-08T19:38:02.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[40655]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:38:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:02.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:02.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:38:00] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:02.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[31694]: pgmap v783: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:38:02.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_count","val": "1"}]': finished 2021-10-08T19:38:02.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[31694]: osdmap e499: 8 total, 8 up, 8 in 2021-10-08T19:38:02.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:02.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:03.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:03.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:03 smithi112 ceph-mon[40655]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:38:03.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:38:03.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:38:03.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:03.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:03 smithi112 ceph-mon[31694]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:38:03.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:38:03.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:38:03.525 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:38:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:03 smithi142 ceph-mon[33432]: osdmap e500: 8 total, 8 up, 8 in 2021-10-08T19:38:03.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:38:03.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]: dispatch 2021-10-08T19:38:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:03.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:03.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:03.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:03.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:38:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:04 smithi142 ceph-mon[33432]: pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]': finished 2021-10-08T19:38:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:04 smithi142 ceph-mon[33432]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:38:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[40655]: pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]': finished 2021-10-08T19:38:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[40655]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:38:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[31694]: pgmap v786: 228 pgs: 228 active+clean; 8.4 MiB data, 453 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-98","var": "target_max_objects","val": "250"}]': finished 2021-10-08T19:38:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[31694]: osdmap e501: 8 total, 8 up, 8 in 2021-10-08T19:38:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:04.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:05.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:38:05.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:05 smithi142 ceph-mon[33432]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:38:05.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:38:05.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:38:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:05] "GET /metrics HTTP/1.1" 200 157700 "" "Prometheus/2.18.1" 2021-10-08T19:38:05.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:38:05.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:05 smithi112 ceph-mon[31694]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:38:05.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:38:05.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:38:05.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:38:05.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:05 smithi112 ceph-mon[40655]: osdmap e502: 8 total, 8 up, 8 in 2021-10-08T19:38:05.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:38:05.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]: dispatch 2021-10-08T19:38:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:06 smithi142 ceph-mon[33432]: pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]': finished 2021-10-08T19:38:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:06 smithi142 ceph-mon[33432]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:38:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:06 smithi112 ceph-mon[40655]: pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]': finished 2021-10-08T19:38:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:06 smithi112 ceph-mon[40655]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:38:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:06 smithi112 ceph-mon[31694]: pgmap v789: 228 pgs: 228 active+clean; 8.4 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-98"}]': finished 2021-10-08T19:38:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:06 smithi112 ceph-mon[31694]: osdmap e503: 8 total, 8 up, 8 in 2021-10-08T19:38:07.264 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:38:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:38:07.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:07 smithi142 ceph-mon[33432]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:38:07.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:07 smithi112 ceph-mon[40655]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:38:07.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:07 smithi112 ceph-mon[31694]: osdmap e504: 8 total, 8 up, 8 in 2021-10-08T19:38:08.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[31694]: pgmap v792: 196 pgs: 196 active+clean; 8.4 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[31694]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:38:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[40655]: pgmap v792: 196 pgs: 196 active+clean; 8.4 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[40655]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:38:08.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:08.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:08.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:08 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:08.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:08 smithi142 ceph-mon[33432]: pgmap v792: 196 pgs: 196 active+clean; 8.4 MiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:08.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:08 smithi142 ceph-mon[33432]: osdmap e505: 8 total, 8 up, 8 in 2021-10-08T19:38:08.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:08.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:09 smithi112 ceph-mon[40655]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:38:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:09.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:09.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:09 smithi112 ceph-mon[31694]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:38:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-100","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:09 smithi142 ceph-mon[33432]: osdmap e506: 8 total, 8 up, 8 in 2021-10-08T19:38:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:38:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[40655]: pgmap v795: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[40655]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:38:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[31694]: pgmap v795: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[31694]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:38:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:10.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:10 smithi142 ceph-mon[33432]: pgmap v795: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:38:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:10 smithi142 ceph-mon[33432]: osdmap e507: 8 total, 8 up, 8 in 2021-10-08T19:38:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:11.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]': finished 2021-10-08T19:38:11.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[31694]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:38:11.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]: dispatch 2021-10-08T19:38:11.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]: dispatch 2021-10-08T19:38:11.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[31694]: pgmap v798: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:11.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]': finished 2021-10-08T19:38:11.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[40655]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:38:11.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]: dispatch 2021-10-08T19:38:11.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]: dispatch 2021-10-08T19:38:11.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:11 smithi112 ceph-mon[40655]: pgmap v798: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-6", "overlaypool": "test-rados-api-smithi112-83223-100"}]': finished 2021-10-08T19:38:11.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:11 smithi142 ceph-mon[33432]: osdmap e508: 8 total, 8 up, 8 in 2021-10-08T19:38:11.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]: dispatch 2021-10-08T19:38:11.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]: dispatch 2021-10-08T19:38:11.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:11 smithi142 ceph-mon[33432]: pgmap v798: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:12.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:12.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]': finished 2021-10-08T19:38:12.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[31694]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:38:12.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:12.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:12.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:12.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]': finished 2021-10-08T19:38:12.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[40655]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:38:12.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:12.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:12 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-100", "mode": "writeback"}]': finished 2021-10-08T19:38:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:12 smithi142 ceph-mon[33432]: osdmap e509: 8 total, 8 up, 8 in 2021-10-08T19:38:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:12.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:38:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:38:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:13 smithi142 ceph-mon[33432]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:38:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:13 smithi142 ceph-mon[33432]: pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:13.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:13.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:13.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:13.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:13.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:13.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:38:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:38:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[31694]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:38:13.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:13.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:13.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[31694]: pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:13.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:38:13.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[40655]: osdmap e510: 8 total, 8 up, 8 in 2021-10-08T19:38:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:13.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:13.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:13 smithi112 ceph-mon[40655]: pgmap v801: 228 pgs: 228 active+clean; 8.4 MiB data, 459 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:14.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:14.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:14 smithi112 ceph-mon[40655]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:38:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:14.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:14.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:14.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:14 smithi112 ceph-mon[31694]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:38:14.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:14.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:14 smithi142 ceph-mon[33432]: osdmap e511: 8 total, 8 up, 8 in 2021-10-08T19:38:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:15.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:15] "GET /metrics HTTP/1.1" 200 157636 "" "Prometheus/2.18.1" 2021-10-08T19:38:15.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:15.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:38:15.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[31694]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:38:15.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:38:15.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:38:15.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[31694]: pgmap v804: 228 pgs: 228 active+clean; 8.4 MiB data, 460 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:15.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:15.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:38:15.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[40655]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:38:15.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:38:15.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:38:15.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:15 smithi112 ceph-mon[40655]: pgmap v804: 228 pgs: 228 active+clean; 8.4 MiB data, 460 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:15 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:38:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:15 smithi142 ceph-mon[33432]: osdmap e512: 8 total, 8 up, 8 in 2021-10-08T19:38:15.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:38:15.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2021-10-08T19:38:15.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:15 smithi142 ceph-mon[33432]: pgmap v804: 228 pgs: 228 active+clean; 8.4 MiB data, 460 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:16.666 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2021-10-08T19:38:16.666 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:16 smithi142 ceph-mon[33432]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:38:16.666 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:16.667 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:16.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2021-10-08T19:38:16.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:16 smithi112 ceph-mon[40655]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:38:16.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:16.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:16.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2021-10-08T19:38:16.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:16 smithi112 ceph-mon[31694]: osdmap e513: 8 total, 8 up, 8 in 2021-10-08T19:38:16.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:16.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]: dispatch 2021-10-08T19:38:17.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:38:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:38:17.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:38:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:17 smithi142 ceph-mon[33432]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:38:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:17 smithi142 ceph-mon[33432]: pgmap v807: 228 pgs: 228 active+clean; 8.4 MiB data, 460 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:17.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:38:17.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[40655]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:38:17.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:17.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:17.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:17.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[40655]: pgmap v807: 228 pgs: 228 active+clean; 8.4 MiB data, 460 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-6"}]': finished 2021-10-08T19:38:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[31694]: osdmap e514: 8 total, 8 up, 8 in 2021-10-08T19:38:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2446817837' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]: dispatch 2021-10-08T19:38:17.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:17.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:17 smithi112 ceph-mon[31694]: pgmap v807: 228 pgs: 228 active+clean; 8.4 MiB data, 460 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:18.629 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]': finished 2021-10-08T19:38:18.629 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:18 smithi142 ceph-mon[33432]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:38:18.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]': finished 2021-10-08T19:38:18.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:18 smithi112 ceph-mon[40655]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:38:18.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-6", "tierpool": "test-rados-api-smithi112-83223-100"}]': finished 2021-10-08T19:38:18.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:18 smithi112 ceph-mon[31694]: osdmap e515: 8 total, 8 up, 8 in 2021-10-08T19:38:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:19 smithi142 ceph-mon[33432]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:38:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:19 smithi142 ceph-mon[33432]: pgmap v810: 196 pgs: 196 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:19 smithi142 ceph-mon[33432]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:38:19.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[40655]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:38:19.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:19.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[40655]: pgmap v810: 196 pgs: 196 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[40655]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:38:19.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[31694]: osdmap e516: 8 total, 8 up, 8 in 2021-10-08T19:38:19.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:38:19.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:38:19.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:38:19.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:19.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[31694]: pgmap v810: 196 pgs: 196 active+clean; 8.4 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:19.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:19 smithi112 ceph-mon[31694]: osdmap e517: 8 total, 8 up, 8 in 2021-10-08T19:38:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:20.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:20.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:20.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:20.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:20.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:21.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:21 smithi142 ceph-mon[33432]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:38:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:21.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:21 smithi142 ceph-mon[33432]: pgmap v813: 164 pgs: 164 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[40655]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:38:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:21.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:21.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[40655]: pgmap v813: 164 pgs: 164 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:21.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-102", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:21.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[31694]: osdmap e518: 8 total, 8 up, 8 in 2021-10-08T19:38:21.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:21.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:21.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:21 smithi112 ceph-mon[31694]: pgmap v813: 164 pgs: 164 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:22.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:22 smithi142 ceph-mon[33432]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:38:22.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:22 smithi112 ceph-mon[40655]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:38:22.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:22 smithi112 ceph-mon[31694]: osdmap e519: 8 total, 8 up, 8 in 2021-10-08T19:38:23.522 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:23.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[40655]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:38:23.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:23.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:23.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:23.524 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:23.524 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[40655]: pgmap v816: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:23.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:23.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[31694]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:38:23.525 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:23.525 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:23.526 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:23.526 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:23.526 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:23 smithi112 ceph-mon[31694]: pgmap v816: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:23.527 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:38:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:23.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-102", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:23.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:23 smithi142 ceph-mon[33432]: osdmap e520: 8 total, 8 up, 8 in 2021-10-08T19:38:23.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:23.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:38:23.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:23.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:38:23.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:23 smithi142 ceph-mon[33432]: pgmap v816: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 462 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:23.821 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:23 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:23.924 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:23.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:23.925 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:23.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:23.925 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:23.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:38:24.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:24 smithi142 ceph-mon[33432]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:38:24.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:24.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:24 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:38:24.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:24 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:24.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:24 smithi112 ceph-mon[40655]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:38:24.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:24.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:24 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:38:24.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:24 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:24.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:24 smithi112 ceph-mon[31694]: osdmap e521: 8 total, 8 up, 8 in 2021-10-08T19:38:24.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:24.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:24 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:38:24.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:24 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:38:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:25] "GET /metrics HTTP/1.1" 200 156483 "" "Prometheus/2.18.1" 2021-10-08T19:38:26.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:25 smithi142 ceph-mon[33432]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:38:26.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:26.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:26.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:25 smithi142 ceph-mon[33432]: pgmap v819: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 438 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:26.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:25 smithi112 ceph-mon[40655]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:38:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:26.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:26.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:25 smithi112 ceph-mon[40655]: pgmap v819: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 438 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:26.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:25 smithi112 ceph-mon[31694]: osdmap e522: 8 total, 8 up, 8 in 2021-10-08T19:38:26.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:26.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:26.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:25 smithi112 ceph-mon[31694]: pgmap v819: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 438 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:27.007 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:27.008 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[40655]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:38:27.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:27.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[40655]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:38:27.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:27.009 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:27.010 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:27.010 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[31694]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:38:27.010 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:27.011 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[31694]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:38:27.011 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:27.011 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:27.026 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:38:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:38:27.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:27.027 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:26 smithi142 ceph-mon[33432]: osdmap e523: 8 total, 8 up, 8 in 2021-10-08T19:38:27.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:26 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:27.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:26 smithi142 ceph-mon[33432]: osdmap e524: 8 total, 8 up, 8 in 2021-10-08T19:38:27.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:27.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:27.664 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:27 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:38:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:27.665 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:27.666 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[31694]: pgmap v822: 236 pgs: 64 unknown, 172 active+clean; 582 KiB data, 438 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:27.666 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:27.666 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[31694]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:38:27.667 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:27.667 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:27.667 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:28.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:27 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:27 smithi142 ceph-mon[33432]: pgmap v822: 236 pgs: 64 unknown, 172 active+clean; 582 KiB data, 438 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:27 smithi142 ceph-mon[33432]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:38:28.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:28.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:27 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:28.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:28.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:28.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[40655]: pgmap v822: 236 pgs: 64 unknown, 172 active+clean; 582 KiB data, 438 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:38:28.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-105-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:28.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[40655]: osdmap e525: 8 total, 8 up, 8 in 2021-10-08T19:38:28.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:28.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:28.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:29.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:28 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:29.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:28 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:38:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:29.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:29.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:28 smithi142 ceph-mon[33432]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:38:29.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:29.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:29.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:29.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:38:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:29.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[40655]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:38:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:29.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:29.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:29.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:38:27] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:29.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:29.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[31694]: osdmap e526: 8 total, 8 up, 8 in 2021-10-08T19:38:29.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:29.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:30.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:29 smithi142 ceph-mon[33432]: pgmap v825: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:30.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:30.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:29 smithi142 ceph-mon[33432]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:38:30.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:29 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:30.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:30.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[31694]: pgmap v825: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:30.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:30.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[31694]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:38:30.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:30.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:30.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[40655]: pgmap v825: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:30.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-105", "overlaypool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:30.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[40655]: osdmap e527: 8 total, 8 up, 8 in 2021-10-08T19:38:30.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:30.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:31.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:31 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:31.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]': finished 2021-10-08T19:38:31.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:31 smithi142 ceph-mon[33432]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:38:31.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]: dispatch 2021-10-08T19:38:31.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]: dispatch 2021-10-08T19:38:31.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:31.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]': finished 2021-10-08T19:38:31.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[40655]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:38:31.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]: dispatch 2021-10-08T19:38:31.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]: dispatch 2021-10-08T19:38:31.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:31.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-105-cache", "mode": "writeback"}]': finished 2021-10-08T19:38:31.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[31694]: osdmap e528: 8 total, 8 up, 8 in 2021-10-08T19:38:31.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]: dispatch 2021-10-08T19:38:31.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]: dispatch 2021-10-08T19:38:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:32 smithi142 ceph-mon[33432]: pgmap v828: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]': finished 2021-10-08T19:38:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:32 smithi142 ceph-mon[33432]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:38:32.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:32 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:32.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[40655]: pgmap v828: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]': finished 2021-10-08T19:38:32.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[40655]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:38:32.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:32.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:32.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[31694]: pgmap v828: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:32.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-105"}]': finished 2021-10-08T19:38:32.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[31694]: osdmap e529: 8 total, 8 up, 8 in 2021-10-08T19:38:32.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2608020587' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:32.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]: dispatch 2021-10-08T19:38:33.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:33 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:33.523 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:33.524 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:33 smithi112 ceph-mon[40655]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:38:33.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:33 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:33.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:33.524 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:33 smithi112 ceph-mon[31694]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:38:33.525 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:38:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:33.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:33 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:33.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-105", "tierpool": "test-rados-api-smithi112-83223-105-cache"}]': finished 2021-10-08T19:38:33.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:33 smithi142 ceph-mon[33432]: osdmap e530: 8 total, 8 up, 8 in 2021-10-08T19:38:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:33.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:33.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:33.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:38:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:34 smithi142 ceph-mon[33432]: pgmap v831: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:34 smithi142 ceph-mon[33432]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:38:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:34 smithi112 ceph-mon[40655]: pgmap v831: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:34 smithi112 ceph-mon[40655]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:38:34.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:34 smithi112 ceph-mon[31694]: pgmap v831: 236 pgs: 236 active+clean; 582 KiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:34.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:34 smithi112 ceph-mon[31694]: osdmap e531: 8 total, 8 up, 8 in 2021-10-08T19:38:35.429 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:35] "GET /metrics HTTP/1.1" 200 156483 "" "Prometheus/2.18.1" 2021-10-08T19:38:35.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:35 smithi142 ceph-mon[33432]: osdmap e532: 8 total, 8 up, 8 in 2021-10-08T19:38:35.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:35.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:35.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:35 smithi142 ceph-mon[33432]: pgmap v834: 172 pgs: 172 active+clean; 582 KiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:35.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[31694]: osdmap e532: 8 total, 8 up, 8 in 2021-10-08T19:38:35.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:35.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:35.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[31694]: pgmap v834: 172 pgs: 172 active+clean; 582 KiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:35.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[40655]: osdmap e532: 8 total, 8 up, 8 in 2021-10-08T19:38:35.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:35.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:35.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:35.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:35 smithi112 ceph-mon[40655]: pgmap v834: 172 pgs: 172 active+clean; 582 KiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:37.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:38:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:38:37.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:37.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:36 smithi142 ceph-mon[33432]: osdmap e533: 8 total, 8 up, 8 in 2021-10-08T19:38:37.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:37.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:37.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:37.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:36 smithi112 ceph-mon[31694]: osdmap e533: 8 total, 8 up, 8 in 2021-10-08T19:38:37.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:37.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:37.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-107", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:37.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:36 smithi112 ceph-mon[40655]: osdmap e533: 8 total, 8 up, 8 in 2021-10-08T19:38:37.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:37.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:38.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:37 smithi142 ceph-mon[33432]: osdmap e534: 8 total, 8 up, 8 in 2021-10-08T19:38:38.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:37 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:38.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:37 smithi142 ceph-mon[33432]: pgmap v837: 172 pgs: 172 active+clean; 582 KiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:38.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:38.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:37 smithi142 ceph-mon[33432]: osdmap e535: 8 total, 8 up, 8 in 2021-10-08T19:38:38.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[40655]: osdmap e534: 8 total, 8 up, 8 in 2021-10-08T19:38:38.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:38.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[40655]: pgmap v837: 172 pgs: 172 active+clean; 582 KiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:38.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:38.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[40655]: osdmap e535: 8 total, 8 up, 8 in 2021-10-08T19:38:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[31694]: osdmap e534: 8 total, 8 up, 8 in 2021-10-08T19:38:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[31694]: pgmap v837: 172 pgs: 172 active+clean; 582 KiB data, 449 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-107", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:38.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:37 smithi112 ceph-mon[31694]: osdmap e535: 8 total, 8 up, 8 in 2021-10-08T19:38:39.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:39 smithi142 ceph-mon[33432]: osdmap e536: 8 total, 8 up, 8 in 2021-10-08T19:38:39.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:39.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:39.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:39 smithi142 ceph-mon[33432]: pgmap v840: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:39.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:39 smithi112 ceph-mon[31694]: osdmap e536: 8 total, 8 up, 8 in 2021-10-08T19:38:39.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:39.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:39.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:39 smithi112 ceph-mon[31694]: pgmap v840: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:39.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:39 smithi112 ceph-mon[40655]: osdmap e536: 8 total, 8 up, 8 in 2021-10-08T19:38:39.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:39.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:38:39.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:39 smithi112 ceph-mon[40655]: pgmap v840: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:40.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:40.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:40 smithi142 ceph-mon[33432]: osdmap e537: 8 total, 8 up, 8 in 2021-10-08T19:38:40.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:40.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:40.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:40.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:40 smithi112 ceph-mon[40655]: osdmap e537: 8 total, 8 up, 8 in 2021-10-08T19:38:40.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:40.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:40.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:38:40.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:40 smithi112 ceph-mon[31694]: osdmap e537: 8 total, 8 up, 8 in 2021-10-08T19:38:40.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:40.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:41.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:41.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:41 smithi142 ceph-mon[33432]: osdmap e538: 8 total, 8 up, 8 in 2021-10-08T19:38:41.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:41.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:41.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:41 smithi142 ceph-mon[33432]: pgmap v843: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:41.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:41.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[31694]: osdmap e538: 8 total, 8 up, 8 in 2021-10-08T19:38:41.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:41.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:41.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[31694]: pgmap v843: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:41.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:41.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[40655]: osdmap e538: 8 total, 8 up, 8 in 2021-10-08T19:38:41.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:41.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:41.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:41 smithi112 ceph-mon[40655]: pgmap v843: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:42.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:42.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:42 smithi142 ceph-mon[33432]: osdmap e539: 8 total, 8 up, 8 in 2021-10-08T19:38:42.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:42.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:42.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:42.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:42 smithi112 ceph-mon[31694]: osdmap e539: 8 total, 8 up, 8 in 2021-10-08T19:38:42.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:42.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:42.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-107", "overlaypool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:42.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:42 smithi112 ceph-mon[40655]: osdmap e539: 8 total, 8 up, 8 in 2021-10-08T19:38:42.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:42.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]: dispatch 2021-10-08T19:38:43.461 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:38:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:43 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]': finished 2021-10-08T19:38:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:43 smithi142 ceph-mon[33432]: osdmap e540: 8 total, 8 up, 8 in 2021-10-08T19:38:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:43.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:43.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:43 smithi142 ceph-mon[33432]: pgmap v846: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:43.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:43.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:43.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:38:43.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:43.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]': finished 2021-10-08T19:38:43.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[31694]: osdmap e540: 8 total, 8 up, 8 in 2021-10-08T19:38:43.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:43.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:43.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[31694]: pgmap v846: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:43.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:38:43.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-107-cache", "mode": "writeback"}]': finished 2021-10-08T19:38:43.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[40655]: osdmap e540: 8 total, 8 up, 8 in 2021-10-08T19:38:43.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:43.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:38:43.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:43 smithi112 ceph-mon[40655]: pgmap v846: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 450 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:38:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:44 smithi142 ceph-mon[33432]: osdmap e541: 8 total, 8 up, 8 in 2021-10-08T19:38:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:44.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:38:44.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:44 smithi112 ceph-mon[40655]: osdmap e541: 8 total, 8 up, 8 in 2021-10-08T19:38:44.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:44.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:44.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:38:44.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:44 smithi112 ceph-mon[31694]: osdmap e541: 8 total, 8 up, 8 in 2021-10-08T19:38:44.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:44.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:38:45.490 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:45] "GET /metrics HTTP/1.1" 200 157598 "" "Prometheus/2.18.1" 2021-10-08T19:38:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:45.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:45 smithi142 ceph-mon[33432]: osdmap e542: 8 total, 8 up, 8 in 2021-10-08T19:38:45.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:45.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:45.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:45 smithi142 ceph-mon[33432]: pgmap v849: 212 pgs: 212 active+clean; 582 KiB data, 452 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:45.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:45.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[40655]: osdmap e542: 8 total, 8 up, 8 in 2021-10-08T19:38:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:45.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[40655]: pgmap v849: 212 pgs: 212 active+clean; 582 KiB data, 452 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:45.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:38:45.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[31694]: osdmap e542: 8 total, 8 up, 8 in 2021-10-08T19:38:45.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:45.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:38:45.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:45 smithi112 ceph-mon[31694]: pgmap v849: 212 pgs: 212 active+clean; 582 KiB data, 452 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:46 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:38:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:46 smithi142 ceph-mon[33432]: osdmap e543: 8 total, 8 up, 8 in 2021-10-08T19:38:46.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:46 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:38:46.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:38:46.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:46.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:38:46.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[40655]: osdmap e543: 8 total, 8 up, 8 in 2021-10-08T19:38:46.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:38:46.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:38:46.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:38:46.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:38:46.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[31694]: osdmap e543: 8 total, 8 up, 8 in 2021-10-08T19:38:46.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:38:46.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2021-10-08T19:38:47.275 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:38:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:38:47.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2021-10-08T19:38:47.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:47 smithi142 ceph-mon[33432]: osdmap e544: 8 total, 8 up, 8 in 2021-10-08T19:38:47.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:47.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:47.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:47 smithi142 ceph-mon[33432]: pgmap v852: 212 pgs: 212 active+clean; 582 KiB data, 452 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:47.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:47 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:47.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2021-10-08T19:38:47.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[40655]: osdmap e544: 8 total, 8 up, 8 in 2021-10-08T19:38:47.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:47.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:47.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[40655]: pgmap v852: 212 pgs: 212 active+clean; 582 KiB data, 452 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:47.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:47.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-107-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2021-10-08T19:38:47.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[31694]: osdmap e544: 8 total, 8 up, 8 in 2021-10-08T19:38:47.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:47.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:47.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[31694]: pgmap v852: 212 pgs: 212 active+clean; 582 KiB data, 452 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:47.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:47 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:48.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:48.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:48 smithi142 ceph-mon[33432]: osdmap e545: 8 total, 8 up, 8 in 2021-10-08T19:38:48.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:48.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:48.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:48.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:48 smithi112 ceph-mon[40655]: osdmap e545: 8 total, 8 up, 8 in 2021-10-08T19:38:48.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:48.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:48.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:48.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:48 smithi112 ceph-mon[31694]: osdmap e545: 8 total, 8 up, 8 in 2021-10-08T19:38:48.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:48.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]: dispatch 2021-10-08T19:38:49.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:49.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:49 smithi112 ceph-mon[40655]: osdmap e546: 8 total, 8 up, 8 in 2021-10-08T19:38:49.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:49 smithi112 ceph-mon[40655]: pgmap v855: 212 pgs: 212 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:38:49.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:49.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:49 smithi112 ceph-mon[31694]: osdmap e546: 8 total, 8 up, 8 in 2021-10-08T19:38:49.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:49 smithi112 ceph-mon[31694]: pgmap v855: 212 pgs: 212 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:38:50.022 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-107", "tierpool": "test-rados-api-smithi112-83223-107-cache"}]': finished 2021-10-08T19:38:50.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:49 smithi142 ceph-mon[33432]: osdmap e546: 8 total, 8 up, 8 in 2021-10-08T19:38:50.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:49 smithi142 ceph-mon[33432]: pgmap v855: 212 pgs: 212 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-10-08T19:38:50.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:50 smithi112 ceph-mon[31694]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:50.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:50 smithi112 ceph-mon[31694]: osdmap e547: 8 total, 8 up, 8 in 2021-10-08T19:38:50.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:50 smithi112 ceph-mon[40655]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:50.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:50 smithi112 ceph-mon[40655]: osdmap e547: 8 total, 8 up, 8 in 2021-10-08T19:38:51.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:50 smithi142 ceph-mon[33432]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:51.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:50 smithi142 ceph-mon[33432]: osdmap e547: 8 total, 8 up, 8 in 2021-10-08T19:38:51.537 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:51 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:38:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:51.537 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[31694]: osdmap e548: 8 total, 8 up, 8 in 2021-10-08T19:38:51.538 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:51.538 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:51.538 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[31694]: pgmap v858: 172 pgs: 172 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:51.538 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:51.539 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:38:51.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:38:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:51.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[40655]: osdmap e548: 8 total, 8 up, 8 in 2021-10-08T19:38:51.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:51.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:51.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[40655]: pgmap v858: 172 pgs: 172 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:51.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:51.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:38:51.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:51 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:38:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:52.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:51 smithi142 ceph-mon[33432]: osdmap e548: 8 total, 8 up, 8 in 2021-10-08T19:38:52.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:52.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:52.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:51 smithi142 ceph-mon[33432]: pgmap v858: 172 pgs: 172 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:38:52.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:51 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:52.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:51 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:38:52.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:51 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:38:51] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:52.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:52.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:52 smithi112 ceph-mon[40655]: osdmap e549: 8 total, 8 up, 8 in 2021-10-08T19:38:52.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:52.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:52.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:52.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:52 smithi112 ceph-mon[31694]: osdmap e549: 8 total, 8 up, 8 in 2021-10-08T19:38:52.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:52.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:53.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:53.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:52 smithi142 ceph-mon[33432]: osdmap e549: 8 total, 8 up, 8 in 2021-10-08T19:38:53.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2196387352' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:53.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]: dispatch 2021-10-08T19:38:53.525 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:38:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:38:53.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:53.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:53 smithi112 ceph-mon[40655]: osdmap e550: 8 total, 8 up, 8 in 2021-10-08T19:38:53.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:53 smithi112 ceph-mon[40655]: pgmap v861: 172 pgs: 172 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:53.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:53.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:53 smithi112 ceph-mon[31694]: osdmap e550: 8 total, 8 up, 8 in 2021-10-08T19:38:53.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:53 smithi112 ceph-mon[31694]: pgmap v861: 172 pgs: 172 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:53.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:53.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:38:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:38:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:38:53.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:38:54.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-107"}]': finished 2021-10-08T19:38:54.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:53 smithi142 ceph-mon[33432]: osdmap e550: 8 total, 8 up, 8 in 2021-10-08T19:38:54.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:53 smithi142 ceph-mon[33432]: pgmap v861: 172 pgs: 172 active+clean; 582 KiB data, 453 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:38:54.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:54 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:38:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:54.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[40655]: osdmap e551: 8 total, 8 up, 8 in 2021-10-08T19:38:54.831 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:54.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:54.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:54.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:54.832 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:38:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:54.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[31694]: osdmap e551: 8 total, 8 up, 8 in 2021-10-08T19:38:54.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:54.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:54.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:54.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:54.835 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:54 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:38:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:55.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:54 smithi142 ceph-mon[33432]: osdmap e551: 8 total, 8 up, 8 in 2021-10-08T19:38:55.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:55.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:55.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:54 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:38:55.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:54 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:38:55.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:54 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:38:54] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:38:55.568 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:38:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:38:55] "GET /metrics HTTP/1.1" 200 156519 "" "Prometheus/2.18.1" 2021-10-08T19:38:55.569 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:55.569 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[31694]: osdmap e552: 8 total, 8 up, 8 in 2021-10-08T19:38:55.569 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:55.569 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:55.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[31694]: pgmap v864: 164 pgs: 164 active+clean; 582 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:38:55.570 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:55.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:55.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[40655]: osdmap e552: 8 total, 8 up, 8 in 2021-10-08T19:38:55.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:55.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:55.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[40655]: pgmap v864: 164 pgs: 164 active+clean; 582 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:38:55.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:55 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:56.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:56.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:55 smithi142 ceph-mon[33432]: osdmap e552: 8 total, 8 up, 8 in 2021-10-08T19:38:56.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/855106961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:56.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]: dispatch 2021-10-08T19:38:56.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:55 smithi142 ceph-mon[33432]: pgmap v864: 164 pgs: 164 active+clean; 582 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:38:56.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:55 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:38:56.870 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:56.871 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:56 smithi142 ceph-mon[33432]: osdmap e553: 8 total, 8 up, 8 in 2021-10-08T19:38:56.871 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:56.871 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:56.871 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:56.872 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:56.872 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:56.872 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:57.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:57.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[40655]: osdmap e553: 8 total, 8 up, 8 in 2021-10-08T19:38:57.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:57.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:57.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-102"}]': finished 2021-10-08T19:38:57.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[31694]: osdmap e553: 8 total, 8 up, 8 in 2021-10-08T19:38:57.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:57.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-10-08T19:38:57.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:38:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:38:57.584 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:57.585 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[40655]: osdmap e554: 8 total, 8 up, 8 in 2021-10-08T19:38:57.585 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.585 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.585 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[40655]: pgmap v867: 164 pgs: 164 active+clean; 582 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:38:57.586 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:57.586 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:57.586 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[31694]: osdmap e554: 8 total, 8 up, 8 in 2021-10-08T19:38:57.587 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.587 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:57.587 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[31694]: pgmap v867: 164 pgs: 164 active+clean; 582 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:38:57.587 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:58.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi112-83223-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-10-08T19:38:58.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:57 smithi142 ceph-mon[33432]: osdmap e554: 8 total, 8 up, 8 in 2021-10-08T19:38:58.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:58.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:38:58.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:57 smithi142 ceph-mon[33432]: pgmap v867: 164 pgs: 164 active+clean; 582 KiB data, 454 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-10-08T19:38:58.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:38:59.026 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:58 smithi142 ceph-mon[33432]: osdmap e555: 8 total, 8 up, 8 in 2021-10-08T19:38:59.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:58 smithi112 ceph-mon[40655]: osdmap e555: 8 total, 8 up, 8 in 2021-10-08T19:38:59.084 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:58 smithi112 ceph-mon[31694]: osdmap e555: 8 total, 8 up, 8 in 2021-10-08T19:39:00.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:00.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:59 smithi142 ceph-mon[33432]: osdmap e556: 8 total, 8 up, 8 in 2021-10-08T19:39:00.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:38:59 smithi142 ceph-mon[33432]: pgmap v870: 172 pgs: 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:00.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:00.076 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:59 smithi112 ceph-mon[40655]: osdmap e556: 8 total, 8 up, 8 in 2021-10-08T19:39:00.077 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:38:59 smithi112 ceph-mon[40655]: pgmap v870: 172 pgs: 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:00.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi112-83223-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:00.077 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:59 smithi112 ceph-mon[31694]: osdmap e556: 8 total, 8 up, 8 in 2021-10-08T19:39:00.078 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:38:59 smithi112 ceph-mon[31694]: pgmap v870: 172 pgs: 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:01.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:00 smithi142 ceph-mon[33432]: osdmap e557: 8 total, 8 up, 8 in 2021-10-08T19:39:01.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:01.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:01.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:00 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:01.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:00 smithi112 ceph-mon[40655]: osdmap e557: 8 total, 8 up, 8 in 2021-10-08T19:39:01.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:01.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:01.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:00 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:01.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:00 smithi112 ceph-mon[31694]: osdmap e557: 8 total, 8 up, 8 in 2021-10-08T19:39:01.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:01.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:01.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:00 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:02.028 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:02.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:01 smithi142 ceph-mon[33432]: osdmap e558: 8 total, 8 up, 8 in 2021-10-08T19:39:02.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:02.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:02.029 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:01 smithi142 ceph-mon[33432]: pgmap v873: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:02.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:02.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[40655]: osdmap e558: 8 total, 8 up, 8 in 2021-10-08T19:39:02.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:02.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:02.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[40655]: pgmap v873: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:02.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-110","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:02.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[31694]: osdmap e558: 8 total, 8 up, 8 in 2021-10-08T19:39:02.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:02.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:02.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:01 smithi112 ceph-mon[31694]: pgmap v873: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:02 smithi142 ceph-mon[33432]: osdmap e559: 8 total, 8 up, 8 in 2021-10-08T19:39:03.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:03.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:03.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:03.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:02 smithi112 ceph-mon[40655]: osdmap e559: 8 total, 8 up, 8 in 2021-10-08T19:39:03.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:03.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:03.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:03.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:02 smithi112 ceph-mon[31694]: osdmap e559: 8 total, 8 up, 8 in 2021-10-08T19:39:03.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:03.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:39:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:03.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]': finished 2021-10-08T19:39:03.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[40655]: osdmap e560: 8 total, 8 up, 8 in 2021-10-08T19:39:03.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:03.827 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:03.828 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[40655]: pgmap v876: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:03.829 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:03.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:03.829 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:03.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:03.830 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:03.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:39:03.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]': finished 2021-10-08T19:39:03.833 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[31694]: osdmap e560: 8 total, 8 up, 8 in 2021-10-08T19:39:03.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:03.834 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:03.836 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:03 smithi112 ceph-mon[31694]: pgmap v876: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-110"}]': finished 2021-10-08T19:39:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:03 smithi142 ceph-mon[33432]: osdmap e560: 8 total, 8 up, 8 in 2021-10-08T19:39:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:04.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:04.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:03 smithi142 ceph-mon[33432]: pgmap v876: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:05.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:05.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:04 smithi142 ceph-mon[33432]: osdmap e561: 8 total, 8 up, 8 in 2021-10-08T19:39:05.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:05.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:05.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:05.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:04 smithi112 ceph-mon[40655]: osdmap e561: 8 total, 8 up, 8 in 2021-10-08T19:39:05.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:05.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:05.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:05.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:04 smithi112 ceph-mon[31694]: osdmap e561: 8 total, 8 up, 8 in 2021-10-08T19:39:05.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:05.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]: dispatch 2021-10-08T19:39:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:05] "GET /metrics HTTP/1.1" 200 156519 "" "Prometheus/2.18.1" 2021-10-08T19:39:06.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]': finished 2021-10-08T19:39:06.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:05 smithi142 ceph-mon[33432]: osdmap e562: 8 total, 8 up, 8 in 2021-10-08T19:39:06.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:05 smithi142 ceph-mon[33432]: pgmap v879: 204 pgs: 204 active+clean; 582 KiB data, 425 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:39:06.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]': finished 2021-10-08T19:39:06.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:05 smithi112 ceph-mon[31694]: osdmap e562: 8 total, 8 up, 8 in 2021-10-08T19:39:06.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:05 smithi112 ceph-mon[31694]: pgmap v879: 204 pgs: 204 active+clean; 582 KiB data, 425 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:39:06.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-110"}]': finished 2021-10-08T19:39:06.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:05 smithi112 ceph-mon[40655]: osdmap e562: 8 total, 8 up, 8 in 2021-10-08T19:39:06.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:05 smithi112 ceph-mon[40655]: pgmap v879: 204 pgs: 204 active+clean; 582 KiB data, 425 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:39:07.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:39:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:39:07.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:06 smithi142 ceph-mon[33432]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:07.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:06 smithi142 ceph-mon[33432]: osdmap e563: 8 total, 8 up, 8 in 2021-10-08T19:39:07.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:06 smithi112 ceph-mon[31694]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:07.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:06 smithi112 ceph-mon[31694]: osdmap e563: 8 total, 8 up, 8 in 2021-10-08T19:39:07.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:06 smithi112 ceph-mon[40655]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:07.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:06 smithi112 ceph-mon[40655]: osdmap e563: 8 total, 8 up, 8 in 2021-10-08T19:39:08.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:07 smithi142 ceph-mon[33432]: osdmap e564: 8 total, 8 up, 8 in 2021-10-08T19:39:08.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:08.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:08.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:07 smithi142 ceph-mon[33432]: pgmap v882: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:08.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[40655]: osdmap e564: 8 total, 8 up, 8 in 2021-10-08T19:39:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[40655]: pgmap v882: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:08.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[31694]: osdmap e564: 8 total, 8 up, 8 in 2021-10-08T19:39:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[31694]: pgmap v882: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 425 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:09.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:09.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:08 smithi142 ceph-mon[33432]: osdmap e565: 8 total, 8 up, 8 in 2021-10-08T19:39:09.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:09.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:09.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:09.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:08 smithi112 ceph-mon[40655]: osdmap e565: 8 total, 8 up, 8 in 2021-10-08T19:39:09.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:09.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:09.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-112","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:09.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:08 smithi112 ceph-mon[31694]: osdmap e565: 8 total, 8 up, 8 in 2021-10-08T19:39:09.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:09.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:10.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:10.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:09 smithi142 ceph-mon[33432]: osdmap e566: 8 total, 8 up, 8 in 2021-10-08T19:39:10.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:10.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:10.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:09 smithi142 ceph-mon[33432]: pgmap v885: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:39:10.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:10.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[40655]: osdmap e566: 8 total, 8 up, 8 in 2021-10-08T19:39:10.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:10.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:10.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[40655]: pgmap v885: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:39:10.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:10.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[31694]: osdmap e566: 8 total, 8 up, 8 in 2021-10-08T19:39:10.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:10.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:10.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:09 smithi112 ceph-mon[31694]: pgmap v885: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-10-08T19:39:11.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]': finished 2021-10-08T19:39:11.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:10 smithi142 ceph-mon[33432]: osdmap e567: 8 total, 8 up, 8 in 2021-10-08T19:39:11.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]: dispatch 2021-10-08T19:39:11.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]: dispatch 2021-10-08T19:39:11.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]': finished 2021-10-08T19:39:11.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:10 smithi112 ceph-mon[40655]: osdmap e567: 8 total, 8 up, 8 in 2021-10-08T19:39:11.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]: dispatch 2021-10-08T19:39:11.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]: dispatch 2021-10-08T19:39:11.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-112"}]': finished 2021-10-08T19:39:11.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:10 smithi112 ceph-mon[31694]: osdmap e567: 8 total, 8 up, 8 in 2021-10-08T19:39:11.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]: dispatch 2021-10-08T19:39:11.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]: dispatch 2021-10-08T19:39:11.990 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:11 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:11.990 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]': finished 2021-10-08T19:39:11.991 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:11 smithi142 ceph-mon[33432]: osdmap e568: 8 total, 8 up, 8 in 2021-10-08T19:39:11.991 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:11.991 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:11.991 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:11 smithi142 ceph-mon[33432]: pgmap v888: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:12.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:12.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]': finished 2021-10-08T19:39:12.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[40655]: osdmap e568: 8 total, 8 up, 8 in 2021-10-08T19:39:12.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:12.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:12.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[40655]: pgmap v888: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:12.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:12.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-112", "mode": "writeback"}]': finished 2021-10-08T19:39:12.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[31694]: osdmap e568: 8 total, 8 up, 8 in 2021-10-08T19:39:12.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:12.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:12.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:11 smithi112 ceph-mon[31694]: pgmap v888: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:39:13.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:13.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:12 smithi142 ceph-mon[33432]: osdmap e569: 8 total, 8 up, 8 in 2021-10-08T19:39:13.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:13.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:13.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:13.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:12 smithi112 ceph-mon[40655]: osdmap e569: 8 total, 8 up, 8 in 2021-10-08T19:39:13.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:13.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:13.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:13.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:12 smithi112 ceph-mon[31694]: osdmap e569: 8 total, 8 up, 8 in 2021-10-08T19:39:13.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:13.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]: dispatch 2021-10-08T19:39:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:39:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:13.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:13 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:13.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]': finished 2021-10-08T19:39:13.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:13 smithi112 ceph-mon[40655]: osdmap e570: 8 total, 8 up, 8 in 2021-10-08T19:39:13.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:13 smithi112 ceph-mon[40655]: pgmap v891: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:13.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:13.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:13.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:13.523Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:39:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:13 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:13.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]': finished 2021-10-08T19:39:13.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:13 smithi112 ceph-mon[31694]: osdmap e570: 8 total, 8 up, 8 in 2021-10-08T19:39:13.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:13 smithi112 ceph-mon[31694]: pgmap v891: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:13.973 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:13 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:13.973 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-112"}]': finished 2021-10-08T19:39:13.974 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:13 smithi142 ceph-mon[33432]: osdmap e570: 8 total, 8 up, 8 in 2021-10-08T19:39:13.974 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:13 smithi142 ceph-mon[33432]: pgmap v891: 204 pgs: 204 active+clean; 582 KiB data, 426 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:15.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:14 smithi142 ceph-mon[33432]: osdmap e571: 8 total, 8 up, 8 in 2021-10-08T19:39:15.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:14 smithi112 ceph-mon[40655]: osdmap e571: 8 total, 8 up, 8 in 2021-10-08T19:39:15.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:14 smithi112 ceph-mon[31694]: osdmap e571: 8 total, 8 up, 8 in 2021-10-08T19:39:15.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:15] "GET /metrics HTTP/1.1" 200 157641 "" "Prometheus/2.18.1" 2021-10-08T19:39:16.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:15 smithi142 ceph-mon[33432]: osdmap e572: 8 total, 8 up, 8 in 2021-10-08T19:39:16.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:16.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:16.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:15 smithi142 ceph-mon[33432]: pgmap v894: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:16.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:15 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:16.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[31694]: osdmap e572: 8 total, 8 up, 8 in 2021-10-08T19:39:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[31694]: pgmap v894: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:16.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:16.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[40655]: osdmap e572: 8 total, 8 up, 8 in 2021-10-08T19:39:16.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:16.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:16.074 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[40655]: pgmap v894: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:16.075 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:15 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:39:17.023 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:39:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:39:17.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:17.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:16 smithi142 ceph-mon[33432]: osdmap e573: 8 total, 8 up, 8 in 2021-10-08T19:39:17.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:17.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:16 smithi112 ceph-mon[40655]: osdmap e573: 8 total, 8 up, 8 in 2021-10-08T19:39:17.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-114","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:17.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:16 smithi112 ceph-mon[31694]: osdmap e573: 8 total, 8 up, 8 in 2021-10-08T19:39:18.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:17 smithi142 ceph-mon[33432]: osdmap e574: 8 total, 8 up, 8 in 2021-10-08T19:39:18.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:18.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:18.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:17 smithi142 ceph-mon[33432]: pgmap v897: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:18.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:18.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[40655]: osdmap e574: 8 total, 8 up, 8 in 2021-10-08T19:39:18.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:18.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:18.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[40655]: pgmap v897: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:18.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:18.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[31694]: osdmap e574: 8 total, 8 up, 8 in 2021-10-08T19:39:18.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:18.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:18.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[31694]: pgmap v897: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 427 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:18.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:19.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:19.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: osdmap e575: 8 total, 8 up, 8 in 2021-10-08T19:39:19.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:19.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:19.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:19.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:19.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:19.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:19.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:18 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:19.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:18 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:39:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:19.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:19.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: osdmap e575: 8 total, 8 up, 8 in 2021-10-08T19:39:19.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:19.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:19.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:19.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:19.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:19.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:19.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:19.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:19.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: osdmap e575: 8 total, 8 up, 8 in 2021-10-08T19:39:19.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:19.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:19.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:39:19.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:39:19.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:39:19.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:19.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:18 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:20.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:19 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:39:20.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:19 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:39:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]': finished 2021-10-08T19:39:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:19 smithi142 ceph-mon[33432]: osdmap e576: 8 total, 8 up, 8 in 2021-10-08T19:39:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]: dispatch 2021-10-08T19:39:20.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]: dispatch 2021-10-08T19:39:20.025 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:19 smithi142 ceph-mon[33432]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:39:20.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:39:20.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:39:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:20.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]': finished 2021-10-08T19:39:20.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[40655]: osdmap e576: 8 total, 8 up, 8 in 2021-10-08T19:39:20.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]: dispatch 2021-10-08T19:39:20.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]: dispatch 2021-10-08T19:39:20.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[40655]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:39:20.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:39:20.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:39:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:20.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-114"}]': finished 2021-10-08T19:39:20.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[31694]: osdmap e576: 8 total, 8 up, 8 in 2021-10-08T19:39:20.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]: dispatch 2021-10-08T19:39:20.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]: dispatch 2021-10-08T19:39:20.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:19 smithi112 ceph-mon[31694]: pgmap v900: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:39:21.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:20 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:21.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]': finished 2021-10-08T19:39:21.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:20 smithi142 ceph-mon[33432]: osdmap e577: 8 total, 8 up, 8 in 2021-10-08T19:39:21.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "236.7"}]: dispatch 2021-10-08T19:39:21.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:20 smithi142 ceph-mon[33432]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "236.7"}]: dispatch 2021-10-08T19:39:21.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:20 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:21.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:20 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:39:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:21.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:21.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]': finished 2021-10-08T19:39:21.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[40655]: osdmap e577: 8 total, 8 up, 8 in 2021-10-08T19:39:21.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "236.7"}]: dispatch 2021-10-08T19:39:21.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[40655]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "236.7"}]: dispatch 2021-10-08T19:39:21.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:21.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:21.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-114", "mode": "writeback"}]': finished 2021-10-08T19:39:21.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[31694]: osdmap e577: 8 total, 8 up, 8 in 2021-10-08T19:39:21.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "236.7"}]: dispatch 2021-10-08T19:39:21.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[31694]: from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "236.7"}]: dispatch 2021-10-08T19:39:21.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:20 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:22.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:21 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:39:22.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:21 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:39:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:22.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:21 smithi142 ceph-mon[33432]: 236.7 scrub ok 2021-10-08T19:39:22.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:21 smithi142 ceph-mon[33432]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:39:22.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:21 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:39:22.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:21 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:39:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:22.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:21 smithi112 ceph-mon[40655]: 236.7 scrub ok 2021-10-08T19:39:22.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:21 smithi112 ceph-mon[40655]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:39:22.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:21 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:39:22.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:21 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:39:20] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:22.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:21 smithi112 ceph-mon[31694]: 236.7 scrub ok 2021-10-08T19:39:22.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:21 smithi112 ceph-mon[31694]: pgmap v902: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:39:23.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:23.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:23.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:23.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:23.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:23.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:23.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:23.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:23.173 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:23.173 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:23.174 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:39:23.174 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:39:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:39:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:23.820 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:23.523Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:23.820 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:23.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:23.524Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:39:24.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:23 smithi112 ceph-mon[40655]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:39:24.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:23 smithi112 ceph-mon[31694]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:39:24.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:23 smithi142 ceph-mon[33432]: pgmap v903: 204 pgs: 204 active+clean; 582 KiB data, 429 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:39:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:25] "GET /metrics HTTP/1.1" 200 157677 "" "Prometheus/2.18.1" 2021-10-08T19:39:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:26 smithi142 ceph-mon[33432]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1005 B/s wr, 3 op/s 2021-10-08T19:39:26.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:26 smithi112 ceph-mon[40655]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1005 B/s wr, 3 op/s 2021-10-08T19:39:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:26 smithi112 ceph-mon[31694]: pgmap v904: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1005 B/s wr, 3 op/s 2021-10-08T19:39:27.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:39:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:39:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:28 smithi142 ceph-mon[33432]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 1 op/s 2021-10-08T19:39:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:28 smithi112 ceph-mon[40655]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 1 op/s 2021-10-08T19:39:28.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:28.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:28 smithi112 ceph-mon[31694]: pgmap v905: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 1 op/s 2021-10-08T19:39:28.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:30 smithi142 ceph-mon[33432]: pgmap v906: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:30.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:30 smithi112 ceph-mon[40655]: pgmap v906: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:30.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:30 smithi112 ceph-mon[31694]: pgmap v906: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:32 smithi142 ceph-mon[33432]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:39:32.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:32 smithi112 ceph-mon[31694]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:39:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:32 smithi112 ceph-mon[40655]: pgmap v907: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:39:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:39:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:33.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:33.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:33.524Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:39:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:34 smithi142 ceph-mon[33432]: pgmap v908: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:39:34.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:34 smithi112 ceph-mon[31694]: pgmap v908: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:39:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:34 smithi112 ceph-mon[40655]: pgmap v908: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-10-08T19:39:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:35] "GET /metrics HTTP/1.1" 200 157677 "" "Prometheus/2.18.1" 2021-10-08T19:39:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:36 smithi142 ceph-mon[33432]: pgmap v909: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:39:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:36 smithi142 ceph-mon[33432]: osdmap e578: 8 total, 8 up, 8 in 2021-10-08T19:39:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:36 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:36.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:36 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:36 smithi112 ceph-mon[40655]: pgmap v909: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:39:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:36 smithi112 ceph-mon[40655]: osdmap e578: 8 total, 8 up, 8 in 2021-10-08T19:39:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:36 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:36 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:36 smithi112 ceph-mon[31694]: pgmap v909: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-10-08T19:39:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:36 smithi112 ceph-mon[31694]: osdmap e578: 8 total, 8 up, 8 in 2021-10-08T19:39:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:36 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:36 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:37.163 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:39:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:39:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:37 smithi142 ceph-mon[33432]: osdmap e579: 8 total, 8 up, 8 in 2021-10-08T19:39:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:37.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:37 smithi112 ceph-mon[40655]: osdmap e579: 8 total, 8 up, 8 in 2021-10-08T19:39:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:37.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:37.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:37.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:37 smithi112 ceph-mon[31694]: osdmap e579: 8 total, 8 up, 8 in 2021-10-08T19:39:37.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:37.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]: dispatch 2021-10-08T19:39:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:38 smithi142 ceph-mon[33432]: pgmap v912: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:39:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:38 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]': finished 2021-10-08T19:39:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:38 smithi142 ceph-mon[33432]: osdmap e580: 8 total, 8 up, 8 in 2021-10-08T19:39:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[40655]: pgmap v912: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:39:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]': finished 2021-10-08T19:39:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[40655]: osdmap e580: 8 total, 8 up, 8 in 2021-10-08T19:39:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[31694]: pgmap v912: 204 pgs: 204 active+clean; 582 KiB data, 430 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:39:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-114"}]': finished 2021-10-08T19:39:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:38 smithi112 ceph-mon[31694]: osdmap e580: 8 total, 8 up, 8 in 2021-10-08T19:39:39.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:39 smithi142 ceph-mon[33432]: osdmap e581: 8 total, 8 up, 8 in 2021-10-08T19:39:39.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:39 smithi112 ceph-mon[31694]: osdmap e581: 8 total, 8 up, 8 in 2021-10-08T19:39:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:39 smithi112 ceph-mon[40655]: osdmap e581: 8 total, 8 up, 8 in 2021-10-08T19:39:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:40 smithi142 ceph-mon[33432]: pgmap v915: 172 pgs: 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:39:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:40 smithi142 ceph-mon[33432]: osdmap e582: 8 total, 8 up, 8 in 2021-10-08T19:39:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:40 smithi142 ceph-mon[33432]: osdmap e583: 8 total, 8 up, 8 in 2021-10-08T19:39:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[40655]: pgmap v915: 172 pgs: 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:39:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[40655]: osdmap e582: 8 total, 8 up, 8 in 2021-10-08T19:39:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[40655]: osdmap e583: 8 total, 8 up, 8 in 2021-10-08T19:39:40.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[31694]: pgmap v915: 172 pgs: 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:39:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[31694]: osdmap e582: 8 total, 8 up, 8 in 2021-10-08T19:39:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-116","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:40.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:40 smithi112 ceph-mon[31694]: osdmap e583: 8 total, 8 up, 8 in 2021-10-08T19:39:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:42 smithi142 ceph-mon[33432]: pgmap v918: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:39:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:42 smithi142 ceph-mon[33432]: osdmap e584: 8 total, 8 up, 8 in 2021-10-08T19:39:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:42 smithi112 ceph-mon[40655]: pgmap v918: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:39:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:42 smithi112 ceph-mon[40655]: osdmap e584: 8 total, 8 up, 8 in 2021-10-08T19:39:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:42.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:42 smithi112 ceph-mon[31694]: pgmap v918: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2021-10-08T19:39:42.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:42 smithi112 ceph-mon[31694]: osdmap e584: 8 total, 8 up, 8 in 2021-10-08T19:39:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:42.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:43.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:43.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:43 smithi112 ceph-mon[31694]: osdmap e585: 8 total, 8 up, 8 in 2021-10-08T19:39:43.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:43.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:43.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:43.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:43 smithi112 ceph-mon[40655]: osdmap e585: 8 total, 8 up, 8 in 2021-10-08T19:39:43.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:43.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:39:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:43 smithi142 ceph-mon[33432]: osdmap e585: 8 total, 8 up, 8 in 2021-10-08T19:39:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:43.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:43.524Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:43.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:43.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:39:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:44 smithi142 ceph-mon[33432]: pgmap v921: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]': finished 2021-10-08T19:39:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:44 smithi142 ceph-mon[33432]: osdmap e586: 8 total, 8 up, 8 in 2021-10-08T19:39:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]: dispatch 2021-10-08T19:39:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]: dispatch 2021-10-08T19:39:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[31694]: pgmap v921: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]': finished 2021-10-08T19:39:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[31694]: osdmap e586: 8 total, 8 up, 8 in 2021-10-08T19:39:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]: dispatch 2021-10-08T19:39:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]: dispatch 2021-10-08T19:39:44.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[40655]: pgmap v921: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 431 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:44.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-116"}]': finished 2021-10-08T19:39:44.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[40655]: osdmap e586: 8 total, 8 up, 8 in 2021-10-08T19:39:44.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]: dispatch 2021-10-08T19:39:44.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]: dispatch 2021-10-08T19:39:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:45 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]': finished 2021-10-08T19:39:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:45 smithi142 ceph-mon[33432]: osdmap e587: 8 total, 8 up, 8 in 2021-10-08T19:39:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:45] "GET /metrics HTTP/1.1" 200 157697 "" "Prometheus/2.18.1" 2021-10-08T19:39:45.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:45 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:45.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]': finished 2021-10-08T19:39:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:45 smithi112 ceph-mon[40655]: osdmap e587: 8 total, 8 up, 8 in 2021-10-08T19:39:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:45 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-116", "mode": "writeback"}]': finished 2021-10-08T19:39:45.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:45 smithi112 ceph-mon[31694]: osdmap e587: 8 total, 8 up, 8 in 2021-10-08T19:39:46.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:45 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:39:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:46 smithi142 ceph-mon[33432]: pgmap v924: 204 pgs: 204 active+clean; 582 KiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:46 smithi142 ceph-mon[33432]: osdmap e588: 8 total, 8 up, 8 in 2021-10-08T19:39:46.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:46 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:46.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:46.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:46 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[40655]: pgmap v924: 204 pgs: 204 active+clean; 582 KiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[40655]: osdmap e588: 8 total, 8 up, 8 in 2021-10-08T19:39:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:46.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:46.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:46.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[31694]: pgmap v924: 204 pgs: 204 active+clean; 582 KiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:46.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[31694]: osdmap e588: 8 total, 8 up, 8 in 2021-10-08T19:39:46.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:46.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:46.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:46 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:47.187 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:39:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:39:47.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:47 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:39:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:47.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:39:47.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:39:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:47.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:47.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[40655]: osdmap e589: 8 total, 8 up, 8 in 2021-10-08T19:39:47.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:47.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:47.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:47.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:47.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:39:47.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:39:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:47.328 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:47.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[31694]: osdmap e589: 8 total, 8 up, 8 in 2021-10-08T19:39:47.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:47.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:47.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:47.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:47 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:47 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:39:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:47 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:39:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:47.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:47 smithi142 ceph-mon[33432]: osdmap e589: 8 total, 8 up, 8 in 2021-10-08T19:39:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:47.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]: dispatch 2021-10-08T19:39:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:47 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:39:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:47 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:48 smithi142 ceph-mon[33432]: pgmap v927: 204 pgs: 204 active+clean; 582 KiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:48 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:39:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:48 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:39:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]': finished 2021-10-08T19:39:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:48 smithi142 ceph-mon[33432]: osdmap e590: 8 total, 8 up, 8 in 2021-10-08T19:39:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[40655]: pgmap v927: 204 pgs: 204 active+clean; 582 KiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:39:48.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:39:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:48.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]': finished 2021-10-08T19:39:48.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[40655]: osdmap e590: 8 total, 8 up, 8 in 2021-10-08T19:39:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[31694]: pgmap v927: 204 pgs: 204 active+clean; 582 KiB data, 436 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:48.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:48.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:39:48.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:39:47] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:39:48.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-116"}]': finished 2021-10-08T19:39:48.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:48 smithi112 ceph-mon[31694]: osdmap e590: 8 total, 8 up, 8 in 2021-10-08T19:39:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:49 smithi142 ceph-mon[33432]: osdmap e591: 8 total, 8 up, 8 in 2021-10-08T19:39:49.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:49 smithi112 ceph-mon[40655]: osdmap e591: 8 total, 8 up, 8 in 2021-10-08T19:39:49.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:49 smithi112 ceph-mon[31694]: osdmap e591: 8 total, 8 up, 8 in 2021-10-08T19:39:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:50 smithi142 ceph-mon[33432]: pgmap v930: 172 pgs: 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:50 smithi142 ceph-mon[33432]: osdmap e592: 8 total, 8 up, 8 in 2021-10-08T19:39:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:50 smithi142 ceph-mon[33432]: osdmap e593: 8 total, 8 up, 8 in 2021-10-08T19:39:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[40655]: pgmap v930: 172 pgs: 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[40655]: osdmap e592: 8 total, 8 up, 8 in 2021-10-08T19:39:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[40655]: osdmap e593: 8 total, 8 up, 8 in 2021-10-08T19:39:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:50.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[31694]: pgmap v930: 172 pgs: 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[31694]: osdmap e592: 8 total, 8 up, 8 in 2021-10-08T19:39:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-118","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[31694]: osdmap e593: 8 total, 8 up, 8 in 2021-10-08T19:39:50.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:50.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:52 smithi142 ceph-mon[33432]: pgmap v933: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:52 smithi142 ceph-mon[33432]: osdmap e594: 8 total, 8 up, 8 in 2021-10-08T19:39:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[40655]: pgmap v933: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[40655]: osdmap e594: 8 total, 8 up, 8 in 2021-10-08T19:39:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:52.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[31694]: pgmap v933: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:39:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:39:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[31694]: osdmap e594: 8 total, 8 up, 8 in 2021-10-08T19:39:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:39:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:39:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]': finished 2021-10-08T19:39:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:53 smithi142 ceph-mon[33432]: osdmap e595: 8 total, 8 up, 8 in 2021-10-08T19:39:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]: dispatch 2021-10-08T19:39:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]: dispatch 2021-10-08T19:39:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:53 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]': finished 2021-10-08T19:39:53.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:53 smithi142 ceph-mon[33432]: osdmap e596: 8 total, 8 up, 8 in 2021-10-08T19:39:53.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]': finished 2021-10-08T19:39:53.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[40655]: osdmap e595: 8 total, 8 up, 8 in 2021-10-08T19:39:53.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]: dispatch 2021-10-08T19:39:53.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]: dispatch 2021-10-08T19:39:53.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:53.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]': finished 2021-10-08T19:39:53.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[40655]: osdmap e596: 8 total, 8 up, 8 in 2021-10-08T19:39:53.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-118"}]': finished 2021-10-08T19:39:53.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[31694]: osdmap e595: 8 total, 8 up, 8 in 2021-10-08T19:39:53.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]: dispatch 2021-10-08T19:39:53.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]: dispatch 2021-10-08T19:39:53.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:39:53.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-118", "mode": "writeback"}]': finished 2021-10-08T19:39:53.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:53 smithi112 ceph-mon[31694]: osdmap e596: 8 total, 8 up, 8 in 2021-10-08T19:39:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:53.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:53.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:39:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:39:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:39:53.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:39:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:54 smithi142 ceph-mon[33432]: pgmap v936: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:54 smithi112 ceph-mon[40655]: pgmap v936: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:54 smithi112 ceph-mon[31694]: pgmap v936: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 437 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:39:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:39:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:55 smithi142 ceph-mon[33432]: osdmap e597: 8 total, 8 up, 8 in 2021-10-08T19:39:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:39:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:39:55] "GET /metrics HTTP/1.1" 200 157638 "" "Prometheus/2.18.1" 2021-10-08T19:39:55.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:55 smithi112 ceph-mon[31694]: osdmap e597: 8 total, 8 up, 8 in 2021-10-08T19:39:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:39:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:55 smithi112 ceph-mon[40655]: osdmap e597: 8 total, 8 up, 8 in 2021-10-08T19:39:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]: dispatch 2021-10-08T19:39:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:56 smithi142 ceph-mon[33432]: pgmap v939: 204 pgs: 204 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:39:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:56 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]': finished 2021-10-08T19:39:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:56 smithi142 ceph-mon[33432]: osdmap e598: 8 total, 8 up, 8 in 2021-10-08T19:39:56.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:56 smithi112 ceph-mon[31694]: pgmap v939: 204 pgs: 204 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:39:56.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:56 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:56.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]': finished 2021-10-08T19:39:56.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:56 smithi112 ceph-mon[31694]: osdmap e598: 8 total, 8 up, 8 in 2021-10-08T19:39:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:56 smithi112 ceph-mon[40655]: pgmap v939: 204 pgs: 204 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2021-10-08T19:39:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:56 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:39:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-118"}]': finished 2021-10-08T19:39:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:56 smithi112 ceph-mon[40655]: osdmap e598: 8 total, 8 up, 8 in 2021-10-08T19:39:57.195 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:39:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:39:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:57 smithi142 ceph-mon[33432]: osdmap e599: 8 total, 8 up, 8 in 2021-10-08T19:39:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:57 smithi112 ceph-mon[40655]: osdmap e599: 8 total, 8 up, 8 in 2021-10-08T19:39:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:57 smithi112 ceph-mon[31694]: osdmap e599: 8 total, 8 up, 8 in 2021-10-08T19:39:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:58 smithi142 ceph-mon[33432]: pgmap v942: 172 pgs: 172 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:58 smithi142 ceph-mon[33432]: osdmap e600: 8 total, 8 up, 8 in 2021-10-08T19:39:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[40655]: pgmap v942: 172 pgs: 172 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[40655]: osdmap e600: 8 total, 8 up, 8 in 2021-10-08T19:39:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:58.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[31694]: pgmap v942: 172 pgs: 172 active+clean; 582 KiB data, 439 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:39:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:39:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[31694]: osdmap e600: 8 total, 8 up, 8 in 2021-10-08T19:39:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:39:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:59 smithi142 ceph-mon[33432]: osdmap e601: 8 total, 8 up, 8 in 2021-10-08T19:39:59.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:59.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:39:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:59.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:59.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:59 smithi112 ceph-mon[31694]: osdmap e601: 8 total, 8 up, 8 in 2021-10-08T19:39:59.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:39:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:59.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-120","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:39:59.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:59 smithi112 ceph-mon[40655]: osdmap e601: 8 total, 8 up, 8 in 2021-10-08T19:39:59.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:39:59.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:39:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: pgmap v945: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: osdmap e602: 8 total, 8 up, 8 in 2021-10-08T19:40:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2021-10-08T19:40:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:40:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:40:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: application not enabled on pool 'test-rados-api-smithi112-83223-109' 2021-10-08T19:40:00.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:00 smithi142 ceph-mon[33432]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:40:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: pgmap v945: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: osdmap e602: 8 total, 8 up, 8 in 2021-10-08T19:40:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2021-10-08T19:40:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:40:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:40:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: application not enabled on pool 'test-rados-api-smithi112-83223-109' 2021-10-08T19:40:00.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[40655]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:40:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: pgmap v945: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: osdmap e602: 8 total, 8 up, 8 in 2021-10-08T19:40:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2021-10-08T19:40:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2021-10-08T19:40:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: application not enabled on pool 'ceph_test_rados_api_asio' 2021-10-08T19:40:00.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: application not enabled on pool 'test-rados-api-smithi112-83223-109' 2021-10-08T19:40:00.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:00 smithi112 ceph-mon[31694]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-10-08T19:40:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]': finished 2021-10-08T19:40:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:01 smithi142 ceph-mon[33432]: osdmap e603: 8 total, 8 up, 8 in 2021-10-08T19:40:01.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]: dispatch 2021-10-08T19:40:01.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]: dispatch 2021-10-08T19:40:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]': finished 2021-10-08T19:40:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:01 smithi112 ceph-mon[40655]: osdmap e603: 8 total, 8 up, 8 in 2021-10-08T19:40:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]: dispatch 2021-10-08T19:40:01.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]: dispatch 2021-10-08T19:40:01.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-120"}]': finished 2021-10-08T19:40:01.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:01 smithi112 ceph-mon[31694]: osdmap e603: 8 total, 8 up, 8 in 2021-10-08T19:40:01.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]: dispatch 2021-10-08T19:40:01.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]: dispatch 2021-10-08T19:40:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:02 smithi142 ceph-mon[33432]: pgmap v948: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:02 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:02.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]': finished 2021-10-08T19:40:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:02 smithi142 ceph-mon[33432]: osdmap e604: 8 total, 8 up, 8 in 2021-10-08T19:40:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:02.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[31694]: pgmap v948: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:02.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]': finished 2021-10-08T19:40:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[31694]: osdmap e604: 8 total, 8 up, 8 in 2021-10-08T19:40:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[40655]: pgmap v948: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-120", "mode": "writeback"}]': finished 2021-10-08T19:40:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[40655]: osdmap e604: 8 total, 8 up, 8 in 2021-10-08T19:40:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:02.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:40:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:03.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:03 smithi142 ceph-mon[33432]: osdmap e605: 8 total, 8 up, 8 in 2021-10-08T19:40:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:03.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:03.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:03 smithi112 ceph-mon[40655]: osdmap e605: 8 total, 8 up, 8 in 2021-10-08T19:40:03.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:03.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:03.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:03.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:03 smithi112 ceph-mon[31694]: osdmap e605: 8 total, 8 up, 8 in 2021-10-08T19:40:03.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:03.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]: dispatch 2021-10-08T19:40:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:03.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:03.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:03.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:40:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:04 smithi112 ceph-mon[40655]: pgmap v951: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:04 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]': finished 2021-10-08T19:40:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:04 smithi112 ceph-mon[40655]: osdmap e606: 8 total, 8 up, 8 in 2021-10-08T19:40:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:04 smithi112 ceph-mon[31694]: pgmap v951: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:04 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]': finished 2021-10-08T19:40:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:04 smithi112 ceph-mon[31694]: osdmap e606: 8 total, 8 up, 8 in 2021-10-08T19:40:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:04 smithi142 ceph-mon[33432]: pgmap v951: 204 pgs: 204 active+clean; 582 KiB data, 445 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:04 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-120"}]': finished 2021-10-08T19:40:04.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:04 smithi142 ceph-mon[33432]: osdmap e606: 8 total, 8 up, 8 in 2021-10-08T19:40:05.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:05 smithi112 ceph-mon[40655]: osdmap e607: 8 total, 8 up, 8 in 2021-10-08T19:40:05.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:05 smithi112 ceph-mon[31694]: osdmap e607: 8 total, 8 up, 8 in 2021-10-08T19:40:05.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:05] "GET /metrics HTTP/1.1" 200 157638 "" "Prometheus/2.18.1" 2021-10-08T19:40:05.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:05 smithi142 ceph-mon[33432]: osdmap e607: 8 total, 8 up, 8 in 2021-10-08T19:40:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:06 smithi142 ceph-mon[33432]: pgmap v954: 172 pgs: 172 active+clean; 582 KiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:06 smithi142 ceph-mon[33432]: osdmap e608: 8 total, 8 up, 8 in 2021-10-08T19:40:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:06 smithi112 ceph-mon[40655]: pgmap v954: 172 pgs: 172 active+clean; 582 KiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:06 smithi112 ceph-mon[40655]: osdmap e608: 8 total, 8 up, 8 in 2021-10-08T19:40:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:06 smithi112 ceph-mon[31694]: pgmap v954: 172 pgs: 172 active+clean; 582 KiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:06.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:06 smithi112 ceph-mon[31694]: osdmap e608: 8 total, 8 up, 8 in 2021-10-08T19:40:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:06.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:07.275 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:40:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:40:07.308 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:07.308 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:07 smithi112 ceph-mon[31694]: osdmap e609: 8 total, 8 up, 8 in 2021-10-08T19:40:07.309 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:07.309 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:07 smithi112 ceph-mon[40655]: osdmap e609: 8 total, 8 up, 8 in 2021-10-08T19:40:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-122","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:07.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:07 smithi142 ceph-mon[33432]: osdmap e609: 8 total, 8 up, 8 in 2021-10-08T19:40:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:08 smithi142 ceph-mon[33432]: pgmap v957: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:08 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:08 smithi142 ceph-mon[33432]: osdmap e610: 8 total, 8 up, 8 in 2021-10-08T19:40:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[40655]: pgmap v957: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[40655]: osdmap e610: 8 total, 8 up, 8 in 2021-10-08T19:40:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[31694]: pgmap v957: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 446 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[31694]: osdmap e610: 8 total, 8 up, 8 in 2021-10-08T19:40:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:08.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[40655]: osdmap e611: 8 total, 8 up, 8 in 2021-10-08T19:40:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[40655]: pgmap v960: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:40:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]': finished 2021-10-08T19:40:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[40655]: osdmap e612: 8 total, 8 up, 8 in 2021-10-08T19:40:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[31694]: osdmap e611: 8 total, 8 up, 8 in 2021-10-08T19:40:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:09.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[31694]: pgmap v960: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:40:09.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]': finished 2021-10-08T19:40:09.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:09 smithi112 ceph-mon[31694]: osdmap e612: 8 total, 8 up, 8 in 2021-10-08T19:40:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:09 smithi142 ceph-mon[33432]: osdmap e611: 8 total, 8 up, 8 in 2021-10-08T19:40:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:09.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:09.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:09 smithi142 ceph-mon[33432]: pgmap v960: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:40:09.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-122"}]': finished 2021-10-08T19:40:09.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:09 smithi142 ceph-mon[33432]: osdmap e612: 8 total, 8 up, 8 in 2021-10-08T19:40:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]: dispatch 2021-10-08T19:40:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]: dispatch 2021-10-08T19:40:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]': finished 2021-10-08T19:40:10.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[40655]: osdmap e613: 8 total, 8 up, 8 in 2021-10-08T19:40:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]: dispatch 2021-10-08T19:40:10.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]: dispatch 2021-10-08T19:40:10.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:10.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]': finished 2021-10-08T19:40:10.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:10 smithi112 ceph-mon[31694]: osdmap e613: 8 total, 8 up, 8 in 2021-10-08T19:40:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]: dispatch 2021-10-08T19:40:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]: dispatch 2021-10-08T19:40:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:10 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-122", "mode": "writeback"}]': finished 2021-10-08T19:40:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:10 smithi142 ceph-mon[33432]: osdmap e613: 8 total, 8 up, 8 in 2021-10-08T19:40:11.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:11 smithi142 ceph-mon[33432]: pgmap v963: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:40:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:11 smithi112 ceph-mon[40655]: pgmap v963: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:40:11.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:11 smithi112 ceph-mon[31694]: pgmap v963: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-10-08T19:40:12.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:12 smithi142 ceph-mon[33432]: osdmap e614: 8 total, 8 up, 8 in 2021-10-08T19:40:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:12.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:12.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:12 smithi112 ceph-mon[31694]: osdmap e614: 8 total, 8 up, 8 in 2021-10-08T19:40:12.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:12.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:12.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:12 smithi112 ceph-mon[40655]: osdmap e614: 8 total, 8 up, 8 in 2021-10-08T19:40:12.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:12.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:13.468 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:13 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:40:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:13.468 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:13.469 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[40655]: osdmap e615: 8 total, 8 up, 8 in 2021-10-08T19:40:13.469 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:13.469 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:13.469 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[40655]: pgmap v966: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:13.469 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:13.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:40:13.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:40:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:13.470 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:13.471 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[31694]: osdmap e615: 8 total, 8 up, 8 in 2021-10-08T19:40:13.471 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:13.471 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:13.471 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[31694]: pgmap v966: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:13.471 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:13.472 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:40:13.472 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:13 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:40:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:40:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:13 smithi142 ceph-mon[33432]: osdmap e615: 8 total, 8 up, 8 in 2021-10-08T19:40:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]: dispatch 2021-10-08T19:40:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:13 smithi142 ceph-mon[33432]: pgmap v966: 204 pgs: 204 active+clean; 582 KiB data, 456 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:13 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:13 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:40:13.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:13 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:40:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:13.821 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:13 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:40:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:13.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:13.525Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:13.525Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:40:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:14 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]': finished 2021-10-08T19:40:14.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:14 smithi142 ceph-mon[33432]: osdmap e616: 8 total, 8 up, 8 in 2021-10-08T19:40:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:14 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:14 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:40:14.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:14 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:40:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:14.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:14.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]': finished 2021-10-08T19:40:14.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[31694]: osdmap e616: 8 total, 8 up, 8 in 2021-10-08T19:40:14.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:14.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:40:14.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:40:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-122"}]': finished 2021-10-08T19:40:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[40655]: osdmap e616: 8 total, 8 up, 8 in 2021-10-08T19:40:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:40:14.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:14 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:40:13] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:15.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:15 smithi112 ceph-mon[31694]: osdmap e617: 8 total, 8 up, 8 in 2021-10-08T19:40:15.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:15 smithi112 ceph-mon[31694]: pgmap v969: 172 pgs: 172 active+clean; 582 KiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:15.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:15 smithi112 ceph-mon[40655]: osdmap e617: 8 total, 8 up, 8 in 2021-10-08T19:40:15.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:15 smithi112 ceph-mon[40655]: pgmap v969: 172 pgs: 172 active+clean; 582 KiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:15.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:15] "GET /metrics HTTP/1.1" 200 157644 "" "Prometheus/2.18.1" 2021-10-08T19:40:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:15 smithi142 ceph-mon[33432]: osdmap e617: 8 total, 8 up, 8 in 2021-10-08T19:40:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:15 smithi142 ceph-mon[33432]: pgmap v969: 172 pgs: 172 active+clean; 582 KiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:16 smithi142 ceph-mon[33432]: osdmap e618: 8 total, 8 up, 8 in 2021-10-08T19:40:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:16.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:16.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:16 smithi112 ceph-mon[40655]: osdmap e618: 8 total, 8 up, 8 in 2021-10-08T19:40:16.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:16.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:16.826 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:16 smithi112 ceph-mon[31694]: osdmap e618: 8 total, 8 up, 8 in 2021-10-08T19:40:16.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:16.827 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:17.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:40:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:40:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:17 smithi142 ceph-mon[33432]: osdmap e619: 8 total, 8 up, 8 in 2021-10-08T19:40:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:17 smithi142 ceph-mon[33432]: pgmap v972: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:17.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:17.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[40655]: osdmap e619: 8 total, 8 up, 8 in 2021-10-08T19:40:17.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:17.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:17.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[40655]: pgmap v972: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:17.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:17.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-124","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[31694]: osdmap e619: 8 total, 8 up, 8 in 2021-10-08T19:40:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:17.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[31694]: pgmap v972: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 457 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:17.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:18 smithi142 ceph-mon[33432]: osdmap e620: 8 total, 8 up, 8 in 2021-10-08T19:40:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:18.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:18.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:18 smithi112 ceph-mon[40655]: osdmap e620: 8 total, 8 up, 8 in 2021-10-08T19:40:18.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:18.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:18.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:18.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:18 smithi112 ceph-mon[31694]: osdmap e620: 8 total, 8 up, 8 in 2021-10-08T19:40:18.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:18.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]': finished 2021-10-08T19:40:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: osdmap e621: 8 total, 8 up, 8 in 2021-10-08T19:40:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]: dispatch 2021-10-08T19:40:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]: dispatch 2021-10-08T19:40:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:19.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:19.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:19 smithi142 ceph-mon[33432]: pgmap v975: 204 pgs: 204 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:19.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]': finished 2021-10-08T19:40:19.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: osdmap e621: 8 total, 8 up, 8 in 2021-10-08T19:40:19.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]: dispatch 2021-10-08T19:40:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]: dispatch 2021-10-08T19:40:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:19.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:19.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:19.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:19.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[40655]: pgmap v975: 204 pgs: 204 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:19.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-124"}]': finished 2021-10-08T19:40:19.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: osdmap e621: 8 total, 8 up, 8 in 2021-10-08T19:40:19.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]: dispatch 2021-10-08T19:40:19.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]: dispatch 2021-10-08T19:40:19.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:40:19.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:40:19.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:40:19.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:19.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:19 smithi112 ceph-mon[31694]: pgmap v975: 204 pgs: 204 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]': finished 2021-10-08T19:40:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: osdmap e622: 8 total, 8 up, 8 in 2021-10-08T19:40:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: osdmap e623: 8 total, 8 up, 8 in 2021-10-08T19:40:20.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:20.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:20.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:20.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]': finished 2021-10-08T19:40:20.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: osdmap e622: 8 total, 8 up, 8 in 2021-10-08T19:40:20.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:20.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:20.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:20.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: osdmap e623: 8 total, 8 up, 8 in 2021-10-08T19:40:20.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:20.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:20.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:20.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-124", "mode": "writeback"}]': finished 2021-10-08T19:40:20.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: osdmap e622: 8 total, 8 up, 8 in 2021-10-08T19:40:20.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:20.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:20.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:20.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: osdmap e623: 8 total, 8 up, 8 in 2021-10-08T19:40:20.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:20.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]: dispatch 2021-10-08T19:40:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:21 smithi142 ceph-mon[33432]: pgmap v978: 204 pgs: 204 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:21 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:21.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]': finished 2021-10-08T19:40:21.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:21 smithi142 ceph-mon[33432]: osdmap e624: 8 total, 8 up, 8 in 2021-10-08T19:40:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:21 smithi112 ceph-mon[40655]: pgmap v978: 204 pgs: 204 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:21 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]': finished 2021-10-08T19:40:21.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:21 smithi112 ceph-mon[40655]: osdmap e624: 8 total, 8 up, 8 in 2021-10-08T19:40:21.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:21 smithi112 ceph-mon[31694]: pgmap v978: 204 pgs: 204 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:21.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:21 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:21.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-124"}]': finished 2021-10-08T19:40:21.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:21 smithi112 ceph-mon[31694]: osdmap e624: 8 total, 8 up, 8 in 2021-10-08T19:40:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:40:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:23 smithi142 ceph-mon[33432]: osdmap e625: 8 total, 8 up, 8 in 2021-10-08T19:40:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:23.526 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[40655]: osdmap e625: 8 total, 8 up, 8 in 2021-10-08T19:40:23.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:23.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:23.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:23.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:23.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[31694]: osdmap e625: 8 total, 8 up, 8 in 2021-10-08T19:40:23.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:23.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:23.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:40:23.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:40:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:23.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:23.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:23.526Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:40:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:24 smithi142 ceph-mon[33432]: pgmap v981: 172 pgs: 172 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:24 smithi142 ceph-mon[33432]: osdmap e626: 8 total, 8 up, 8 in 2021-10-08T19:40:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:24.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:24 smithi112 ceph-mon[31694]: pgmap v981: 172 pgs: 172 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:24 smithi112 ceph-mon[31694]: osdmap e626: 8 total, 8 up, 8 in 2021-10-08T19:40:24.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:24.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:24 smithi112 ceph-mon[40655]: pgmap v981: 172 pgs: 172 active+clean; 582 KiB data, 459 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:24 smithi112 ceph-mon[40655]: osdmap e626: 8 total, 8 up, 8 in 2021-10-08T19:40:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:25.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:25.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:25 smithi142 ceph-mon[33432]: osdmap e627: 8 total, 8 up, 8 in 2021-10-08T19:40:25.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:25.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:25 smithi142 ceph-mon[33432]: osdmap e628: 8 total, 8 up, 8 in 2021-10-08T19:40:25.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:25.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:25] "GET /metrics HTTP/1.1" 200 156555 "" "Prometheus/2.18.1" 2021-10-08T19:40:25.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[40655]: osdmap e627: 8 total, 8 up, 8 in 2021-10-08T19:40:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[40655]: osdmap e628: 8 total, 8 up, 8 in 2021-10-08T19:40:25.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:25.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:25.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-126","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:25.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[31694]: osdmap e627: 8 total, 8 up, 8 in 2021-10-08T19:40:25.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:25.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:25.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[31694]: osdmap e628: 8 total, 8 up, 8 in 2021-10-08T19:40:25.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:25.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:26 smithi142 ceph-mon[33432]: pgmap v984: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]': finished 2021-10-08T19:40:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:26 smithi142 ceph-mon[33432]: osdmap e629: 8 total, 8 up, 8 in 2021-10-08T19:40:26.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]: dispatch 2021-10-08T19:40:26.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]: dispatch 2021-10-08T19:40:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[31694]: pgmap v984: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:26.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]': finished 2021-10-08T19:40:26.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[31694]: osdmap e629: 8 total, 8 up, 8 in 2021-10-08T19:40:26.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]: dispatch 2021-10-08T19:40:26.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]: dispatch 2021-10-08T19:40:26.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[40655]: pgmap v984: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:26.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-126"}]': finished 2021-10-08T19:40:26.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[40655]: osdmap e629: 8 total, 8 up, 8 in 2021-10-08T19:40:26.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]: dispatch 2021-10-08T19:40:26.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]: dispatch 2021-10-08T19:40:27.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:40:26 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:40:27.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:27 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:27.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]': finished 2021-10-08T19:40:27.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:27 smithi142 ceph-mon[33432]: osdmap e630: 8 total, 8 up, 8 in 2021-10-08T19:40:27.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:27 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:27.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]': finished 2021-10-08T19:40:27.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:27 smithi112 ceph-mon[40655]: osdmap e630: 8 total, 8 up, 8 in 2021-10-08T19:40:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:27 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-126", "mode": "writeback"}]': finished 2021-10-08T19:40:27.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:27 smithi112 ceph-mon[31694]: osdmap e630: 8 total, 8 up, 8 in 2021-10-08T19:40:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:28 smithi142 ceph-mon[33432]: pgmap v987: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:28.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:28 smithi112 ceph-mon[31694]: pgmap v987: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:28.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:28 smithi112 ceph-mon[40655]: pgmap v987: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:28.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:30 smithi142 ceph-mon[33432]: pgmap v989: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 433 B/s wr, 1 op/s 2021-10-08T19:40:30.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:30 smithi112 ceph-mon[40655]: pgmap v989: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 433 B/s wr, 1 op/s 2021-10-08T19:40:30.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:30 smithi112 ceph-mon[31694]: pgmap v989: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 433 B/s wr, 1 op/s 2021-10-08T19:40:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:32 smithi142 ceph-mon[33432]: pgmap v990: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2021-10-08T19:40:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:32 smithi112 ceph-mon[40655]: pgmap v990: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2021-10-08T19:40:32.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:32 smithi112 ceph-mon[31694]: pgmap v990: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2021-10-08T19:40:33.434 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:33 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:33.435 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:33.436 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:40:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:33.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:33 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:33.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:33.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:33 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:33.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:33.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:33.526Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:33.527Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:40:34.204 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[31694]: pgmap v991: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 794 B/s rd, 264 B/s wr, 1 op/s 2021-10-08T19:40:34.205 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:34.205 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[31694]: osdmap e631: 8 total, 8 up, 8 in 2021-10-08T19:40:34.206 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:34.206 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:34 smithi142 ceph-mon[33432]: pgmap v991: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 794 B/s rd, 264 B/s wr, 1 op/s 2021-10-08T19:40:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:34 smithi142 ceph-mon[33432]: osdmap e631: 8 total, 8 up, 8 in 2021-10-08T19:40:34.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:34.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[40655]: pgmap v991: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 794 B/s rd, 264 B/s wr, 1 op/s 2021-10-08T19:40:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[40655]: osdmap e631: 8 total, 8 up, 8 in 2021-10-08T19:40:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]: dispatch 2021-10-08T19:40:35.217 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2021-10-08T19:40:35.218 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:40:35.218 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9064 ms) 2021-10-08T19:40:35.218 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2021-10-08T19:40:35.219 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:40:35.219 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6050 ms) 2021-10-08T19:40:35.219 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2021-10-08T19:40:35.220 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:40:35.220 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5027 ms) 2021-10-08T19:40:35.220 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2021-10-08T19:40:35.220 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:40:35.220 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25619 ms) 2021-10-08T19:40:35.221 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2021-10-08T19:40:35.221 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: require_osd_release = quincy 2021-10-08T19:40:35.221 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14049 ms) 2021-10-08T19:40:35.221 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2021-10-08T19:40:35.222 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12091 ms) 2021-10-08T19:40:35.222 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2021-10-08T19:40:35.222 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2021-10-08T19:40:35.222 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: 00000010 69 73 |is| 2021-10-08T19:40:35.222 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: 00000012 2021-10-08T19:40:35.223 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12096 ms) 2021-10-08T19:40:35.223 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] 47 tests from LibRadosTwoPoolsPP (549083 ms total) 2021-10-08T19:40:35.223 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: 2021-10-08T19:40:35.223 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2021-10-08T19:40:35.224 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2021-10-08T19:40:35.224 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1017 ms) 2021-10-08T19:40:35.224 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2021-10-08T19:40:35.224 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11035 ms) 2021-10-08T19:40:35.224 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2021-10-08T19:40:35.225 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18119 ms) 2021-10-08T19:40:35.225 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2021-10-08T19:40:35.225 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (2 ms) 2021-10-08T19:40:35.225 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30173 ms total) 2021-10-08T19:40:35.226 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: 2021-10-08T19:40:35.226 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2021-10-08T19:40:35.226 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2021-10-08T19:40:35.226 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7052 ms) 2021-10-08T19:40:35.226 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2021-10-08T19:40:35.227 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8060 ms) 2021-10-08T19:40:35.227 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2021-10-08T19:40:35.227 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: waiting for scrub... 2021-10-08T19:40:35.227 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: done waiting 2021-10-08T19:40:35.227 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24460 ms) 2021-10-08T19:40:35.228 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2021-10-08T19:40:35.228 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (10026 ms) 2021-10-08T19:40:35.228 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2021-10-08T19:40:35.228 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (7993 ms) 2021-10-08T19:40:35.229 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2021-10-08T19:40:35.229 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8079 ms) 2021-10-08T19:40:35.229 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2021-10-08T19:40:35.229 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10073 ms) 2021-10-08T19:40:35.229 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2021-10-08T19:40:35.230 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7813 ms) 2021-10-08T19:40:35.230 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2021-10-08T19:40:35.230 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13060 ms) 2021-10-08T19:40:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:35 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]': finished 2021-10-08T19:40:35.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:35 smithi142 ceph-mon[33432]: osdmap e632: 8 total, 8 up, 8 in 2021-10-08T19:40:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:35] "GET /metrics HTTP/1.1" 200 156555 "" "Prometheus/2.18.1" 2021-10-08T19:40:35.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:35 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:35.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]': finished 2021-10-08T19:40:35.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:35 smithi112 ceph-mon[40655]: osdmap e632: 8 total, 8 up, 8 in 2021-10-08T19:40:35.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:35 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:35.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-126"}]': finished 2021-10-08T19:40:35.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:35 smithi112 ceph-mon[31694]: osdmap e632: 8 total, 8 up, 8 in 2021-10-08T19:40:36.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:36 smithi142 ceph-mon[33432]: pgmap v994: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 265 B/s wr, 1 op/s 2021-10-08T19:40:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:36 smithi142 ceph-mon[33432]: osdmap e633: 8 total, 8 up, 8 in 2021-10-08T19:40:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:36 smithi112 ceph-mon[40655]: pgmap v994: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 265 B/s wr, 1 op/s 2021-10-08T19:40:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:36 smithi112 ceph-mon[40655]: osdmap e633: 8 total, 8 up, 8 in 2021-10-08T19:40:36.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:36 smithi112 ceph-mon[31694]: pgmap v994: 204 pgs: 204 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 265 B/s wr, 1 op/s 2021-10-08T19:40:36.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:36 smithi112 ceph-mon[31694]: osdmap e633: 8 total, 8 up, 8 in 2021-10-08T19:40:37.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:40:36 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:40:37.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:37 smithi142 ceph-mon[33432]: osdmap e634: 8 total, 8 up, 8 in 2021-10-08T19:40:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:37.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:37 smithi112 ceph-mon[40655]: osdmap e634: 8 total, 8 up, 8 in 2021-10-08T19:40:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:37.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:37.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:37 smithi112 ceph-mon[31694]: osdmap e634: 8 total, 8 up, 8 in 2021-10-08T19:40:37.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:37.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:38 smithi142 ceph-mon[33432]: pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:38 smithi142 ceph-mon[33432]: osdmap e635: 8 total, 8 up, 8 in 2021-10-08T19:40:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:38 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:38.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:38 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[40655]: pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[40655]: osdmap e635: 8 total, 8 up, 8 in 2021-10-08T19:40:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[31694]: pgmap v997: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 465 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-128","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[31694]: osdmap e635: 8 total, 8 up, 8 in 2021-10-08T19:40:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:38.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:38 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:39.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:39.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:39 smithi142 ceph-mon[33432]: osdmap e636: 8 total, 8 up, 8 in 2021-10-08T19:40:39.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:39.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:39.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]': finished 2021-10-08T19:40:39.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:39 smithi142 ceph-mon[33432]: osdmap e637: 8 total, 8 up, 8 in 2021-10-08T19:40:39.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[31694]: osdmap e636: 8 total, 8 up, 8 in 2021-10-08T19:40:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]': finished 2021-10-08T19:40:39.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[31694]: osdmap e637: 8 total, 8 up, 8 in 2021-10-08T19:40:39.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:39.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[40655]: osdmap e636: 8 total, 8 up, 8 in 2021-10-08T19:40:39.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:39.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:39.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-128"}]': finished 2021-10-08T19:40:39.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:39 smithi112 ceph-mon[40655]: osdmap e637: 8 total, 8 up, 8 in 2021-10-08T19:40:40.233 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:39 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:40:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:40.235 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[31694]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:40.235 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]: dispatch 2021-10-08T19:40:40.236 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]: dispatch 2021-10-08T19:40:40.236 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:40.236 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:40.236 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]': finished 2021-10-08T19:40:40.236 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[31694]: osdmap e638: 8 total, 8 up, 8 in 2021-10-08T19:40:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:40 smithi142 ceph-mon[33432]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]: dispatch 2021-10-08T19:40:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]: dispatch 2021-10-08T19:40:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:40 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:40 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]': finished 2021-10-08T19:40:40.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:40 smithi142 ceph-mon[33432]: osdmap e638: 8 total, 8 up, 8 in 2021-10-08T19:40:40.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:40 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:40:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[40655]: pgmap v1000: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:40:40.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]: dispatch 2021-10-08T19:40:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]: dispatch 2021-10-08T19:40:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-128", "mode": "writeback"}]': finished 2021-10-08T19:40:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:40 smithi112 ceph-mon[40655]: osdmap e638: 8 total, 8 up, 8 in 2021-10-08T19:40:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:41 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:40:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:41 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:40:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:41 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:40:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:40:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:41.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:41.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:40:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:40:39] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:41.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:41.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:41 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:40:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:42 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:40:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:42 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:40:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:42 smithi142 ceph-mon[33432]: pgmap v1003: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:42 smithi142 ceph-mon[33432]: osdmap e639: 8 total, 8 up, 8 in 2021-10-08T19:40:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:42.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:40:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:40:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[40655]: pgmap v1003: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:42.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:42.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[40655]: osdmap e639: 8 total, 8 up, 8 in 2021-10-08T19:40:42.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:42.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:40:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:40:40] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:40:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[31694]: pgmap v1003: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:40:42.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:42.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[31694]: osdmap e639: 8 total, 8 up, 8 in 2021-10-08T19:40:42.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:42.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]: dispatch 2021-10-08T19:40:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:40:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:43.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:43 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]': finished 2021-10-08T19:40:43.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:43 smithi142 ceph-mon[33432]: osdmap e640: 8 total, 8 up, 8 in 2021-10-08T19:40:43.527 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:43 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:43.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]': finished 2021-10-08T19:40:43.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:43 smithi112 ceph-mon[40655]: osdmap e640: 8 total, 8 up, 8 in 2021-10-08T19:40:43.528 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:43 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:43.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-128"}]': finished 2021-10-08T19:40:43.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:43 smithi112 ceph-mon[31694]: osdmap e640: 8 total, 8 up, 8 in 2021-10-08T19:40:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:43.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:43.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:43.527Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:40:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:44 smithi142 ceph-mon[33432]: pgmap v1006: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:44 smithi142 ceph-mon[33432]: osdmap e641: 8 total, 8 up, 8 in 2021-10-08T19:40:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:44 smithi112 ceph-mon[40655]: pgmap v1006: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:44.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:44 smithi112 ceph-mon[40655]: osdmap e641: 8 total, 8 up, 8 in 2021-10-08T19:40:44.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:44 smithi112 ceph-mon[31694]: pgmap v1006: 204 pgs: 204 active+clean; 582 KiB data, 467 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:44.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:44 smithi112 ceph-mon[31694]: osdmap e641: 8 total, 8 up, 8 in 2021-10-08T19:40:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:45] "GET /metrics HTTP/1.1" 200 157657 "" "Prometheus/2.18.1" 2021-10-08T19:40:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[31694]: osdmap e642: 8 total, 8 up, 8 in 2021-10-08T19:40:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:45.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[31694]: osdmap e643: 8 total, 8 up, 8 in 2021-10-08T19:40:45.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:45.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[40655]: osdmap e642: 8 total, 8 up, 8 in 2021-10-08T19:40:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:45.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[40655]: osdmap e643: 8 total, 8 up, 8 in 2021-10-08T19:40:45.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:45.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:45 smithi142 ceph-mon[33432]: osdmap e642: 8 total, 8 up, 8 in 2021-10-08T19:40:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-130","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:45 smithi142 ceph-mon[33432]: osdmap e643: 8 total, 8 up, 8 in 2021-10-08T19:40:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:45.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[40655]: pgmap v1009: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:46.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[40655]: osdmap e644: 8 total, 8 up, 8 in 2021-10-08T19:40:46.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:46.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:46.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[31694]: pgmap v1009: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:46.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:46.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[31694]: osdmap e644: 8 total, 8 up, 8 in 2021-10-08T19:40:46.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:46.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:46 smithi142 ceph-mon[33432]: pgmap v1009: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:40:46.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:46 smithi142 ceph-mon[33432]: osdmap e644: 8 total, 8 up, 8 in 2021-10-08T19:40:46.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:46 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:46.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:47.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:40:46 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:40:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:48 smithi142 ceph-mon[33432]: pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:48.603 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:48.604 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:48.604 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:48 smithi142 ceph-mon[33432]: osdmap e645: 8 total, 8 up, 8 in 2021-10-08T19:40:48.604 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]: dispatch 2021-10-08T19:40:48.604 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]: dispatch 2021-10-08T19:40:48.606 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[40655]: pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:48.606 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:48.607 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:48.607 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[40655]: osdmap e645: 8 total, 8 up, 8 in 2021-10-08T19:40:48.607 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]: dispatch 2021-10-08T19:40:48.607 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]: dispatch 2021-10-08T19:40:48.608 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[31694]: pgmap v1012: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 468 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:48.608 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:48.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:48.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[31694]: osdmap e645: 8 total, 8 up, 8 in 2021-10-08T19:40:48.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]: dispatch 2021-10-08T19:40:48.609 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]: dispatch 2021-10-08T19:40:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:49 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:49.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:49 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]': finished 2021-10-08T19:40:49.579 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:49 smithi112 ceph-mon[40655]: osdmap e646: 8 total, 8 up, 8 in 2021-10-08T19:40:49.579 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:49 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:49.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:49 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]': finished 2021-10-08T19:40:49.580 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:49 smithi112 ceph-mon[31694]: osdmap e646: 8 total, 8 up, 8 in 2021-10-08T19:40:49.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:49 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:40:49.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:49 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-130", "mode": "writeback"}]': finished 2021-10-08T19:40:49.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:49 smithi142 ceph-mon[33432]: osdmap e646: 8 total, 8 up, 8 in 2021-10-08T19:40:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:50 smithi112 ceph-mon[40655]: pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:50 smithi112 ceph-mon[40655]: osdmap e647: 8 total, 8 up, 8 in 2021-10-08T19:40:50.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:50 smithi112 ceph-mon[31694]: pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:50.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:50 smithi112 ceph-mon[31694]: osdmap e647: 8 total, 8 up, 8 in 2021-10-08T19:40:50.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:50 smithi142 ceph-mon[33432]: pgmap v1015: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:50.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:50 smithi142 ceph-mon[33432]: osdmap e647: 8 total, 8 up, 8 in 2021-10-08T19:40:51.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:51 smithi112 ceph-mon[40655]: osdmap e648: 8 total, 8 up, 8 in 2021-10-08T19:40:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:51 smithi112 ceph-mon[31694]: osdmap e648: 8 total, 8 up, 8 in 2021-10-08T19:40:51.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:51.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:51 smithi142 ceph-mon[33432]: osdmap e648: 8 total, 8 up, 8 in 2021-10-08T19:40:51.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:51.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[40655]: pgmap v1018: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[40655]: osdmap e649: 8 total, 8 up, 8 in 2021-10-08T19:40:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[31694]: pgmap v1018: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[31694]: osdmap e649: 8 total, 8 up, 8 in 2021-10-08T19:40:52.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:52.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:52 smithi142 ceph-mon[33432]: pgmap v1018: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:40:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:52.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:52 smithi142 ceph-mon[33432]: osdmap e649: 8 total, 8 up, 8 in 2021-10-08T19:40:52.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:52.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:40:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:40:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:53 smithi142 ceph-mon[33432]: osdmap e650: 8 total, 8 up, 8 in 2021-10-08T19:40:53.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:53.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:53 smithi112 ceph-mon[40655]: osdmap e650: 8 total, 8 up, 8 in 2021-10-08T19:40:53.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:53.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:53 smithi112 ceph-mon[31694]: osdmap e650: 8 total, 8 up, 8 in 2021-10-08T19:40:53.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:53.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:53.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:53.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:40:53.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:40:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:40:53.527Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:40:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:54 smithi112 ceph-mon[40655]: pgmap v1021: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:54 smithi112 ceph-mon[40655]: osdmap e651: 8 total, 8 up, 8 in 2021-10-08T19:40:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:54.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:54 smithi112 ceph-mon[31694]: pgmap v1021: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:54.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:54 smithi112 ceph-mon[31694]: osdmap e651: 8 total, 8 up, 8 in 2021-10-08T19:40:54.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:54.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:54.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:54 smithi142 ceph-mon[33432]: pgmap v1021: 204 pgs: 204 active+clean; 582 KiB data, 474 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:40:54.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:54 smithi142 ceph-mon[33432]: osdmap e651: 8 total, 8 up, 8 in 2021-10-08T19:40:54.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:54.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:40:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:40:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:40:55] "GET /metrics HTTP/1.1" 200 157717 "" "Prometheus/2.18.1" 2021-10-08T19:40:55.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[40655]: osdmap e652: 8 total, 8 up, 8 in 2021-10-08T19:40:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[40655]: pgmap v1024: 204 pgs: 204 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:40:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[31694]: osdmap e652: 8 total, 8 up, 8 in 2021-10-08T19:40:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:55.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:55 smithi112 ceph-mon[31694]: pgmap v1024: 204 pgs: 204 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:40:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:40:55.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:55 smithi142 ceph-mon[33432]: osdmap e652: 8 total, 8 up, 8 in 2021-10-08T19:40:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]: dispatch 2021-10-08T19:40:55.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:55 smithi142 ceph-mon[33432]: pgmap v1024: 204 pgs: 204 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-10-08T19:40:56.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:56 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:56.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:56 smithi142 ceph-mon[33432]: osdmap e653: 8 total, 8 up, 8 in 2021-10-08T19:40:56.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:56 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:56.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:56.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:56 smithi112 ceph-mon[40655]: osdmap e653: 8 total, 8 up, 8 in 2021-10-08T19:40:56.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:56 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:40:56.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-130"}]': finished 2021-10-08T19:40:56.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:56 smithi112 ceph-mon[31694]: osdmap e653: 8 total, 8 up, 8 in 2021-10-08T19:40:57.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:40:56 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:40:57.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:57 smithi142 ceph-mon[33432]: osdmap e654: 8 total, 8 up, 8 in 2021-10-08T19:40:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:57 smithi142 ceph-mon[33432]: pgmap v1027: 172 pgs: 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:40:57.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:57 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:57.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:57 smithi112 ceph-mon[40655]: osdmap e654: 8 total, 8 up, 8 in 2021-10-08T19:40:57.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:57 smithi112 ceph-mon[40655]: pgmap v1027: 172 pgs: 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:40:57.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:57 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:57.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:57 smithi112 ceph-mon[31694]: osdmap e654: 8 total, 8 up, 8 in 2021-10-08T19:40:57.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:57 smithi112 ceph-mon[31694]: pgmap v1027: 172 pgs: 172 active+clean; 582 KiB data, 475 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-10-08T19:40:57.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:57 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:40:58.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:58 smithi142 ceph-mon[33432]: osdmap e655: 8 total, 8 up, 8 in 2021-10-08T19:40:58.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:58.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:58.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:58 smithi112 ceph-mon[40655]: osdmap e655: 8 total, 8 up, 8 in 2021-10-08T19:40:58.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:58.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:58.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:58 smithi112 ceph-mon[31694]: osdmap e655: 8 total, 8 up, 8 in 2021-10-08T19:40:58.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:58.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:40:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:59 smithi142 ceph-mon[33432]: osdmap e656: 8 total, 8 up, 8 in 2021-10-08T19:40:59.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:59.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:40:59 smithi142 ceph-mon[33432]: pgmap v1030: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:40:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[40655]: osdmap e656: 8 total, 8 up, 8 in 2021-10-08T19:40:59.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:59.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[40655]: pgmap v1030: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:40:59.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-132","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:40:59.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[31694]: osdmap e656: 8 total, 8 up, 8 in 2021-10-08T19:40:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:40:59.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:40:59 smithi112 ceph-mon[31694]: pgmap v1030: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-10-08T19:41:00.357 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:00.357 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[31694]: osdmap e657: 8 total, 8 up, 8 in 2021-10-08T19:41:00.357 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:00.358 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:00.358 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]': finished 2021-10-08T19:41:00.358 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[31694]: osdmap e658: 8 total, 8 up, 8 in 2021-10-08T19:41:00.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]: dispatch 2021-10-08T19:41:00.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]: dispatch 2021-10-08T19:41:00.632 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:00.633 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:00 smithi142 ceph-mon[33432]: osdmap e657: 8 total, 8 up, 8 in 2021-10-08T19:41:00.633 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:00.634 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:00.636 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]': finished 2021-10-08T19:41:00.636 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:00 smithi142 ceph-mon[33432]: osdmap e658: 8 total, 8 up, 8 in 2021-10-08T19:41:00.637 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]: dispatch 2021-10-08T19:41:00.637 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]: dispatch 2021-10-08T19:41:00.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:00.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[40655]: osdmap e657: 8 total, 8 up, 8 in 2021-10-08T19:41:00.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-132"}]': finished 2021-10-08T19:41:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[40655]: osdmap e658: 8 total, 8 up, 8 in 2021-10-08T19:41:00.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]: dispatch 2021-10-08T19:41:00.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]: dispatch 2021-10-08T19:41:01.644 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[40655]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:01.644 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:01.644 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]': finished 2021-10-08T19:41:01.645 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[40655]: osdmap e659: 8 total, 8 up, 8 in 2021-10-08T19:41:01.645 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:01.645 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:01.645 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[31694]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:01.646 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:01.646 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]': finished 2021-10-08T19:41:01.646 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[31694]: osdmap e659: 8 total, 8 up, 8 in 2021-10-08T19:41:01.646 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:01.647 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:01 smithi142 ceph-mon[33432]: pgmap v1033: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:01 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-132", "mode": "writeback"}]': finished 2021-10-08T19:41:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:01 smithi142 ceph-mon[33432]: osdmap e659: 8 total, 8 up, 8 in 2021-10-08T19:41:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:03 smithi142 ceph-mon[33432]: osdmap e660: 8 total, 8 up, 8 in 2021-10-08T19:41:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:03.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:03.525 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:41:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:03.529 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:03.529 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:03 smithi112 ceph-mon[40655]: osdmap e660: 8 total, 8 up, 8 in 2021-10-08T19:41:03.529 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:03.530 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:03.530 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:03.531 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:03 smithi112 ceph-mon[31694]: osdmap e660: 8 total, 8 up, 8 in 2021-10-08T19:41:03.531 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:03.531 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]: dispatch 2021-10-08T19:41:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:03.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:03.527Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:03.527Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:41:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:04 smithi142 ceph-mon[33432]: pgmap v1036: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:04 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:04.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]': finished 2021-10-08T19:41:04.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:04 smithi142 ceph-mon[33432]: osdmap e661: 8 total, 8 up, 8 in 2021-10-08T19:41:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:04 smithi112 ceph-mon[40655]: pgmap v1036: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:04 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:04.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]': finished 2021-10-08T19:41:04.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:04 smithi112 ceph-mon[40655]: osdmap e661: 8 total, 8 up, 8 in 2021-10-08T19:41:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:04 smithi112 ceph-mon[31694]: pgmap v1036: 204 pgs: 204 active+clean; 582 KiB data, 469 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:04.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:04 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-132"}]': finished 2021-10-08T19:41:04.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:04 smithi112 ceph-mon[31694]: osdmap e661: 8 total, 8 up, 8 in 2021-10-08T19:41:05.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:05 smithi142 ceph-mon[33432]: osdmap e662: 8 total, 8 up, 8 in 2021-10-08T19:41:05.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:05 smithi112 ceph-mon[40655]: osdmap e662: 8 total, 8 up, 8 in 2021-10-08T19:41:05.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:05 smithi112 ceph-mon[31694]: osdmap e662: 8 total, 8 up, 8 in 2021-10-08T19:41:05.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:05] "GET /metrics HTTP/1.1" 200 157717 "" "Prometheus/2.18.1" 2021-10-08T19:41:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:06 smithi142 ceph-mon[33432]: pgmap v1039: 172 pgs: 172 active+clean; 582 KiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:41:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:06 smithi142 ceph-mon[33432]: osdmap e663: 8 total, 8 up, 8 in 2021-10-08T19:41:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:06.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:06.565 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:06 smithi112 ceph-mon[40655]: pgmap v1039: 172 pgs: 172 active+clean; 582 KiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:41:06.565 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:06 smithi112 ceph-mon[40655]: osdmap e663: 8 total, 8 up, 8 in 2021-10-08T19:41:06.566 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:06.566 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:06.567 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:06 smithi112 ceph-mon[31694]: pgmap v1039: 172 pgs: 172 active+clean; 582 KiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:41:06.567 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:06 smithi112 ceph-mon[31694]: osdmap e663: 8 total, 8 up, 8 in 2021-10-08T19:41:06.567 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:06.567 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:06.821 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:06 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:41:06] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:07.279 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:41:06 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:41:07.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:07.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:07 smithi142 ceph-mon[33432]: osdmap e664: 8 total, 8 up, 8 in 2021-10-08T19:41:07.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:07.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:07.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:07 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:07.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:07.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[40655]: osdmap e664: 8 total, 8 up, 8 in 2021-10-08T19:41:07.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:07.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:07.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:07.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-134","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:07.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[31694]: osdmap e664: 8 total, 8 up, 8 in 2021-10-08T19:41:07.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:07.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:07.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:07 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:08.206 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:07 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:41:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:41:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:41:06] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: pgmap v1042: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:41:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: osdmap e665: 8 total, 8 up, 8 in 2021-10-08T19:41:08.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:08.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:08.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:08 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:41:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:41:06] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: pgmap v1042: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:41:08.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: osdmap e665: 8 total, 8 up, 8 in 2021-10-08T19:41:08.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:08.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:08.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:08.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:41:08.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:41:06] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:08.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: pgmap v1042: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 470 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-10-08T19:41:08.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:08.577 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:08.578 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: osdmap e665: 8 total, 8 up, 8 in 2021-10-08T19:41:08.581 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:08.582 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:08.583 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:08 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:09.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:09 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:41:09.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:09 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:41:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:09.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]': finished 2021-10-08T19:41:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:09 smithi142 ceph-mon[33432]: osdmap e666: 8 total, 8 up, 8 in 2021-10-08T19:41:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]: dispatch 2021-10-08T19:41:09.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]: dispatch 2021-10-08T19:41:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:41:09.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:41:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]': finished 2021-10-08T19:41:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[40655]: osdmap e666: 8 total, 8 up, 8 in 2021-10-08T19:41:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]: dispatch 2021-10-08T19:41:09.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]: dispatch 2021-10-08T19:41:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:41:09.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:41:07] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:09.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-134"}]': finished 2021-10-08T19:41:09.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[31694]: osdmap e666: 8 total, 8 up, 8 in 2021-10-08T19:41:09.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]: dispatch 2021-10-08T19:41:09.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]: dispatch 2021-10-08T19:41:10.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:10 smithi142 ceph-mon[33432]: pgmap v1045: 204 pgs: 204 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:10.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:10 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:10.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]': finished 2021-10-08T19:41:10.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:10 smithi142 ceph-mon[33432]: osdmap e667: 8 total, 8 up, 8 in 2021-10-08T19:41:10.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:10.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:10 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[40655]: pgmap v1045: 204 pgs: 204 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]': finished 2021-10-08T19:41:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[40655]: osdmap e667: 8 total, 8 up, 8 in 2021-10-08T19:41:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:10.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[31694]: pgmap v1045: 204 pgs: 204 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-134", "mode": "writeback"}]': finished 2021-10-08T19:41:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[31694]: osdmap e667: 8 total, 8 up, 8 in 2021-10-08T19:41:10.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:10.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:10 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:11.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:11.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:11 smithi142 ceph-mon[33432]: osdmap e668: 8 total, 8 up, 8 in 2021-10-08T19:41:11.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:11.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:11.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:11.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:11 smithi112 ceph-mon[40655]: osdmap e668: 8 total, 8 up, 8 in 2021-10-08T19:41:11.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:11.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:11.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:11.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:11 smithi112 ceph-mon[31694]: osdmap e668: 8 total, 8 up, 8 in 2021-10-08T19:41:11.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:11.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]: dispatch 2021-10-08T19:41:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:12 smithi142 ceph-mon[33432]: pgmap v1048: 204 pgs: 204 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:12.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:12 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:12.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]': finished 2021-10-08T19:41:12.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:12 smithi142 ceph-mon[33432]: osdmap e669: 8 total, 8 up, 8 in 2021-10-08T19:41:12.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:12 smithi112 ceph-mon[40655]: pgmap v1048: 204 pgs: 204 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:12.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:12 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:12.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]': finished 2021-10-08T19:41:12.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:12 smithi112 ceph-mon[40655]: osdmap e669: 8 total, 8 up, 8 in 2021-10-08T19:41:12.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:12 smithi112 ceph-mon[31694]: pgmap v1048: 204 pgs: 204 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:12.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:12 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:12.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-134"}]': finished 2021-10-08T19:41:12.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:12 smithi112 ceph-mon[31694]: osdmap e669: 8 total, 8 up, 8 in 2021-10-08T19:41:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:13 smithi142 ceph-mon[33432]: osdmap e670: 8 total, 8 up, 8 in 2021-10-08T19:41:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:41:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:13.528 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:13 smithi112 ceph-mon[40655]: osdmap e670: 8 total, 8 up, 8 in 2021-10-08T19:41:13.529 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:13 smithi112 ceph-mon[31694]: osdmap e670: 8 total, 8 up, 8 in 2021-10-08T19:41:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:13.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:13.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:13.528Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:41:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:14 smithi142 ceph-mon[33432]: pgmap v1051: 172 pgs: 172 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:14 smithi142 ceph-mon[33432]: osdmap e671: 8 total, 8 up, 8 in 2021-10-08T19:41:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:14.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:14 smithi112 ceph-mon[31694]: pgmap v1051: 172 pgs: 172 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:14.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:14 smithi112 ceph-mon[31694]: osdmap e671: 8 total, 8 up, 8 in 2021-10-08T19:41:14.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:14.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:14 smithi112 ceph-mon[40655]: pgmap v1051: 172 pgs: 172 active+clean; 582 KiB data, 472 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:14 smithi112 ceph-mon[40655]: osdmap e671: 8 total, 8 up, 8 in 2021-10-08T19:41:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:14.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:15 smithi142 ceph-mon[33432]: osdmap e672: 8 total, 8 up, 8 in 2021-10-08T19:41:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:15.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:15 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:15.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:15] "GET /metrics HTTP/1.1" 200 157653 "" "Prometheus/2.18.1" 2021-10-08T19:41:15.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:15.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:15 smithi112 ceph-mon[31694]: osdmap e672: 8 total, 8 up, 8 in 2021-10-08T19:41:15.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:15.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:15 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:15.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-136","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:15.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:15 smithi112 ceph-mon[40655]: osdmap e672: 8 total, 8 up, 8 in 2021-10-08T19:41:15.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:15.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:15 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:16 smithi142 ceph-mon[33432]: pgmap v1054: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 479 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:41:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:16 smithi142 ceph-mon[33432]: osdmap e673: 8 total, 8 up, 8 in 2021-10-08T19:41:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:16.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:16.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[40655]: pgmap v1054: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 479 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:41:16.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:16.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[40655]: osdmap e673: 8 total, 8 up, 8 in 2021-10-08T19:41:16.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:16.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:16.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[31694]: pgmap v1054: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 479 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:41:16.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:16.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[31694]: osdmap e673: 8 total, 8 up, 8 in 2021-10-08T19:41:16.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:16.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:17.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:41:16 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:41:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:17 smithi112 ceph-mon[40655]: osdmap e674: 8 total, 8 up, 8 in 2021-10-08T19:41:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:17.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:17.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:17.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:17 smithi112 ceph-mon[31694]: osdmap e674: 8 total, 8 up, 8 in 2021-10-08T19:41:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:17 smithi142 ceph-mon[33432]: osdmap e674: 8 total, 8 up, 8 in 2021-10-08T19:41:17.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:17.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[40655]: pgmap v1057: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 479 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:41:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[40655]: osdmap e675: 8 total, 8 up, 8 in 2021-10-08T19:41:18.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:41:18.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:41:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[31694]: pgmap v1057: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 479 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:41:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:18.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:18.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[31694]: osdmap e675: 8 total, 8 up, 8 in 2021-10-08T19:41:18.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:41:18.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:41:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:18 smithi142 ceph-mon[33432]: pgmap v1057: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 479 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2021-10-08T19:41:18.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:18 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:18 smithi142 ceph-mon[33432]: osdmap e675: 8 total, 8 up, 8 in 2021-10-08T19:41:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:41:18.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]: dispatch 2021-10-08T19:41:19.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:41:19.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[40655]: osdmap e676: 8 total, 8 up, 8 in 2021-10-08T19:41:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:19.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:41:19.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[31694]: osdmap e676: 8 total, 8 up, 8 in 2021-10-08T19:41:19.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:19.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:19.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:19.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-136","var": "hit_set_type","val": "explicit_object"}]': finished 2021-10-08T19:41:19.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:19 smithi142 ceph-mon[33432]: osdmap e676: 8 total, 8 up, 8 in 2021-10-08T19:41:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:41:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:41:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:41:19.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[40655]: pgmap v1060: 204 pgs: 204 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]: dispatch 2021-10-08T19:41:20.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]: dispatch 2021-10-08T19:41:20.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[31694]: pgmap v1060: 204 pgs: 204 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:20.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:20.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:20.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]: dispatch 2021-10-08T19:41:20.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]: dispatch 2021-10-08T19:41:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:20 smithi142 ceph-mon[33432]: pgmap v1060: 204 pgs: 204 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:20.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]: dispatch 2021-10-08T19:41:20.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]: dispatch 2021-10-08T19:41:21.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]': finished 2021-10-08T19:41:21.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:21 smithi112 ceph-mon[40655]: osdmap e677: 8 total, 8 up, 8 in 2021-10-08T19:41:21.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]': finished 2021-10-08T19:41:21.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:21 smithi112 ceph-mon[31694]: osdmap e677: 8 total, 8 up, 8 in 2021-10-08T19:41:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-136"}]': finished 2021-10-08T19:41:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:21 smithi142 ceph-mon[33432]: osdmap e677: 8 total, 8 up, 8 in 2021-10-08T19:41:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:22 smithi112 ceph-mon[40655]: pgmap v1062: 204 pgs: 204 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:22.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:22 smithi112 ceph-mon[40655]: osdmap e678: 8 total, 8 up, 8 in 2021-10-08T19:41:22.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:22 smithi112 ceph-mon[31694]: pgmap v1062: 204 pgs: 204 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:22.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:22 smithi112 ceph-mon[31694]: osdmap e678: 8 total, 8 up, 8 in 2021-10-08T19:41:22.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:22 smithi142 ceph-mon[33432]: pgmap v1062: 204 pgs: 204 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:22.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:22 smithi142 ceph-mon[33432]: osdmap e678: 8 total, 8 up, 8 in 2021-10-08T19:41:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:41:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:23 smithi142 ceph-mon[33432]: osdmap e679: 8 total, 8 up, 8 in 2021-10-08T19:41:23.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:23.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:23.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:23.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:23.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:23.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:23.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:23.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:23.528Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:41:23.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[40655]: osdmap e679: 8 total, 8 up, 8 in 2021-10-08T19:41:23.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:23.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:23.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:23.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:23.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:23.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:23.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[31694]: osdmap e679: 8 total, 8 up, 8 in 2021-10-08T19:41:23.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:41:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:41:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[40655]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[40655]: osdmap e680: 8 total, 8 up, 8 in 2021-10-08T19:41:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:24.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[31694]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:24.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:24.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[31694]: osdmap e680: 8 total, 8 up, 8 in 2021-10-08T19:41:24.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:24.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:24.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:24 smithi142 ceph-mon[33432]: pgmap v1065: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:41:24.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-138","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:24.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:24 smithi142 ceph-mon[33432]: osdmap e680: 8 total, 8 up, 8 in 2021-10-08T19:41:24.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:24.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:25.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:25.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:25 smithi112 ceph-mon[31694]: osdmap e681: 8 total, 8 up, 8 in 2021-10-08T19:41:25.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:25 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:41:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:41:25.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:25] "GET /metrics HTTP/1.1" 200 157660 "" "Prometheus/2.18.1" 2021-10-08T19:41:25.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:25.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:25 smithi112 ceph-mon[40655]: osdmap e681: 8 total, 8 up, 8 in 2021-10-08T19:41:25.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:25 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:41:25.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:41:25.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:25.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:25 smithi142 ceph-mon[33432]: osdmap e681: 8 total, 8 up, 8 in 2021-10-08T19:41:25.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:25 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:41:25.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]: dispatch 2021-10-08T19:41:26.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:26 smithi142 ceph-mon[33432]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 482 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:41:26.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:41:26.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:26 smithi142 ceph-mon[33432]: osdmap e682: 8 total, 8 up, 8 in 2021-10-08T19:41:26.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:26 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:41:26.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:26 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:41:26.791 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[40655]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 482 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:41:26.791 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:41:26.791 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[40655]: osdmap e682: 8 total, 8 up, 8 in 2021-10-08T19:41:26.792 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:41:26.792 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:41:26.792 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[31694]: pgmap v1068: 204 pgs: 204 active+clean; 4.4 MiB data, 482 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:41:26.792 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_count","val": "3"}]': finished 2021-10-08T19:41:26.793 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[31694]: osdmap e682: 8 total, 8 up, 8 in 2021-10-08T19:41:26.793 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:41:26.793 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:26 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]: dispatch 2021-10-08T19:41:27.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:41:27 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:41:27.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:41:27.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[40655]: osdmap e683: 8 total, 8 up, 8 in 2021-10-08T19:41:27.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:27.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:27.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[40655]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 482 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:41:27.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:27.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:41:27.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[31694]: osdmap e683: 8 total, 8 up, 8 in 2021-10-08T19:41:27.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:27.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:27.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[31694]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 482 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:41:27.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:27 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_period","val": "3"}]': finished 2021-10-08T19:41:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:27 smithi142 ceph-mon[33432]: osdmap e683: 8 total, 8 up, 8 in 2021-10-08T19:41:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:27 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:27 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:27 smithi142 ceph-mon[33432]: pgmap v1071: 204 pgs: 204 active+clean; 4.4 MiB data, 482 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:41:27.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:27 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:28.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:28 smithi142 ceph-mon[33432]: osdmap e684: 8 total, 8 up, 8 in 2021-10-08T19:41:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:28 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:41:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:28 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:41:28.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:28.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:28 smithi112 ceph-mon[40655]: osdmap e684: 8 total, 8 up, 8 in 2021-10-08T19:41:28.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:28 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:41:28.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:28 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:41:28.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:28.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:28 smithi112 ceph-mon[31694]: osdmap e684: 8 total, 8 up, 8 in 2021-10-08T19:41:28.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:28 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:41:28.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:28 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]: dispatch 2021-10-08T19:41:29.352 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:29 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:41:29.353 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:29 smithi112 ceph-mon[40655]: osdmap e685: 8 total, 8 up, 8 in 2021-10-08T19:41:29.353 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:29 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:41:29.353 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:29 smithi112 ceph-mon[31694]: osdmap e685: 8 total, 8 up, 8 in 2021-10-08T19:41:29.354 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:29 smithi112 ceph-mon[31694]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2021-10-08T19:41:29.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:29 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-138","var": "hit_set_fpp","val": ".01"}]': finished 2021-10-08T19:41:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:29 smithi142 ceph-mon[33432]: osdmap e685: 8 total, 8 up, 8 in 2021-10-08T19:41:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:29 smithi142 ceph-mon[33432]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2021-10-08T19:41:32.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:32 smithi142 ceph-mon[33432]: pgmap v1075: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 1.4 KiB/s wr, 1 op/s 2021-10-08T19:41:32.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:29 smithi112 ceph-mon[40655]: pgmap v1074: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2021-10-08T19:41:32.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:32 smithi112 ceph-mon[40655]: pgmap v1075: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 1.4 KiB/s wr, 1 op/s 2021-10-08T19:41:32.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:32 smithi112 ceph-mon[31694]: pgmap v1075: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 1.4 KiB/s wr, 1 op/s 2021-10-08T19:41:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:41:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:33.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:33 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:41:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:33.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:33.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:33.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:33.528Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:33.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:33.528Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:41:34.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:34 smithi112 ceph-mon[40655]: pgmap v1076: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 778 B/s rd, 1.2 KiB/s wr, 0 op/s 2021-10-08T19:41:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:34 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:34 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:41:34.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:34 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:41:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:34.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:34 smithi112 ceph-mon[31694]: pgmap v1076: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 778 B/s rd, 1.2 KiB/s wr, 0 op/s 2021-10-08T19:41:34.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:34 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:34.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:34 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:41:34.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:34 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:41:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:34.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:34 smithi142 ceph-mon[33432]: pgmap v1076: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 778 B/s rd, 1.2 KiB/s wr, 0 op/s 2021-10-08T19:41:34.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:34 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:34.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:34 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:41:34.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:34 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:41:33] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:35 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:41:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:35] "GET /metrics HTTP/1.1" 200 157660 "" "Prometheus/2.18.1" 2021-10-08T19:41:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:36 smithi142 ceph-mon[33432]: pgmap v1077: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2021-10-08T19:41:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:36 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:36.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:36 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:41:36.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:36 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:41:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:36.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:36 smithi112 ceph-mon[40655]: pgmap v1077: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2021-10-08T19:41:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:36 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:36.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:36 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:41:36.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:36 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:41:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:36.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:36 smithi112 ceph-mon[31694]: pgmap v1077: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.1 KiB/s wr, 2 op/s 2021-10-08T19:41:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:36 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:41:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:36 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:41:36.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:36 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:41:35] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:41:37.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:41:37 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:41:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:38 smithi142 ceph-mon[33432]: pgmap v1078: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2021-10-08T19:41:38.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:38.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:38 smithi112 ceph-mon[40655]: pgmap v1078: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2021-10-08T19:41:38.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:38.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:38 smithi112 ceph-mon[31694]: pgmap v1078: 204 pgs: 204 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2021-10-08T19:41:38.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:40 smithi142 ceph-mon[33432]: pgmap v1079: 204 pgs: 204 active+clean; 4.5 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 8.6 KiB/s wr, 2 op/s 2021-10-08T19:41:40.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:40 smithi112 ceph-mon[40655]: pgmap v1079: 204 pgs: 204 active+clean; 4.5 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 8.6 KiB/s wr, 2 op/s 2021-10-08T19:41:40.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:40 smithi112 ceph-mon[31694]: pgmap v1079: 204 pgs: 204 active+clean; 4.5 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 8.6 KiB/s wr, 2 op/s 2021-10-08T19:41:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:41.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]: dispatch 2021-10-08T19:41:41.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]: dispatch 2021-10-08T19:41:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]: dispatch 2021-10-08T19:41:41.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]: dispatch 2021-10-08T19:41:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:41.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]: dispatch 2021-10-08T19:41:41.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]: dispatch 2021-10-08T19:41:42.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:42 smithi142 ceph-mon[33432]: pgmap v1080: 204 pgs: 204 active+clean; 4.5 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 6.9 KiB/s wr, 1 op/s 2021-10-08T19:41:42.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]': finished 2021-10-08T19:41:42.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:42 smithi142 ceph-mon[33432]: osdmap e686: 8 total, 8 up, 8 in 2021-10-08T19:41:42.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:42 smithi112 ceph-mon[40655]: pgmap v1080: 204 pgs: 204 active+clean; 4.5 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 6.9 KiB/s wr, 1 op/s 2021-10-08T19:41:42.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]': finished 2021-10-08T19:41:42.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:42 smithi112 ceph-mon[40655]: osdmap e686: 8 total, 8 up, 8 in 2021-10-08T19:41:42.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:42 smithi112 ceph-mon[31694]: pgmap v1080: 204 pgs: 204 active+clean; 4.5 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 6.9 KiB/s wr, 1 op/s 2021-10-08T19:41:42.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-138"}]': finished 2021-10-08T19:41:42.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:42 smithi112 ceph-mon[31694]: osdmap e686: 8 total, 8 up, 8 in 2021-10-08T19:41:43.425 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:41:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:43 smithi142 ceph-mon[33432]: osdmap e687: 8 total, 8 up, 8 in 2021-10-08T19:41:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:43 smithi142 ceph-mon[33432]: pgmap v1083: 172 pgs: 172 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:41:43.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:43 smithi142 ceph-mon[33432]: osdmap e688: 8 total, 8 up, 8 in 2021-10-08T19:41:43.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:43 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:43.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:43 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:43.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[40655]: osdmap e687: 8 total, 8 up, 8 in 2021-10-08T19:41:43.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[40655]: pgmap v1083: 172 pgs: 172 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:41:43.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[40655]: osdmap e688: 8 total, 8 up, 8 in 2021-10-08T19:41:43.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:43.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:43.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:43.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:43.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:43.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:43.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:43.529Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:41:43.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[31694]: osdmap e687: 8 total, 8 up, 8 in 2021-10-08T19:41:43.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[31694]: pgmap v1083: 172 pgs: 172 active+clean; 4.4 MiB data, 483 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:41:43.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[31694]: osdmap e688: 8 total, 8 up, 8 in 2021-10-08T19:41:43.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:43.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:43 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:45 smithi142 ceph-mon[33432]: osdmap e689: 8 total, 8 up, 8 in 2021-10-08T19:41:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:45.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:45.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:45 smithi112 ceph-mon[40655]: osdmap e689: 8 total, 8 up, 8 in 2021-10-08T19:41:45.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-140","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:45.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:45 smithi112 ceph-mon[31694]: osdmap e689: 8 total, 8 up, 8 in 2021-10-08T19:41:45.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:45.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:45.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:45] "GET /metrics HTTP/1.1" 200 157729 "" "Prometheus/2.18.1" 2021-10-08T19:41:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:46 smithi142 ceph-mon[33432]: pgmap v1086: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:46 smithi142 ceph-mon[33432]: osdmap e690: 8 total, 8 up, 8 in 2021-10-08T19:41:46.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:46 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:46.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:46 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:46.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[31694]: pgmap v1086: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:46.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:46.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[31694]: osdmap e690: 8 total, 8 up, 8 in 2021-10-08T19:41:46.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:46.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:46.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[40655]: pgmap v1086: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:46.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:41:46.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[40655]: osdmap e690: 8 total, 8 up, 8 in 2021-10-08T19:41:46.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:46.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:46 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:47.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:41:47 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:41:47.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]': finished 2021-10-08T19:41:47.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:47 smithi142 ceph-mon[33432]: osdmap e691: 8 total, 8 up, 8 in 2021-10-08T19:41:47.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]: dispatch 2021-10-08T19:41:47.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]: dispatch 2021-10-08T19:41:47.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:47 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:47.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]': finished 2021-10-08T19:41:47.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:47 smithi142 ceph-mon[33432]: osdmap e692: 8 total, 8 up, 8 in 2021-10-08T19:41:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]': finished 2021-10-08T19:41:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[40655]: osdmap e691: 8 total, 8 up, 8 in 2021-10-08T19:41:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]: dispatch 2021-10-08T19:41:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]: dispatch 2021-10-08T19:41:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]': finished 2021-10-08T19:41:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[40655]: osdmap e692: 8 total, 8 up, 8 in 2021-10-08T19:41:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-140"}]': finished 2021-10-08T19:41:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[31694]: osdmap e691: 8 total, 8 up, 8 in 2021-10-08T19:41:47.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]: dispatch 2021-10-08T19:41:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]: dispatch 2021-10-08T19:41:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:41:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-140", "mode": "writeback"}]': finished 2021-10-08T19:41:47.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:47 smithi112 ceph-mon[31694]: osdmap e692: 8 total, 8 up, 8 in 2021-10-08T19:41:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:48 smithi142 ceph-mon[33432]: pgmap v1089: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:48.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:48.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:48 smithi142 ceph-mon[33432]: osdmap e693: 8 total, 8 up, 8 in 2021-10-08T19:41:48.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:48.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[31694]: pgmap v1089: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:48.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:48.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[31694]: osdmap e693: 8 total, 8 up, 8 in 2021-10-08T19:41:48.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:48.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:48.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[40655]: pgmap v1089: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 484 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:41:48.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:48.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:48.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:41:48.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:41:48.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[40655]: osdmap e693: 8 total, 8 up, 8 in 2021-10-08T19:41:48.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:48.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:41:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:50 smithi142 ceph-mon[33432]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:41:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:50 smithi142 ceph-mon[33432]: osdmap e694: 8 total, 8 up, 8 in 2021-10-08T19:41:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[40655]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:41:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[40655]: osdmap e694: 8 total, 8 up, 8 in 2021-10-08T19:41:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:50.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[31694]: pgmap v1092: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:41:50.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:41:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[31694]: osdmap e694: 8 total, 8 up, 8 in 2021-10-08T19:41:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:41:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:51 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:51.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:51 smithi142 ceph-mon[33432]: osdmap e695: 8 total, 8 up, 8 in 2021-10-08T19:41:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:51.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:51.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[31694]: osdmap e695: 8 total, 8 up, 8 in 2021-10-08T19:41:51.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:51.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:51.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:41:51.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:41:51.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[40655]: osdmap e695: 8 total, 8 up, 8 in 2021-10-08T19:41:51.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:51.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:41:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:52 smithi142 ceph-mon[33432]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:41:52.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:41:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:52 smithi142 ceph-mon[33432]: osdmap e696: 8 total, 8 up, 8 in 2021-10-08T19:41:52.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:52 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:41:52.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:52 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:41:52.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[40655]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:41:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:41:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[40655]: osdmap e696: 8 total, 8 up, 8 in 2021-10-08T19:41:52.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:41:52.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:41:52.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[31694]: pgmap v1095: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2021-10-08T19:41:52.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:41:52.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[31694]: osdmap e696: 8 total, 8 up, 8 in 2021-10-08T19:41:52.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:41:52.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:52 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2021-10-08T19:41:53.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:41:53.470 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:53 smithi112 ceph-mon[40655]: osdmap e697: 8 total, 8 up, 8 in 2021-10-08T19:41:53.471 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:41:53.471 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:41:53.471 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:41:53.472 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:53 smithi112 ceph-mon[31694]: osdmap e697: 8 total, 8 up, 8 in 2021-10-08T19:41:53.472 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:41:53.472 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:41:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:41:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:41:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2021-10-08T19:41:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:53 smithi142 ceph-mon[33432]: osdmap e697: 8 total, 8 up, 8 in 2021-10-08T19:41:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:41:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]: dispatch 2021-10-08T19:41:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:53.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:53.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:53.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:41:53.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:41:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:41:53.529Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:41:54.226 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[31694]: pgmap v1098: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:54.227 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:41:54.227 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[31694]: osdmap e698: 8 total, 8 up, 8 in 2021-10-08T19:41:54.227 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:54.227 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:54 smithi142 ceph-mon[33432]: pgmap v1098: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:41:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:54 smithi142 ceph-mon[33432]: osdmap e698: 8 total, 8 up, 8 in 2021-10-08T19:41:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[40655]: pgmap v1098: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:41:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-140","var": "hit_set_search_last_n","val": "1"}]': finished 2021-10-08T19:41:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[40655]: osdmap e698: 8 total, 8 up, 8 in 2021-10-08T19:41:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:54.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:55 smithi142 ceph-mon[33432]: osdmap e699: 8 total, 8 up, 8 in 2021-10-08T19:41:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:55.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:41:55] "GET /metrics HTTP/1.1" 200 157695 "" "Prometheus/2.18.1" 2021-10-08T19:41:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:55.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:55 smithi112 ceph-mon[40655]: osdmap e699: 8 total, 8 up, 8 in 2021-10-08T19:41:55.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:55.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:41:55.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:55 smithi112 ceph-mon[31694]: osdmap e699: 8 total, 8 up, 8 in 2021-10-08T19:41:55.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:55.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:56 smithi142 ceph-mon[33432]: pgmap v1101: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]': finished 2021-10-08T19:41:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:56 smithi142 ceph-mon[33432]: osdmap e700: 8 total, 8 up, 8 in 2021-10-08T19:41:56.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:56.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:56.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:56.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[40655]: pgmap v1101: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]': finished 2021-10-08T19:41:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[40655]: osdmap e700: 8 total, 8 up, 8 in 2021-10-08T19:41:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:56.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[31694]: pgmap v1101: 204 pgs: 204 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:56.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]': finished 2021-10-08T19:41:56.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[31694]: osdmap e700: 8 total, 8 up, 8 in 2021-10-08T19:41:56.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:56.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:41:56.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:56.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-140"}]: dispatch 2021-10-08T19:41:57.363 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:57 smithi142 ceph-mon[33432]: osdmap e701: 8 total, 8 up, 8 in 2021-10-08T19:41:57.363 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:41:57 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:41:57.570 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:57 smithi112 ceph-mon[40655]: osdmap e701: 8 total, 8 up, 8 in 2021-10-08T19:41:57.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:57 smithi112 ceph-mon[31694]: osdmap e701: 8 total, 8 up, 8 in 2021-10-08T19:41:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:58 smithi142 ceph-mon[33432]: pgmap v1104: 172 pgs: 172 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:58 smithi142 ceph-mon[33432]: osdmap e702: 8 total, 8 up, 8 in 2021-10-08T19:41:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[40655]: pgmap v1104: 172 pgs: 172 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[40655]: osdmap e702: 8 total, 8 up, 8 in 2021-10-08T19:41:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:58.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:58.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[31694]: pgmap v1104: 172 pgs: 172 active+clean; 4.4 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2021-10-08T19:41:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:41:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[31694]: osdmap e702: 8 total, 8 up, 8 in 2021-10-08T19:41:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:41:59.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:59.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:59 smithi142 ceph-mon[33432]: osdmap e703: 8 total, 8 up, 8 in 2021-10-08T19:41:59.528 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:59.529 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:41:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:59 smithi112 ceph-mon[40655]: osdmap e703: 8 total, 8 up, 8 in 2021-10-08T19:41:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:41:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-142","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:41:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:59 smithi112 ceph-mon[31694]: osdmap e703: 8 total, 8 up, 8 in 2021-10-08T19:41:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:41:59.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:41:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:00.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:41:59 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:41:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:00.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:00 smithi142 ceph-mon[33432]: pgmap v1107: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:42:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:00 smithi142 ceph-mon[33432]: osdmap e704: 8 total, 8 up, 8 in 2021-10-08T19:42:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:00 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:00.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:00 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[40655]: pgmap v1107: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:42:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[40655]: osdmap e704: 8 total, 8 up, 8 in 2021-10-08T19:42:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[31694]: pgmap v1107: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:42:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[31694]: osdmap e704: 8 total, 8 up, 8 in 2021-10-08T19:42:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:00.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:00 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:41:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:01.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]': finished 2021-10-08T19:42:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[40655]: osdmap e705: 8 total, 8 up, 8 in 2021-10-08T19:42:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:42:01.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:42:01.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:01.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:41:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]': finished 2021-10-08T19:42:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[31694]: osdmap e705: 8 total, 8 up, 8 in 2021-10-08T19:42:01.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:42:01.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:01 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:42:01.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:01 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:01 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:41:59] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-142"}]': finished 2021-10-08T19:42:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:01 smithi142 ceph-mon[33432]: osdmap e705: 8 total, 8 up, 8 in 2021-10-08T19:42:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:01 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:42:01.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:01 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]: dispatch 2021-10-08T19:42:02.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:02 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:42:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:02.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:02 smithi112 ceph-mon[31694]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:42:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:02 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:42:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]': finished 2021-10-08T19:42:02.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:02 smithi112 ceph-mon[31694]: osdmap e706: 8 total, 8 up, 8 in 2021-10-08T19:42:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:02 smithi112 ceph-mon[40655]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:42:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:02 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:42:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]': finished 2021-10-08T19:42:02.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:02 smithi112 ceph-mon[40655]: osdmap e706: 8 total, 8 up, 8 in 2021-10-08T19:42:02.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:02 smithi142 ceph-mon[33432]: pgmap v1110: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-10-08T19:42:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:02 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:42:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-142", "mode": "readproxy"}]': finished 2021-10-08T19:42:02.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:02 smithi142 ceph-mon[33432]: osdmap e706: 8 total, 8 up, 8 in 2021-10-08T19:42:03.440 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:42:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:03.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:03 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:03.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:03 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:03.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:03 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:42:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:03.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:03 smithi142 ceph-mon[33432]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 219 B/s wr, 1 op/s 2021-10-08T19:42:03.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:03 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:03.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:03 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:03.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:03 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:42:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:03.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:03 smithi112 ceph-mon[40655]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 219 B/s wr, 1 op/s 2021-10-08T19:42:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:03.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:03.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:03.529Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:03.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:03.529Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:42:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:03 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:03 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:03 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:42:02] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:03 smithi112 ceph-mon[31694]: pgmap v1112: 204 pgs: 204 active+clean; 4.4 MiB data, 488 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 219 B/s wr, 1 op/s 2021-10-08T19:42:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:05] "GET /metrics HTTP/1.1" 200 157695 "" "Prometheus/2.18.1" 2021-10-08T19:42:06.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:06 smithi142 ceph-mon[33432]: pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:06.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:06 smithi112 ceph-mon[31694]: pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:06.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:06 smithi112 ceph-mon[40655]: pgmap v1113: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:42:07.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:42:07 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:42:08.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:08 smithi142 ceph-mon[33432]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2021-10-08T19:42:08.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:08 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:08 smithi112 ceph-mon[40655]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2021-10-08T19:42:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:08 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:08.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:08 smithi112 ceph-mon[31694]: pgmap v1114: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2021-10-08T19:42:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:08 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:10.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:10 smithi142 ceph-mon[33432]: pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:42:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:10 smithi112 ceph-mon[40655]: pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:42:10.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:10 smithi112 ceph-mon[31694]: pgmap v1115: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-10-08T19:42:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:12 smithi142 ceph-mon[33432]: pgmap v1116: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:12.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:12.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:12 smithi112 ceph-mon[40655]: pgmap v1116: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:12.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:12.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:12.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:12 smithi112 ceph-mon[31694]: pgmap v1116: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:12.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:12.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:42:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:13.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:13 smithi142 ceph-mon[33432]: osdmap e707: 8 total, 8 up, 8 in 2021-10-08T19:42:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:13.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:13.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:13.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:13 smithi112 ceph-mon[40655]: osdmap e707: 8 total, 8 up, 8 in 2021-10-08T19:42:13.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:13.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:13.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:13.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:13 smithi112 ceph-mon[31694]: osdmap e707: 8 total, 8 up, 8 in 2021-10-08T19:42:13.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:13.534 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:13.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:13.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:13.530Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:42:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:14 smithi142 ceph-mon[33432]: pgmap v1118: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:14 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:42:14.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]': finished 2021-10-08T19:42:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:14 smithi142 ceph-mon[33432]: osdmap e708: 8 total, 8 up, 8 in 2021-10-08T19:42:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:14.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:14.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:14 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:14.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[31694]: pgmap v1118: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:14.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:42:14.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]': finished 2021-10-08T19:42:14.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[31694]: osdmap e708: 8 total, 8 up, 8 in 2021-10-08T19:42:14.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:14.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:14.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:14.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:14.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[40655]: pgmap v1118: 204 pgs: 204 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-10-08T19:42:14.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:42:14.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]': finished 2021-10-08T19:42:14.576 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[40655]: osdmap e708: 8 total, 8 up, 8 in 2021-10-08T19:42:14.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:14.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:14.577 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:14.578 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:14 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-142"}]: dispatch 2021-10-08T19:42:15.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:15 smithi142 ceph-mon[33432]: osdmap e709: 8 total, 8 up, 8 in 2021-10-08T19:42:15.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:15 smithi112 ceph-mon[31694]: osdmap e709: 8 total, 8 up, 8 in 2021-10-08T19:42:15.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:15] "GET /metrics HTTP/1.1" 200 157704 "" "Prometheus/2.18.1" 2021-10-08T19:42:15.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:15 smithi112 ceph-mon[40655]: osdmap e709: 8 total, 8 up, 8 in 2021-10-08T19:42:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:16 smithi142 ceph-mon[33432]: pgmap v1121: 172 pgs: 172 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:16 smithi142 ceph-mon[33432]: osdmap e710: 8 total, 8 up, 8 in 2021-10-08T19:42:16.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:16 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:16.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:16 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:16.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:16 smithi112 ceph-mon[31694]: pgmap v1121: 172 pgs: 172 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:16.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:16 smithi112 ceph-mon[31694]: osdmap e710: 8 total, 8 up, 8 in 2021-10-08T19:42:16.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:16 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:16.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:16 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:16.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:16 smithi112 ceph-mon[40655]: pgmap v1121: 172 pgs: 172 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:42:16.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:16 smithi112 ceph-mon[40655]: osdmap e710: 8 total, 8 up, 8 in 2021-10-08T19:42:16.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:16 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:16.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:16 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:17.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:42:17 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:42:17.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:17 smithi142 ceph-mon[33432]: osdmap e711: 8 total, 8 up, 8 in 2021-10-08T19:42:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:17.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:17.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:17 smithi142 ceph-mon[33432]: osdmap e712: 8 total, 8 up, 8 in 2021-10-08T19:42:17.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:17 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:17.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:17 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[40655]: osdmap e711: 8 total, 8 up, 8 in 2021-10-08T19:42:17.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:17.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:17.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:17.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[40655]: osdmap e712: 8 total, 8 up, 8 in 2021-10-08T19:42:17.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:17.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-144","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:17.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[31694]: osdmap e711: 8 total, 8 up, 8 in 2021-10-08T19:42:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[31694]: osdmap e712: 8 total, 8 up, 8 in 2021-10-08T19:42:17.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:17.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:17 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:18 smithi142 ceph-mon[33432]: pgmap v1124: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:18 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]': finished 2021-10-08T19:42:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:18 smithi142 ceph-mon[33432]: osdmap e713: 8 total, 8 up, 8 in 2021-10-08T19:42:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:18 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]: dispatch 2021-10-08T19:42:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:18 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]: dispatch 2021-10-08T19:42:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[40655]: pgmap v1124: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:18.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]': finished 2021-10-08T19:42:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[40655]: osdmap e713: 8 total, 8 up, 8 in 2021-10-08T19:42:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]: dispatch 2021-10-08T19:42:18.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]: dispatch 2021-10-08T19:42:18.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[31694]: pgmap v1124: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 489 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:18.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:18.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi112-83223-109", "overlaypool": "test-rados-api-smithi112-83223-144"}]': finished 2021-10-08T19:42:18.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[31694]: osdmap e713: 8 total, 8 up, 8 in 2021-10-08T19:42:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]: dispatch 2021-10-08T19:42:18.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:18 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]: dispatch 2021-10-08T19:42:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:19 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:19 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:42:19.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:19 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]': finished 2021-10-08T19:42:19.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:19 smithi142 ceph-mon[33432]: osdmap e714: 8 total, 8 up, 8 in 2021-10-08T19:42:19.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:19.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:42:19.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]': finished 2021-10-08T19:42:19.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[40655]: osdmap e714: 8 total, 8 up, 8 in 2021-10-08T19:42:19.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:42:19.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:42:19.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:42:19.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:19.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:19.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-10-08T19:42:19.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi112-83223-144", "mode": "writeback"}]': finished 2021-10-08T19:42:19.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:19 smithi112 ceph-mon[31694]: osdmap e714: 8 total, 8 up, 8 in 2021-10-08T19:42:20.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:20 smithi142 ceph-mon[33432]: poll took 540164.152 ms: 1 events 2021-10-08T19:42:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:20 smithi142 ceph-mon[33432]: pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:42:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:20 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:42:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:20 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:42:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:20 smithi112 ceph-mon[40655]: poll took 540164.152 ms: 1 events 2021-10-08T19:42:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:20 smithi112 ceph-mon[40655]: pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:42:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:20 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:42:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:20 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:42:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:20 smithi112 ceph-mon[31694]: poll took 540164.152 ms: 1 events 2021-10-08T19:42:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:20 smithi112 ceph-mon[31694]: pgmap v1127: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:42:20.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:20 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:42:20.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:20 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]: dispatch 2021-10-08T19:42:21.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:42:21.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:21 smithi112 ceph-mon[40655]: osdmap e715: 8 total, 8 up, 8 in 2021-10-08T19:42:21.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:21 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:42:21.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:21 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:42:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:42:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:21 smithi112 ceph-mon[31694]: osdmap e715: 8 total, 8 up, 8 in 2021-10-08T19:42:21.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:21 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:42:21.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:21 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:42:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_count","val": "2"}]': finished 2021-10-08T19:42:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:21 smithi142 ceph-mon[33432]: osdmap e715: 8 total, 8 up, 8 in 2021-10-08T19:42:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:21 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:42:21.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:21 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]: dispatch 2021-10-08T19:42:22.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[31694]: pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:42:22.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:42:22.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[31694]: osdmap e716: 8 total, 8 up, 8 in 2021-10-08T19:42:22.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:42:22.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:42:22.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[40655]: pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:42:22.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:42:22.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[40655]: osdmap e716: 8 total, 8 up, 8 in 2021-10-08T19:42:22.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:42:22.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:22 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:42:22.632 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:22 smithi142 ceph-mon[33432]: pgmap v1130: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2021-10-08T19:42:22.632 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_period","val": "600"}]': finished 2021-10-08T19:42:22.633 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:22 smithi142 ceph-mon[33432]: osdmap e716: 8 total, 8 up, 8 in 2021-10-08T19:42:22.633 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:22 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:42:22.633 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:22 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]: dispatch 2021-10-08T19:42:23.273 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:42:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:23.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:23.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:23.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:23.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:23.571 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:23.530Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:42:23.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:42:23.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:42:23.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: osdmap e717: 8 total, 8 up, 8 in 2021-10-08T19:42:23.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:42:23.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:42:23.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:23.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:23.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:23.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:23.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:42:23.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:42:23.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: osdmap e717: 8 total, 8 up, 8 in 2021-10-08T19:42:23.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:42:23.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:42:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:23.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:23 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:23.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-10-08T19:42:23.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "hit_set_type","val": "bloom"}]': finished 2021-10-08T19:42:23.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: osdmap e717: 8 total, 8 up, 8 in 2021-10-08T19:42:23.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:42:23.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2021-10-08T19:42:23.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:23.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:23.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:42:23.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:23 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:42:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[40655]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:42:24.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[40655]: osdmap e718: 8 total, 8 up, 8 in 2021-10-08T19:42:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:42:24.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:42:24.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[31694]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:24.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:42:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[31694]: osdmap e718: 8 total, 8 up, 8 in 2021-10-08T19:42:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:42:24.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:24 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:42:24.767 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:24 smithi142 ceph-mon[33432]: pgmap v1133: 204 pgs: 204 active+clean; 4.4 MiB data, 491 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:24.768 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "min_read_recency_for_promote","val": "1"}]': finished 2021-10-08T19:42:24.768 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:24 smithi142 ceph-mon[33432]: osdmap e718: 8 total, 8 up, 8 in 2021-10-08T19:42:24.768 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:24 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:42:24.768 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:24 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]: dispatch 2021-10-08T19:42:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:25] "GET /metrics HTTP/1.1" 200 157698 "" "Prometheus/2.18.1" 2021-10-08T19:42:25.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:25 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:42:25.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:25 smithi112 ceph-mon[40655]: osdmap e719: 8 total, 8 up, 8 in 2021-10-08T19:42:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:25 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:42:25.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:25 smithi112 ceph-mon[31694]: osdmap e719: 8 total, 8 up, 8 in 2021-10-08T19:42:25.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:25 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-144","var": "target_max_objects","val": "1"}]': finished 2021-10-08T19:42:25.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:25 smithi142 ceph-mon[33432]: osdmap e719: 8 total, 8 up, 8 in 2021-10-08T19:42:26.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:26 smithi112 ceph-mon[31694]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:42:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:26 smithi112 ceph-mon[31694]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:42:26.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:26 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:26.573 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:26 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:42:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:26.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:26 smithi112 ceph-mon[40655]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:42:26.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:26 smithi112 ceph-mon[40655]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:42:26.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:26 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:26.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:26 smithi142 ceph-mon[33432]: pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:42:26.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:26 smithi142 ceph-mon[33432]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2021-10-08T19:42:26.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:26 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:27.323 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:42:27 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:42:27.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:27 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:27.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:27 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:42:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:27.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:27 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:27.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:27 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:42:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:27.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:27 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:27.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:27 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:42:26] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:28.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:28 smithi142 ceph-mon[33432]: pgmap v1137: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:28.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:28.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:28 smithi112 ceph-mon[40655]: pgmap v1137: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:28.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:28.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:28 smithi112 ceph-mon[31694]: pgmap v1137: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:28.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:29.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:29 smithi142 ceph-mon[33432]: pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:42:29.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:29 smithi112 ceph-mon[31694]: pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:42:29.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:29 smithi112 ceph-mon[40655]: pgmap v1138: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-10-08T19:42:29.822 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:29 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:42:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:30.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:30 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:30.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:30 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:30.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:30 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:42:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:30.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:30 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:30.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:30 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:30.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:30 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:42:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:31.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:30 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:31.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:30 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:31.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:30 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:42:29] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:32.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:31 smithi142 ceph-mon[33432]: pgmap v1139: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:32.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:31 smithi112 ceph-mon[40655]: pgmap v1139: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:32.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:31 smithi112 ceph-mon[31694]: pgmap v1139: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:42:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:33.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:33.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:33.530Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:42:34.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:33 smithi142 ceph-mon[33432]: pgmap v1140: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:34.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:33 smithi112 ceph-mon[40655]: pgmap v1140: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:34.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:33 smithi112 ceph-mon[31694]: pgmap v1140: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-10-08T19:42:35.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:34 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:35.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:34 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:35.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:34 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:35.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:34 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:35.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:35] "GET /metrics HTTP/1.1" 200 157698 "" "Prometheus/2.18.1" 2021-10-08T19:42:35.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:34 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:35.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:34 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:36.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:35 smithi142 ceph-mon[33432]: pgmap v1141: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:42:36.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:36.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:35 smithi142 ceph-mon[33432]: osdmap e720: 8 total, 8 up, 8 in 2021-10-08T19:42:36.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:35 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:36.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:35 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[40655]: pgmap v1141: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:42:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[40655]: osdmap e720: 8 total, 8 up, 8 in 2021-10-08T19:42:36.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:36.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:36.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[31694]: pgmap v1141: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 B/s wr, 1 op/s 2021-10-08T19:42:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[31694]: osdmap e720: 8 total, 8 up, 8 in 2021-10-08T19:42:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:35 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:37.275 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:42:37 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:42:37.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]': finished 2021-10-08T19:42:37.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:37 smithi142 ceph-mon[33432]: osdmap e721: 8 total, 8 up, 8 in 2021-10-08T19:42:37.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:37.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:37.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:37 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:37.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:37 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:37.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]': finished 2021-10-08T19:42:37.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[31694]: osdmap e721: 8 total, 8 up, 8 in 2021-10-08T19:42:37.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:37.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:37.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:37.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:37.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]': finished 2021-10-08T19:42:37.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[40655]: osdmap e721: 8 total, 8 up, 8 in 2021-10-08T19:42:37.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:37.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:37.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:37.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:37 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-144"}]: dispatch 2021-10-08T19:42:38.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:38 smithi142 ceph-mon[33432]: pgmap v1144: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:42:38.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:38 smithi142 ceph-mon[33432]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:38.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:38 smithi142 ceph-mon[33432]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:42:38.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:38 smithi142 ceph-mon[33432]: osdmap e722: 8 total, 8 up, 8 in 2021-10-08T19:42:38.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:38.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[40655]: pgmap v1144: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:42:38.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[40655]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[40655]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:42:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[40655]: osdmap e722: 8 total, 8 up, 8 in 2021-10-08T19:42:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:38.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[31694]: pgmap v1144: 204 pgs: 204 active+clean; 4.4 MiB data, 492 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:42:38.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[31694]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:38.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[31694]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2021-10-08T19:42:38.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[31694]: osdmap e722: 8 total, 8 up, 8 in 2021-10-08T19:42:38.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:39.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:39 smithi142 ceph-mon[33432]: osdmap e723: 8 total, 8 up, 8 in 2021-10-08T19:42:39.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:39 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:39.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:39 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:39.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:39 smithi112 ceph-mon[40655]: osdmap e723: 8 total, 8 up, 8 in 2021-10-08T19:42:39.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:39 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:39.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:39 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:39.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:39 smithi112 ceph-mon[31694]: osdmap e723: 8 total, 8 up, 8 in 2021-10-08T19:42:39.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:39 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:39.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:39 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:40.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:40 smithi142 ceph-mon[33432]: pgmap v1147: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:42:40.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:40.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:40 smithi142 ceph-mon[33432]: osdmap e724: 8 total, 8 up, 8 in 2021-10-08T19:42:40.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:40 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:40.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:40 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:40.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[40655]: pgmap v1147: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:42:40.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:40.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[40655]: osdmap e724: 8 total, 8 up, 8 in 2021-10-08T19:42:40.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:40.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:40.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[31694]: pgmap v1147: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:42:40.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-146","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:40.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[31694]: osdmap e724: 8 total, 8 up, 8 in 2021-10-08T19:42:40.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:40.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:40 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]: dispatch 2021-10-08T19:42:41.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:41.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:41 smithi112 ceph-mon[40655]: osdmap e725: 8 total, 8 up, 8 in 2021-10-08T19:42:41.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:41 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:41.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:41 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:41.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:41.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:41 smithi112 ceph-mon[31694]: osdmap e725: 8 total, 8 up, 8 in 2021-10-08T19:42:41.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:41 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:41.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:41 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146", "force_nonempty": "--force-nonempty" }]': finished 2021-10-08T19:42:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:41 smithi142 ceph-mon[33432]: osdmap e725: 8 total, 8 up, 8 in 2021-10-08T19:42:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:41 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:41.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:41 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:42.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[31694]: pgmap v1150: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:42:42.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]': finished 2021-10-08T19:42:42.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[31694]: osdmap e726: 8 total, 8 up, 8 in 2021-10-08T19:42:42.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:42.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:42.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:42.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:42.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[40655]: pgmap v1150: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:42:42.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]': finished 2021-10-08T19:42:42.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[40655]: osdmap e726: 8 total, 8 up, 8 in 2021-10-08T19:42:42.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:42.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:42.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:42.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:42 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:42 smithi142 ceph-mon[33432]: pgmap v1150: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-10-08T19:42:42.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]': finished 2021-10-08T19:42:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:42 smithi142 ceph-mon[33432]: osdmap e726: 8 total, 8 up, 8 in 2021-10-08T19:42:42.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:42.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:42.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:42 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:42.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:42 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-146"}]: dispatch 2021-10-08T19:42:43.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:43 smithi112 ceph-mon[40655]: osdmap e727: 8 total, 8 up, 8 in 2021-10-08T19:42:43.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:43 smithi112 ceph-mon[31694]: osdmap e727: 8 total, 8 up, 8 in 2021-10-08T19:42:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:42:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:43.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:43 smithi142 ceph-mon[33432]: osdmap e727: 8 total, 8 up, 8 in 2021-10-08T19:42:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:43.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:43.530Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:43.530Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:42:44.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:44 smithi112 ceph-mon[31694]: pgmap v1153: 172 pgs: 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:44.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:44 smithi112 ceph-mon[31694]: osdmap e728: 8 total, 8 up, 8 in 2021-10-08T19:42:44.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:44 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:44.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:44 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:44.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:44 smithi112 ceph-mon[40655]: pgmap v1153: 172 pgs: 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:44.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:44 smithi112 ceph-mon[40655]: osdmap e728: 8 total, 8 up, 8 in 2021-10-08T19:42:44.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:44 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:44.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:44 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:44 smithi142 ceph-mon[33432]: pgmap v1153: 172 pgs: 172 active+clean; 4.4 MiB data, 493 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:44 smithi142 ceph-mon[33432]: osdmap e728: 8 total, 8 up, 8 in 2021-10-08T19:42:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:44 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:44.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:44 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:45 smithi142 ceph-mon[33432]: osdmap e729: 8 total, 8 up, 8 in 2021-10-08T19:42:45.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:45 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-148"}]: dispatch 2021-10-08T19:42:45.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:45 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-148"}]: dispatch 2021-10-08T19:42:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:45] "GET /metrics HTTP/1.1" 200 156576 "" "Prometheus/2.18.1" 2021-10-08T19:42:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:45.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[40655]: osdmap e729: 8 total, 8 up, 8 in 2021-10-08T19:42:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:45.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-148"}]: dispatch 2021-10-08T19:42:45.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-148"}]: dispatch 2021-10-08T19:42:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-148","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[31694]: osdmap e729: 8 total, 8 up, 8 in 2021-10-08T19:42:45.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:45.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:45.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-148"}]: dispatch 2021-10-08T19:42:45.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:45 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-148"}]: dispatch 2021-10-08T19:42:46.358 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:46 smithi112 ceph-mon[40655]: pgmap v1156: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:42:46.358 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:46 smithi112 ceph-mon[40655]: osdmap e730: 8 total, 8 up, 8 in 2021-10-08T19:42:46.359 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:46 smithi112 ceph-mon[40655]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:46.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:46 smithi112 ceph-mon[31694]: pgmap v1156: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:42:46.359 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:46 smithi112 ceph-mon[31694]: osdmap e730: 8 total, 8 up, 8 in 2021-10-08T19:42:46.360 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:46 smithi112 ceph-mon[31694]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:46 smithi142 ceph-mon[33432]: pgmap v1156: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:42:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:46 smithi142 ceph-mon[33432]: osdmap e730: 8 total, 8 up, 8 in 2021-10-08T19:42:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:46 smithi142 ceph-mon[33432]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:47.524 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:42:47 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:42:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:47 smithi142 ceph-mon[33432]: osdmap e731: 8 total, 8 up, 8 in 2021-10-08T19:42:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:47 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:47.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:47 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:47 smithi112 ceph-mon[40655]: osdmap e731: 8 total, 8 up, 8 in 2021-10-08T19:42:47.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:47 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:47.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:47 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:47 smithi112 ceph-mon[31694]: osdmap e731: 8 total, 8 up, 8 in 2021-10-08T19:42:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:47 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:47.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:47 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:48 smithi142 ceph-mon[33432]: pgmap v1159: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:42:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:48 smithi142 ceph-mon[33432]: osdmap e732: 8 total, 8 up, 8 in 2021-10-08T19:42:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:48.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:48.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:48 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-150"}]: dispatch 2021-10-08T19:42:48.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:48 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-150"}]: dispatch 2021-10-08T19:42:48.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[40655]: pgmap v1159: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:42:48.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:48.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:48.533 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[40655]: osdmap e732: 8 total, 8 up, 8 in 2021-10-08T19:42:48.534 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:48.534 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:48.534 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-150"}]: dispatch 2021-10-08T19:42:48.534 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-150"}]: dispatch 2021-10-08T19:42:48.535 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[31694]: pgmap v1159: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 495 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-10-08T19:42:48.535 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:48.536 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-150","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:48.537 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[31694]: osdmap e732: 8 total, 8 up, 8 in 2021-10-08T19:42:48.537 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:48.538 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:48.538 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-150"}]: dispatch 2021-10-08T19:42:48.540 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:48 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-150"}]: dispatch 2021-10-08T19:42:49.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:49 smithi142 ceph-mon[33432]: osdmap e733: 8 total, 8 up, 8 in 2021-10-08T19:42:49.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:49 smithi112 ceph-mon[40655]: osdmap e733: 8 total, 8 up, 8 in 2021-10-08T19:42:49.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:49 smithi112 ceph-mon[31694]: osdmap e733: 8 total, 8 up, 8 in 2021-10-08T19:42:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:50 smithi142 ceph-mon[33432]: pgmap v1162: 172 pgs: 172 active+clean; 4.4 MiB data, 509 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:42:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:50 smithi142 ceph-mon[33432]: osdmap e734: 8 total, 8 up, 8 in 2021-10-08T19:42:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:50 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:50.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:50 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:50 smithi112 ceph-mon[40655]: pgmap v1162: 172 pgs: 172 active+clean; 4.4 MiB data, 509 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:42:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:50 smithi112 ceph-mon[40655]: osdmap e734: 8 total, 8 up, 8 in 2021-10-08T19:42:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:50 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:50.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:50 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:50.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:50 smithi112 ceph-mon[31694]: pgmap v1162: 172 pgs: 172 active+clean; 4.4 MiB data, 509 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:42:50.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:50 smithi112 ceph-mon[31694]: osdmap e734: 8 total, 8 up, 8 in 2021-10-08T19:42:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:50 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:50.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:50 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-10-08T19:42:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:51.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:51 smithi142 ceph-mon[33432]: osdmap e735: 8 total, 8 up, 8 in 2021-10-08T19:42:51.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-109","var": "dedup_tier","val": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-109","var": "dedup_tier","val": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:51.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:51.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:51 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:51 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:51.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[40655]: osdmap e735: 8 total, 8 up, 8 in 2021-10-08T19:42:51.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-109","var": "dedup_tier","val": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-109","var": "dedup_tier","val": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:51.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi112-83223-152","app": "rados","yes_i_really_mean_it": true}]': finished 2021-10-08T19:42:51.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[31694]: osdmap e735: 8 total, 8 up, 8 in 2021-10-08T19:42:51.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-109","var": "dedup_tier","val": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi112-83223-109","var": "dedup_tier","val": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:51.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:51.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:51.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:51 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi112-83223-109", "tierpool": "test-rados-api-smithi112-83223-152"}]: dispatch 2021-10-08T19:42:52.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:52 smithi142 ceph-mon[33432]: pgmap v1165: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 509 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:42:52.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:52 smithi142 ceph-mon[33432]: osdmap e736: 8 total, 8 up, 8 in 2021-10-08T19:42:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:52 smithi112 ceph-mon[40655]: pgmap v1165: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 509 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:42:52.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:52 smithi112 ceph-mon[40655]: osdmap e736: 8 total, 8 up, 8 in 2021-10-08T19:42:52.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:52 smithi112 ceph-mon[31694]: pgmap v1165: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 509 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2021-10-08T19:42:52.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:52 smithi112 ceph-mon[31694]: osdmap e736: 8 total, 8 up, 8 in 2021-10-08T19:42:53.071 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:52 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:42:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:42:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:42:53.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:53 smithi142 ceph-mon[33432]: osdmap e737: 8 total, 8 up, 8 in 2021-10-08T19:42:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:53 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:53 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:53.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:53 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:53.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:53 smithi112 ceph-mon[40655]: osdmap e737: 8 total, 8 up, 8 in 2021-10-08T19:42:53.531 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:53 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:53.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:53 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:53.532 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:53 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:53.532 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:53 smithi112 ceph-mon[31694]: osdmap e737: 8 total, 8 up, 8 in 2021-10-08T19:42:53.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:53 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:53.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:53 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:53.533 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:53 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:53.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:53.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:42:53.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:42:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:42:53.531Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:42:54.153 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2021-10-08T19:42:54.153 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8043 ms) 2021-10-08T19:42:54.153 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2021-10-08T19:42:54.154 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13075 ms) 2021-10-08T19:42:54.154 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2021-10-08T19:42:54.154 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7838 ms) 2021-10-08T19:42:54.154 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2021-10-08T19:42:54.155 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8077 ms) 2021-10-08T19:42:54.155 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2021-10-08T19:42:54.155 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: hmm, no HitSet yet 2021-10-08T19:42:54.155 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: ok, hit_set contains 247:602f83fe:::foo:head 2021-10-08T19:42:54.155 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9058 ms) 2021-10-08T19:42:54.156 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2021-10-08T19:42:54.156 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,0 2021-10-08T19:42:54.156 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: first is 1633722089 2021-10-08T19:42:54.156 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,0 2021-10-08T19:42:54.157 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,0 2021-10-08T19:42:54.157 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,0 2021-10-08T19:42:54.157 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,0 2021-10-08T19:42:54.157 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,0 2021-10-08T19:42:54.157 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,1633722094,1633722095,0 2021-10-08T19:42:54.158 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,1633722094,1633722095,0 2021-10-08T19:42:54.158 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,1633722094,1633722095,0 2021-10-08T19:42:54.158 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,1633722094,1633722095,1633722097,1633722098,0 2021-10-08T19:42:54.158 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,1633722094,1633722095,1633722097,1633722098,0 2021-10-08T19:42:54.159 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722089,1633722091,1633722092,1633722094,1633722095,1633722097,1633722098,0 2021-10-08T19:42:54.159 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: got ls 1633722092,1633722094,1633722095,1633722097,1633722098,1633722100,1633722101,0 2021-10-08T19:42:54.159 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: first now 1633722092, trimmed 2021-10-08T19:42:54.160 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20865 ms) 2021-10-08T19:42:54.160 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2021-10-08T19:42:54.160 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: foo0 2021-10-08T19:42:54.160 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: verifying foo0 is eventually promoted 2021-10-08T19:42:54.161 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14071 ms) 2021-10-08T19:42:54.161 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2021-10-08T19:42:54.161 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (17977 ms) 2021-10-08T19:42:54.161 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2021-10-08T19:42:54.162 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (22788 ms) 2021-10-08T19:42:54.162 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2021-10-08T19:42:54.162 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5055 ms) 2021-10-08T19:42:54.163 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2021-10-08T19:42:54.163 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3024 ms) 2021-10-08T19:42:54.163 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2021-10-08T19:42:54.163 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3026 ms) 2021-10-08T19:42:54.164 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2021-10-08T19:42:54.164 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3021 ms) 2021-10-08T19:42:54.164 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (232536 ms total) 2021-10-08T19:42:54.164 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: 2021-10-08T19:42:54.165 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [----------] Global test environment tear-down 2021-10-08T19:42:54.165 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [==========] 76 tests from 4 test suites ran. (847909 ms total) 2021-10-08T19:42:54.165 INFO:tasks.workunit.client.0.smithi112.stdout: api_tier_pp: [ PASSED ] 76 tests. 2021-10-08T19:42:54.167 INFO:tasks.workunit.client.0.smithi112.stderr:+ exit 0 2021-10-08T19:42:54.167 INFO:tasks.workunit.client.0.smithi112.stderr:+ cleanup 2021-10-08T19:42:54.167 INFO:tasks.workunit.client.0.smithi112.stderr:+ pkill -P 83023 2021-10-08T19:42:54.197 INFO:tasks.workunit.client.0.smithi112.stderr:+ true 2021-10-08T19:42:54.198 INFO:teuthology.orchestra.run:Running command with timeout 3600 2021-10-08T19:42:54.198 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2021-10-08T19:42:54.231 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2021-10-08T19:42:54.233 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2021-10-08T19:42:54.233 DEBUG:teuthology.orchestra.run.smithi112:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d1d7181c8e91145ded12e11fc2a9c8ce31671f6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2021-10-08T19:42:54.291 INFO:tasks.workunit.client.0.smithi112.stderr:++ uuidgen 2021-10-08T19:42:54.317 INFO:tasks.workunit.client.0.smithi112.stderr:+ p=c4948540-7f5b-41ca-ab7e-9986a908a571 2021-10-08T19:42:54.317 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool create c4948540-7f5b-41ca-ab7e-9986a908a571 12 2021-10-08T19:42:54.420 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 -- 172.21.15.112:0/1304892099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fd530 msgr2=0x7f0b500fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:54.420 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 --2- 172.21.15.112:0/1304892099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fd530 0x7f0b500fd900 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c004620 tx=0x7f0b4c009b30 comp rx=0 tx=0).stop 2021-10-08T19:42:54.421 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 -- 172.21.15.112:0/1304892099 shutdown_connections 2021-10-08T19:42:54.421 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 --2- 172.21.15.112:0/1304892099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b500f7ca0 0x7f0b501042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:54.421 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 --2- 172.21.15.112:0/1304892099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fd530 0x7f0b500fd900 unknown :-1 s=CLOSED pgs=2597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:54.421 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 --2- 172.21.15.112:0/1304892099 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b500fde40 0x7f0b500f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:54.421 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 -- 172.21.15.112:0/1304892099 >> 172.21.15.112:0/1304892099 conn(0x7f0b5006e250 msgr2=0x7f0b500f5610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:54.422 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 -- 172.21.15.112:0/1304892099 shutdown_connections 2021-10-08T19:42:54.422 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 -- 172.21.15.112:0/1304892099 wait complete. 2021-10-08T19:42:54.423 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 Processor -- start 2021-10-08T19:42:54.423 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.415+0000 7f0b58471700 1 -- start start 2021-10-08T19:42:54.423 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b58471700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b500f7ca0 0x7f0b500f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:54.423 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b58471700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b500fd530 0x7f0b500f9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:54.424 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b58471700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fde40 0x7f0b500f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:54.424 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b58471700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50116d90 con 0x7f0b500fde40 2021-10-08T19:42:54.424 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b58471700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50116f00 con 0x7f0b500fd530 2021-10-08T19:42:54.424 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b58471700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501170c0 con 0x7f0b500f7ca0 2021-10-08T19:42:54.424 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b500f7ca0 0x7f0b500f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:54.425 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b500f7ca0 0x7f0b500f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37458/0 (socket says 172.21.15.112:37458) 2021-10-08T19:42:54.425 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b56a0e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fde40 0x7f0b500f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:54.425 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 -- 172.21.15.112:0/1538677494 learned_addr learned my addr 172.21.15.112:0/1538677494 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:42:54.426 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b55a0c700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b500fd530 0x7f0b500f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:54.426 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 -- 172.21.15.112:0/1538677494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b500fd530 msgr2=0x7f0b500f9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:54.427 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b500fd530 0x7f0b500f9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:54.427 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 -- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fde40 msgr2=0x7f0b500f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:54.427 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fde40 0x7f0b500f9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:54.427 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 -- 172.21.15.112:0/1538677494 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40005040 con 0x7f0b500f7ca0 2021-10-08T19:42:54.428 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b56a0e700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fde40 0x7f0b500f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:42:54.428 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b5620d700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b500f7ca0 0x7f0b500f9150 secure :-1 s=READY pgs=2697 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009990 tx=0x7f0b4c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:54.429 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b46ffd700 1 -- 172.21.15.112:0/1538677494 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c01a070 con 0x7f0b500f7ca0 2021-10-08T19:42:54.429 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c005040 con 0x7f0b500f7ca0 2021-10-08T19:42:54.429 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b46ffd700 1 -- 172.21.15.112:0/1538677494 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f0b4c007920 con 0x7f0b500f7ca0 2021-10-08T19:42:54.429 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b46ffd700 1 -- 172.21.15.112:0/1538677494 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c01e6a0 con 0x7f0b500f7ca0 2021-10-08T19:42:54.430 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.416+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b50117690 con 0x7f0b500f7ca0 2021-10-08T19:42:54.430 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.417+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5005fc40 con 0x7f0b500f7ca0 2021-10-08T19:42:54.430 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.418+0000 7f0b46ffd700 1 -- 172.21.15.112:0/1538677494 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f0b4c007a90 con 0x7f0b500f7ca0 2021-10-08T19:42:54.431 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.418+0000 7f0b46ffd700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0b3c063530 0x7f0b3c0659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:54.431 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.418+0000 7f0b46ffd700 1 -- 172.21.15.112:0/1538677494 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(739..739 src has 1..739) v4 ==== 8493+0+0 (secure 0 0 0) 0x7f0b4c080c80 con 0x7f0b500f7ca0 2021-10-08T19:42:54.431 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.418+0000 7f0b55a0c700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0b3c063530 0x7f0b3c0659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:54.431 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.418+0000 7f0b55a0c700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0b3c063530 0x7f0b3c0659e0 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f0b500fa940 tx=0x7f0b4000b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:54.432 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.422+0000 7f0b46ffd700 1 -- 172.21.15.112:0/1538677494 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f0b4c052fb0 con 0x7f0b500f7ca0 2021-10-08T19:42:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:42:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:54.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: pgmap v1168: 164 pgs: 164 active+clean; 582 KiB data, 509 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: osdmap e738: 8 total, 8 up, 8 in 2021-10-08T19:42:54.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:54.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:54.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:54 smithi142 ceph-mon[33432]: osdmap e739: 8 total, 8 up, 8 in 2021-10-08T19:42:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:42:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:54.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: pgmap v1168: 164 pgs: 164 active+clean; 582 KiB data, 509 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: osdmap e738: 8 total, 8 up, 8 in 2021-10-08T19:42:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:54.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:54.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:54.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:54.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[40655]: osdmap e739: 8 total, 8 up, 8 in 2021-10-08T19:42:54.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:42:54.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:42:52] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:54.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: pgmap v1168: 164 pgs: 164 active+clean; 582 KiB data, 509 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:54.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:54.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: osdmap e738: 8 total, 8 up, 8 in 2021-10-08T19:42:54.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/4128568804' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:54.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]: dispatch 2021-10-08T19:42:54.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-10-08T19:42:54.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi112-83223-109"}]': finished 2021-10-08T19:42:54.576 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:54 smithi112 ceph-mon[31694]: osdmap e739: 8 total, 8 up, 8 in 2021-10-08T19:42:54.591 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:54.587+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12} v 0) v1 -- 0x7f0b501066d0 con 0x7f0b500f7ca0 2021-10-08T19:42:55.168 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.167+0000 7f0b46ffd700 1 -- 172.21.15.112:0/1538677494 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]=0 pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' created v740) v1 ==== 176+0+0 (secure 0 0 0) 0x7f0b4c023030 con 0x7f0b500f7ca0 2021-10-08T19:42:55.275 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.274+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12} v 0) v1 -- 0x7f0b501178b0 con 0x7f0b500f7ca0 2021-10-08T19:42:55.275 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.275+0000 7f0b46ffd700 1 -- 172.21.15.112:0/1538677494 <== mon.1 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]=0 pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' already exists v740) v1 ==== 183+0+0 (secure 0 0 0) 0x7f0b4c052ba0 con 0x7f0b500f7ca0 2021-10-08T19:42:55.278 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0b3c063530 msgr2=0x7f0b3c0659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:55.278 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0b3c063530 0x7f0b3c0659e0 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f0b500fa940 tx=0x7f0b4000b040 comp rx=0 tx=0).stop 2021-10-08T19:42:55.279 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b500f7ca0 msgr2=0x7f0b500f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:55.279 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b500f7ca0 0x7f0b500f9150 secure :-1 s=READY pgs=2697 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009990 tx=0x7f0b4c009b30 comp rx=0 tx=0).stop 2021-10-08T19:42:55.279 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 shutdown_connections 2021-10-08T19:42:55.279 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0b3c063530 0x7f0b3c0659e0 unknown :-1 s=CLOSED pgs=3297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.280 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b500fde40 0x7f0b500f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.280 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b500f7ca0 0x7f0b500f9150 unknown :-1 s=CLOSED pgs=2697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.280 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 --2- 172.21.15.112:0/1538677494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b500fd530 0x7f0b500f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.280 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 >> 172.21.15.112:0/1538677494 conn(0x7f0b5006e250 msgr2=0x7f0b5006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:55.280 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 shutdown_connections 2021-10-08T19:42:55.281 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.277+0000 7f0b58471700 1 -- 172.21.15.112:0/1538677494 wait complete. 2021-10-08T19:42:55.281 INFO:tasks.workunit.client.0.smithi112.stderr:pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' already exists 2021-10-08T19:42:55.288 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool set-quota c4948540-7f5b-41ca-ab7e-9986a908a571 max_objects 10 2021-10-08T19:42:55.388 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 -- 172.21.15.112:0/3304807066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 msgr2=0x7ff8f40fd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:55.389 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 --2- 172.21.15.112:0/3304807066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 0x7ff8f40fd6e0 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4004620 tx=0x7ff8e4009b30 comp rx=0 tx=0).stop 2021-10-08T19:42:55.389 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 -- 172.21.15.112:0/3304807066 shutdown_connections 2021-10-08T19:42:55.389 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 --2- 172.21.15.112:0/3304807066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f40f7b70 0x7ff8f4104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.389 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 --2- 172.21.15.112:0/3304807066 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 0x7ff8f40fd6e0 unknown :-1 s=CLOSED pgs=2698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.390 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 --2- 172.21.15.112:0/3304807066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f40fdcb0 0x7ff8f40f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.390 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 -- 172.21.15.112:0/3304807066 >> 172.21.15.112:0/3304807066 conn(0x7ff8f406f360 msgr2=0x7ff8f406f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:55.390 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 -- 172.21.15.112:0/3304807066 shutdown_connections 2021-10-08T19:42:55.390 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.385+0000 7ff8f8992700 1 -- 172.21.15.112:0/3304807066 wait complete. 2021-10-08T19:42:55.391 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f8992700 1 Processor -- start 2021-10-08T19:42:55.391 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f8992700 1 -- start start 2021-10-08T19:42:55.391 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f8992700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f40f7b70 0x7ff8f410d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:55.391 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f8992700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 0x7ff8f410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:55.391 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f8992700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f40fdcb0 0x7ff8f4107780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:55.392 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f8992700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4107d00 con 0x7ff8f40fdcb0 2021-10-08T19:42:55.392 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f8992700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4107e70 con 0x7ff8f40f7b70 2021-10-08T19:42:55.392 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f8992700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4108030 con 0x7ff8f40fd310 2021-10-08T19:42:55.392 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 0x7ff8f410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:55.393 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f40fdcb0 0x7ff8f4107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:55.393 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 0x7ff8f410dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37478/0 (socket says 172.21.15.112:37478) 2021-10-08T19:42:55.393 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 -- 172.21.15.112:0/1354066766 learned_addr learned my addr 172.21.15.112:0/1354066766 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:42:55.393 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f2d9d700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f40f7b70 0x7ff8f410d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:55.394 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 -- 172.21.15.112:0/1354066766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f40f7b70 msgr2=0x7ff8f410d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:55.394 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f40f7b70 0x7ff8f410d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.394 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 -- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f40fdcb0 msgr2=0x7ff8f4107780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:55.394 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f40fdcb0 0x7ff8f4107780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:55.394 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 -- 172.21.15.112:0/1354066766 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec009640 con 0x7ff8f40fd310 2021-10-08T19:42:55.395 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f359e700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f40fdcb0 0x7ff8f4107780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:42:55.395 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.386+0000 7ff8f259c700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 0x7ff8f410dbd0 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8002780 tx=0x7ff8e8009d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:55.395 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.387+0000 7ff8db7fe700 1 -- 172.21.15.112:0/1354066766 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e80092e0 con 0x7ff8f40fd310 2021-10-08T19:42:55.395 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.387+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e4005040 con 0x7ff8f40fd310 2021-10-08T19:42:55.396 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.387+0000 7ff8db7fe700 1 -- 172.21.15.112:0/1354066766 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff8e800f040 con 0x7ff8f40fd310 2021-10-08T19:42:55.396 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.387+0000 7ff8db7fe700 1 -- 172.21.15.112:0/1354066766 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8013660 con 0x7ff8f40fd310 2021-10-08T19:42:55.396 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.387+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f4114500 con 0x7ff8f40fd310 2021-10-08T19:42:55.396 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.387+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f4047b50 con 0x7ff8f40fd310 2021-10-08T19:42:55.396 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.388+0000 7ff8db7fe700 1 -- 172.21.15.112:0/1354066766 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7ff8e801a030 con 0x7ff8f40fd310 2021-10-08T19:42:55.398 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.388+0000 7ff8db7fe700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ff8dc063530 0x7ff8dc0659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:55.398 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.388+0000 7ff8db7fe700 1 -- 172.21.15.112:0/1354066766 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(740..740 src has 1..740) v4 ==== 8868+0+0 (secure 0 0 0) 0x7ff8e807fc20 con 0x7ff8f40fd310 2021-10-08T19:42:55.398 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.388+0000 7ff8f2d9d700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ff8dc063530 0x7ff8dc0659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:55.398 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.389+0000 7ff8f2d9d700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ff8dc063530 0x7ff8dc0659e0 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40144a0 tx=0x7ff8e4009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:55.399 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.392+0000 7ff8db7fe700 1 -- 172.21.15.112:0/1354066766 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7ff8e8047b00 con 0x7ff8f40fd310 2021-10-08T19:42:55.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:55 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1538677494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:55.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:55 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:55.551 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:55.550+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7ff8f4108cb0 con 0x7ff8f40fd310 2021-10-08T19:42:55.570 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:42:55] "GET /metrics HTTP/1.1" 200 155438 "" "Prometheus/2.18.1" 2021-10-08T19:42:55.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:55 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1538677494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:55.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:55 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:55 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1538677494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:55.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:55 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:56.168 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:56.167+0000 7ff8db7fe700 1 -- 172.21.15.112:0/1354066766 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v741) v1 ==== 223+0+0 (secure 0 0 0) 0x7ff8e8018020 con 0x7ff8f40fd310 2021-10-08T19:42:56.279 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:56.279+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7ff8f40289c0 con 0x7ff8f40fd310 2021-10-08T19:42:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:56 smithi142 ceph-mon[33432]: pgmap v1171: 164 pgs: 164 active+clean; 582 KiB data, 513 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]': finished 2021-10-08T19:42:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:56 smithi142 ceph-mon[33432]: osdmap e740: 8 total, 8 up, 8 in 2021-10-08T19:42:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1538677494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:56 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1354066766' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:56.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:56 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[40655]: pgmap v1171: 164 pgs: 164 active+clean; 582 KiB data, 513 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:56.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]': finished 2021-10-08T19:42:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[40655]: osdmap e740: 8 total, 8 up, 8 in 2021-10-08T19:42:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1538677494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:56.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1354066766' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:56.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:56.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[31694]: pgmap v1171: 164 pgs: 164 active+clean; 582 KiB data, 513 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:42:56.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]': finished 2021-10-08T19:42:56.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[31694]: osdmap e740: 8 total, 8 up, 8 in 2021-10-08T19:42:56.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1538677494' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:56.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "pg_num": 12}]: dispatch 2021-10-08T19:42:56.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1354066766' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:56.575 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:56 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:57.181 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.181+0000 7ff8db7fe700 1 -- 172.21.15.112:0/1354066766 <== mon.1 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v742) v1 ==== 223+0+0 (secure 0 0 0) 0x7ff8e8051ce0 con 0x7ff8f40fd310 2021-10-08T19:42:57.183 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:42:56 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:42:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:57.184 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ff8dc063530 msgr2=0x7ff8dc0659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:57.185 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ff8dc063530 0x7ff8dc0659e0 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40144a0 tx=0x7ff8e4009b30 comp rx=0 tx=0).stop 2021-10-08T19:42:57.185 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 msgr2=0x7ff8f410dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:57.185 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 0x7ff8f410dbd0 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8002780 tx=0x7ff8e8009d60 comp rx=0 tx=0).stop 2021-10-08T19:42:57.185 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 shutdown_connections 2021-10-08T19:42:57.186 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ff8dc063530 0x7ff8dc0659e0 unknown :-1 s=CLOSED pgs=3298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.186 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8f40fdcb0 0x7ff8f4107780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.186 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f40f7b70 0x7ff8f410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.186 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 --2- 172.21.15.112:0/1354066766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8f40fd310 0x7ff8f410dbd0 unknown :-1 s=CLOSED pgs=2699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.187 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.183+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 >> 172.21.15.112:0/1354066766 conn(0x7ff8f406f360 msgr2=0x7ff8f40f6910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:57.187 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.184+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 shutdown_connections 2021-10-08T19:42:57.187 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.184+0000 7ff8f8992700 1 -- 172.21.15.112:0/1354066766 wait complete. 2021-10-08T19:42:57.188 INFO:tasks.workunit.client.0.smithi112.stderr:set-quota max_objects = 10 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 2021-10-08T19:42:57.198 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool application enable c4948540-7f5b-41ca-ab7e-9986a908a571 rados 2021-10-08T19:42:57.303 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 -- 172.21.15.112:0/3850608388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f93f0 msgr2=0x7fdf6c0f97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:57.304 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 --2- 172.21.15.112:0/3850608388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f93f0 0x7fdf6c0f97c0 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0046e0 tx=0x7fdf5c009b30 comp rx=0 tx=0).stop 2021-10-08T19:42:57.304 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 -- 172.21.15.112:0/3850608388 shutdown_connections 2021-10-08T19:42:57.304 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 --2- 172.21.15.112:0/3850608388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c0f7fa0 0x7fdf6c1043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.305 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 --2- 172.21.15.112:0/3850608388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f93f0 0x7fdf6c0f97c0 unknown :-1 s=CLOSED pgs=2700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.305 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 --2- 172.21.15.112:0/3850608388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf6c0f75f0 0x7fdf6c0f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.305 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 -- 172.21.15.112:0/3850608388 >> 172.21.15.112:0/3850608388 conn(0x7fdf6c06d400 msgr2=0x7fdf6c06d800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:57.306 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 -- 172.21.15.112:0/3850608388 shutdown_connections 2021-10-08T19:42:57.306 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 -- 172.21.15.112:0/3850608388 wait complete. 2021-10-08T19:42:57.306 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 Processor -- start 2021-10-08T19:42:57.306 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.301+0000 7fdf72384700 1 -- start start 2021-10-08T19:42:57.307 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf72384700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f75f0 0x7fdf6c1099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:57.307 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf72384700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c0f7fa0 0x7fdf6c109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:57.307 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf72384700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf6c0f93f0 0x7fdf6c114a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:57.307 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf72384700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c10a6c0 con 0x7fdf6c0f7fa0 2021-10-08T19:42:57.307 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf72384700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c10a830 con 0x7fdf6c0f93f0 2021-10-08T19:42:57.308 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf72384700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c114fb0 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.308 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f75f0 0x7fdf6c1099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:57.308 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c0f7fa0 0x7fdf6c109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:57.308 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f75f0 0x7fdf6c1099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37494/0 (socket says 172.21.15.112:37494) 2021-10-08T19:42:57.309 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 -- 172.21.15.112:0/1427233180 learned_addr learned my addr 172.21.15.112:0/1427233180 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:42:57.309 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf70921700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf6c0f93f0 0x7fdf6c114a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:57.309 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 -- 172.21.15.112:0/1427233180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf6c0f93f0 msgr2=0x7fdf6c114a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:57.309 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf6c0f93f0 0x7fdf6c114a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.309 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 -- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c0f7fa0 msgr2=0x7fdf6c109f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:57.310 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c0f7fa0 0x7fdf6c109f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:57.310 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 -- 172.21.15.112:0/1427233180 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64009640 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.310 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf70921700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf6c0f93f0 0x7fdf6c114a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:42:57.310 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6b7fe700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c0f7fa0 0x7fdf6c109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:42:57.311 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf6bfff700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f75f0 0x7fdf6c1099c0 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c005010 tx=0x7fdf5c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:57.311 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf68ff9700 1 -- 172.21.15.112:0/1427233180 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c009660 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.311 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf68ff9700 1 -- 172.21.15.112:0/1427233180 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fdf5c004200 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.311 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c005040 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.311 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf68ff9700 1 -- 172.21.15.112:0/1427233180 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c01cac0 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.312 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.302+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c115520 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.313 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.303+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c060900 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.313 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.304+0000 7fdf68ff9700 1 -- 172.21.15.112:0/1427233180 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fdf5c007920 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.313 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.304+0000 7fdf68ff9700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf54063530 0x7fdf540659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:42:57.313 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.304+0000 7fdf68ff9700 1 -- 172.21.15.112:0/1427233180 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(742..742 src has 1..742) v4 ==== 8868+0+0 (secure 0 0 0) 0x7fdf5c081960 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.314 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.304+0000 7fdf6b7fe700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf54063530 0x7fdf540659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:42:57.314 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.304+0000 7fdf6b7fe700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf54063530 0x7fdf540659e0 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c062370 tx=0x7fdf6000b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:42:57.314 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.308+0000 7fdf68ff9700 1 -- 172.21.15.112:0/1427233180 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fdf5c053a80 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.471 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:57.470+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"} v 0) v1 -- 0x7fdf6c115740 con 0x7fdf6c0f75f0 2021-10-08T19:42:57.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:42:57 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:42:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:42:57.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:57 smithi142 ceph-mon[33432]: osdmap e741: 8 total, 8 up, 8 in 2021-10-08T19:42:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:57 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1354066766' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:57 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:57.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:57 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:42:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[40655]: osdmap e741: 8 total, 8 up, 8 in 2021-10-08T19:42:57.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1354066766' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:57.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:57.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:42:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[31694]: osdmap e741: 8 total, 8 up, 8 in 2021-10-08T19:42:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1354066766' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:42:57.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:57 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:42:58.192 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:58.191+0000 7fdf68ff9700 1 -- 172.21.15.112:0/1427233180 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]=0 enabled application 'rados' on pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' v743) v1 ==== 213+0+0 (secure 0 0 0) 0x7fdf5c053670 con 0x7fdf6c0f75f0 2021-10-08T19:42:58.303 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:58.303+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"} v 0) v1 -- 0x7fdf6c115740 con 0x7fdf6c0f75f0 2021-10-08T19:42:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:58 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:58 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:42:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:58 smithi142 ceph-mon[33432]: pgmap v1174: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:42:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:58 smithi142 ceph-mon[33432]: osdmap e742: 8 total, 8 up, 8 in 2021-10-08T19:42:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:58 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1427233180' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:58.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:58 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:58.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:58.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:42:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:58.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[31694]: pgmap v1174: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:58.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:58.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:42:58.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[31694]: osdmap e742: 8 total, 8 up, 8 in 2021-10-08T19:42:58.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1427233180' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:58.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:58.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:42:58.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:42:56] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:42:58.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[40655]: pgmap v1174: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 513 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:42:58.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:42:58.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:42:58.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[40655]: osdmap e742: 8 total, 8 up, 8 in 2021-10-08T19:42:58.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1427233180' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:58.575 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:58 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:59.205 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.204+0000 7fdf68ff9700 1 -- 172.21.15.112:0/1427233180 <== mon.1 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]=0 enabled application 'rados' on pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' v744) v1 ==== 213+0+0 (secure 0 0 0) 0x7fdf5c053850 con 0x7fdf6c0f75f0 2021-10-08T19:42:59.208 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf54063530 msgr2=0x7fdf540659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:59.208 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf54063530 0x7fdf540659e0 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c062370 tx=0x7fdf6000b040 comp rx=0 tx=0).stop 2021-10-08T19:42:59.208 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f75f0 msgr2=0x7fdf6c1099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:42:59.208 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f75f0 0x7fdf6c1099c0 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c005010 tx=0x7fdf5c009b30 comp rx=0 tx=0).stop 2021-10-08T19:42:59.209 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 shutdown_connections 2021-10-08T19:42:59.209 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fdf54063530 0x7fdf540659e0 unknown :-1 s=CLOSED pgs=3299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:59.209 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf6c0f93f0 0x7fdf6c114a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:59.209 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf6c0f75f0 0x7fdf6c1099c0 unknown :-1 s=CLOSED pgs=2701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:59.210 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 --2- 172.21.15.112:0/1427233180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c0f7fa0 0x7fdf6c109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:42:59.210 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 >> 172.21.15.112:0/1427233180 conn(0x7fdf6c06d400 msgr2=0x7fdf6c0f63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:42:59.210 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 shutdown_connections 2021-10-08T19:42:59.211 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:42:59.207+0000 7fdf72384700 1 -- 172.21.15.112:0/1427233180 wait complete. 2021-10-08T19:42:59.211 INFO:tasks.workunit.client.0.smithi112.stderr:enabled application 'rados' on pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' 2021-10-08T19:42:59.221 INFO:tasks.workunit.client.0.smithi112.stderr:++ seq 1 10 2021-10-08T19:42:59.238 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.239 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj1 /etc/passwd 2021-10-08T19:42:59.270 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.271 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj2 /etc/passwd 2021-10-08T19:42:59.302 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.303 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj3 /etc/passwd 2021-10-08T19:42:59.333 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.334 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj4 /etc/passwd 2021-10-08T19:42:59.364 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.364 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj5 /etc/passwd 2021-10-08T19:42:59.393 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.393 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj6 /etc/passwd 2021-10-08T19:42:59.422 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.423 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj7 /etc/passwd 2021-10-08T19:42:59.452 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.452 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj8 /etc/passwd 2021-10-08T19:42:59.481 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.481 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj9 /etc/passwd 2021-10-08T19:42:59.510 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:42:59.511 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put obj10 /etc/passwd 2021-10-08T19:42:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]': finished 2021-10-08T19:42:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:59 smithi142 ceph-mon[33432]: osdmap e743: 8 total, 8 up, 8 in 2021-10-08T19:42:59.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:59 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1427233180' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:59.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:42:59 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:59.539 INFO:tasks.workunit.client.0.smithi112.stderr:+ sleep 30 2021-10-08T19:42:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]': finished 2021-10-08T19:42:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:59 smithi112 ceph-mon[40655]: osdmap e743: 8 total, 8 up, 8 in 2021-10-08T19:42:59.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:59 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1427233180' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:59.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:42:59 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]': finished 2021-10-08T19:42:59.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:59 smithi112 ceph-mon[31694]: osdmap e743: 8 total, 8 up, 8 in 2021-10-08T19:42:59.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:59 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1427233180' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:42:59.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:42:59 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]: dispatch 2021-10-08T19:43:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:00 smithi142 ceph-mon[33432]: pgmap v1177: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:00 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]': finished 2021-10-08T19:43:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:00 smithi142 ceph-mon[33432]: osdmap e744: 8 total, 8 up, 8 in 2021-10-08T19:43:00.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:00 smithi112 ceph-mon[40655]: pgmap v1177: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:00 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]': finished 2021-10-08T19:43:00.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:00 smithi112 ceph-mon[40655]: osdmap e744: 8 total, 8 up, 8 in 2021-10-08T19:43:00.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:00 smithi112 ceph-mon[31694]: pgmap v1177: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:00 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "app": "rados"}]': finished 2021-10-08T19:43:00.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:00 smithi112 ceph-mon[31694]: osdmap e744: 8 total, 8 up, 8 in 2021-10-08T19:43:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:01 smithi142 ceph-mon[33432]: pgmap v1179: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:43:01.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:01 smithi112 ceph-mon[40655]: pgmap v1179: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:43:01.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:01 smithi112 ceph-mon[31694]: pgmap v1179: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:43:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:43:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:03.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:03.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:03.531Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:43:04.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:03 smithi142 ceph-mon[33432]: pgmap v1180: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:04.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:03 smithi112 ceph-mon[40655]: pgmap v1180: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:04.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:03 smithi112 ceph-mon[31694]: pgmap v1180: 176 pgs: 176 active+clean; 582 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:05] "GET /metrics HTTP/1.1" 200 155438 "" "Prometheus/2.18.1" 2021-10-08T19:43:06.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:05 smithi142 ceph-mon[33432]: pgmap v1181: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 12 KiB/s wr, 2 op/s 2021-10-08T19:43:06.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:05 smithi142 ceph-mon[33432]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' is full (reached quota's max_objects: 10) 2021-10-08T19:43:06.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:05 smithi142 ceph-mon[33432]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:06.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:05 smithi142 ceph-mon[33432]: osdmap e745: 8 total, 8 up, 8 in 2021-10-08T19:43:06.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:05 smithi112 ceph-mon[40655]: pgmap v1181: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 12 KiB/s wr, 2 op/s 2021-10-08T19:43:06.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:05 smithi112 ceph-mon[40655]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' is full (reached quota's max_objects: 10) 2021-10-08T19:43:06.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:05 smithi112 ceph-mon[40655]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:06.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:05 smithi112 ceph-mon[40655]: osdmap e745: 8 total, 8 up, 8 in 2021-10-08T19:43:06.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:05 smithi112 ceph-mon[31694]: pgmap v1181: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 12 KiB/s wr, 2 op/s 2021-10-08T19:43:06.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:05 smithi112 ceph-mon[31694]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' is full (reached quota's max_objects: 10) 2021-10-08T19:43:06.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:05 smithi112 ceph-mon[31694]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:06.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:05 smithi112 ceph-mon[31694]: osdmap e745: 8 total, 8 up, 8 in 2021-10-08T19:43:07.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:43:07 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:43:08.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:07 smithi142 ceph-mon[33432]: pgmap v1183: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 11 KiB/s wr, 1 op/s 2021-10-08T19:43:08.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:08.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:07 smithi112 ceph-mon[40655]: pgmap v1183: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 11 KiB/s wr, 1 op/s 2021-10-08T19:43:08.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:08.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:07 smithi112 ceph-mon[31694]: pgmap v1183: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 11 KiB/s wr, 1 op/s 2021-10-08T19:43:08.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:10.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:09 smithi142 ceph-mon[33432]: pgmap v1184: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 9.2 KiB/s wr, 2 op/s 2021-10-08T19:43:10.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:10 smithi112 ceph-mon[40655]: pgmap v1184: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 9.2 KiB/s wr, 2 op/s 2021-10-08T19:43:10.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:09 smithi112 ceph-mon[31694]: pgmap v1184: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 9.2 KiB/s wr, 2 op/s 2021-10-08T19:43:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:11 smithi142 ceph-mon[33432]: pgmap v1185: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:11 smithi112 ceph-mon[40655]: pgmap v1185: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:11.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:11 smithi112 ceph-mon[31694]: pgmap v1185: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:43:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:13.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:13.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:13.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:13.531Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:13.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:13.531Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:43:14.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:13 smithi142 ceph-mon[33432]: pgmap v1186: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:14.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:13 smithi112 ceph-mon[40655]: pgmap v1186: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:14.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:13 smithi112 ceph-mon[31694]: pgmap v1186: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:43:15.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:15] "GET /metrics HTTP/1.1" 200 156597 "" "Prometheus/2.18.1" 2021-10-08T19:43:16.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:15 smithi142 ceph-mon[33432]: pgmap v1187: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:16.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:15 smithi112 ceph-mon[31694]: pgmap v1187: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:16.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:15 smithi112 ceph-mon[40655]: pgmap v1187: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:17.272 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:43:17 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:43:18.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:17 smithi142 ceph-mon[33432]: pgmap v1188: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2021-10-08T19:43:18.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:17 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:18.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:17 smithi112 ceph-mon[40655]: pgmap v1188: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2021-10-08T19:43:18.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:17 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:18.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:17 smithi112 ceph-mon[31694]: pgmap v1188: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2021-10-08T19:43:18.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:17 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:19.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:19 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:43:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:20.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: pgmap v1189: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:20.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:20.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:20.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:20.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: poll took 60019.530 ms: 1 events 2021-10-08T19:43:20.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:20.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:43:20.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:43:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:20.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:20.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:20 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:20.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: pgmap v1189: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:20.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:20.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:20.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:20.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: poll took 60019.530 ms: 1 events 2021-10-08T19:43:20.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:20.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:43:20.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:43:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:20.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:20.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:20.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: pgmap v1189: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:20.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:43:20.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:43:20.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:43:20.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: poll took 60019.530 ms: 1 events 2021-10-08T19:43:20.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:20.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:43:20.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:43:19] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:20.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:20.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:20 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:21 smithi142 ceph-mon[33432]: pgmap v1190: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:21 smithi112 ceph-mon[40655]: pgmap v1190: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:21.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:21 smithi112 ceph-mon[31694]: pgmap v1190: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:23.173 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:23.173 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:23.173 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:23.174 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:23.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:23.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:23.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:23.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:23.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:23.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:23.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:43:23.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:43:23.522 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:43:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:23.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:23.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:23.532Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:43:24.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:23 smithi142 ceph-mon[33432]: pgmap v1191: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:24.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:23 smithi112 ceph-mon[40655]: pgmap v1191: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:24.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:23 smithi112 ceph-mon[31694]: pgmap v1191: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:24.322 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:23 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:43:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:25.124 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:24 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:25.125 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:24 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:43:25.125 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:24 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:43:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:25.125 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:24 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:25.126 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:24 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:43:25.126 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:24 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:43:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:25.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:24 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:25.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:24 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:43:25.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:24 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:43:23] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:25] "GET /metrics HTTP/1.1" 200 156590 "" "Prometheus/2.18.1" 2021-10-08T19:43:26.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:25 smithi142 ceph-mon[33432]: pgmap v1192: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:26.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:25 smithi112 ceph-mon[31694]: pgmap v1192: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:26.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:25 smithi112 ceph-mon[40655]: pgmap v1192: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:27.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:43:27 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:43:28.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:27 smithi142 ceph-mon[33432]: pgmap v1193: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:28.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:27 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:28.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:27 smithi112 ceph-mon[31694]: pgmap v1193: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:28.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:27 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:28.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:27 smithi112 ceph-mon[40655]: pgmap v1193: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:28.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:27 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:29.541 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=186766 2021-10-08T19:43:29.542 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool set-quota c4948540-7f5b-41ca-ab7e-9986a908a571 max_objects 100 2021-10-08T19:43:29.542 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put onemore /etc/passwd 2021-10-08T19:43:29.654 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 -- 172.21.15.112:0/1027522295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd80f78d0 msgr2=0x7ffbd80f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:29.655 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1027522295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd80f78d0 0x7ffbd80f7ca0 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009ab0 tx=0x7ffbc8004c50 comp rx=0 tx=0).stop 2021-10-08T19:43:29.655 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 -- 172.21.15.112:0/1027522295 shutdown_connections 2021-10-08T19:43:29.655 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1027522295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd80f97c0 0x7ffbd81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:29.655 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1027522295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd80f78d0 0x7ffbd80f7ca0 unknown :-1 s=CLOSED pgs=2611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:29.656 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1027522295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80f81e0 0x7ffbd80f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:29.656 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 -- 172.21.15.112:0/1027522295 >> 172.21.15.112:0/1027522295 conn(0x7ffbd806d110 msgr2=0x7ffbd80f5620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:29.656 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 -- 172.21.15.112:0/1027522295 shutdown_connections 2021-10-08T19:43:29.656 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 -- 172.21.15.112:0/1027522295 wait complete. 2021-10-08T19:43:29.656 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.651+0000 7ffbddb68700 1 Processor -- start 2021-10-08T19:43:29.657 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbddb68700 1 -- start start 2021-10-08T19:43:29.657 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbddb68700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd80f78d0 0x7ffbd810e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:29.657 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbddb68700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80f97c0 0x7ffbd810ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:29.657 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbddb68700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8108a90 0x7ffbd8108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:29.658 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbddb68700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8109440 con 0x7ffbd8108a90 2021-10-08T19:43:29.658 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbddb68700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8109580 con 0x7ffbd80f97c0 2021-10-08T19:43:29.658 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbddb68700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8109740 con 0x7ffbd80f78d0 2021-10-08T19:43:29.658 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd77fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd80f78d0 0x7ffbd810e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:29.659 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd77fe700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd80f78d0 0x7ffbd810e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37830/0 (socket says 172.21.15.112:37830) 2021-10-08T19:43:29.659 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd77fe700 1 -- 172.21.15.112:0/1907524397 learned_addr learned my addr 172.21.15.112:0/1907524397 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:43:29.659 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd7fff700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8108a90 0x7ffbd8108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:29.659 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd6ffd700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80f97c0 0x7ffbd810ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:29.659 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd7fff700 1 -- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd80f78d0 msgr2=0x7ffbd810e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:29.660 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd7fff700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd80f78d0 0x7ffbd810e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:29.660 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd7fff700 1 -- 172.21.15.112:0/1907524397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80f97c0 msgr2=0x7ffbd810ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:29.660 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd7fff700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80f97c0 0x7ffbd810ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:29.660 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd7fff700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0005040 con 0x7ffbd8108a90 2021-10-08T19:43:29.661 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd77fe700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd80f78d0 0x7ffbd810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:43:29.661 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd6ffd700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80f97c0 0x7ffbd810ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:43:29.661 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbd7fff700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8108a90 0x7ffbd8108f00 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0007fd0 tx=0x7ffbd0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:29.661 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000e050 con 0x7ffbd8108a90 2021-10-08T19:43:29.661 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc8009640 con 0x7ffbd8108a90 2021-10-08T19:43:29.662 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.652+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ffbd000f040 con 0x7ffbd8108a90 2021-10-08T19:43:29.662 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.653+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0014690 con 0x7ffbd8108a90 2021-10-08T19:43:29.662 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.653+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd8115a70 con 0x7ffbd8108a90 2021-10-08T19:43:29.662 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.653+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd8060900 con 0x7ffbd8108a90 2021-10-08T19:43:29.663 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.654+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7ffbd001b030 con 0x7ffbd8108a90 2021-10-08T19:43:29.664 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.654+0000 7ffbbbfff700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ffbc0063530 0x7ffbc00659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:29.664 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.654+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(745..745 src has 1..745) v4 ==== 8881+0+0 (secure 0 0 0) 0x7ffbd00800e0 con 0x7ffbd8108a90 2021-10-08T19:43:29.664 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.654+0000 7ffbd77fe700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ffbc0063530 0x7ffbc00659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:29.664 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.654+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=746}) v3 -- 0x7ffbc006eca0 con 0x7ffbd8108a90 2021-10-08T19:43:29.665 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.655+0000 7ffbd77fe700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ffbc0063530 0x7ffbc00659e0 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009a80 tx=0x7ffbc8004c50 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:29.665 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.659+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7ffbd0019020 con 0x7ffbd8108a90 2021-10-08T19:43:29.823 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:29.823+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7ffbd8109fa0 con 0x7ffbd8108a90 2021-10-08T19:43:30.010 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.009+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 7 ==== osd_map(746..746 src has 1..746) v4 ==== 620+0+0 (secure 0 0 0) 0x7ffbd0052750 con 0x7ffbd8108a90 2021-10-08T19:43:30.011 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.009+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=747}) v3 -- 0x7ffbc006f8a0 con 0x7ffbd8108a90 2021-10-08T19:43:30.012 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.011+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v746) v1 ==== 225+0+0 (secure 0 0 0) 0x7ffbd0050450 con 0x7ffbd8108a90 2021-10-08T19:43:30.121 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.120+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7ffbd80f81e0 con 0x7ffbd8108a90 2021-10-08T19:43:30.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:30 smithi142 ceph-mon[33432]: pgmap v1194: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:30.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:30 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:43:30.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:30 smithi112 ceph-mon[40655]: pgmap v1194: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:30.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:30 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:43:30.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:30 smithi112 ceph-mon[31694]: pgmap v1194: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:30.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:30 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:43:30.343 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.343+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 9 ==== osd_map(747..747 src has 1..747) v4 ==== 620+0+0 (secure 0 0 0) 0x7ffbd0050450 con 0x7ffbd8108a90 2021-10-08T19:43:30.344 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.343+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=748}) v3 -- 0x7ffbc006fc60 con 0x7ffbd8108a90 2021-10-08T19:43:30.351 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.349+0000 7ffbbbfff700 1 -- 172.21.15.112:0/1907524397 <== mon.0 v2:172.21.15.112:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v747) v1 ==== 225+0+0 (secure 0 0 0) 0x7ffbd0019020 con 0x7ffbd8108a90 2021-10-08T19:43:30.354 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ffbc0063530 msgr2=0x7ffbc00659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:30.354 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ffbc0063530 0x7ffbc00659e0 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009a80 tx=0x7ffbc8004c50 comp rx=0 tx=0).stop 2021-10-08T19:43:30.355 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8108a90 msgr2=0x7ffbd8108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:30.355 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8108a90 0x7ffbd8108f00 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0007fd0 tx=0x7ffbd0009b30 comp rx=0 tx=0).stop 2021-10-08T19:43:30.356 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 shutdown_connections 2021-10-08T19:43:30.356 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7ffbc0063530 0x7ffbc00659e0 unknown :-1 s=CLOSED pgs=3311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.357 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbd8108a90 0x7ffbd8108f00 unknown :-1 s=CLOSED pgs=2612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.357 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffbd80f78d0 0x7ffbd810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.358 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 --2- 172.21.15.112:0/1907524397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbd80f97c0 0x7ffbd810ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.358 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 >> 172.21.15.112:0/1907524397 conn(0x7ffbd806d110 msgr2=0x7ffbd80fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:30.359 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 shutdown_connections 2021-10-08T19:43:30.359 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.352+0000 7ffbddb68700 1 -- 172.21.15.112:0/1907524397 wait complete. 2021-10-08T19:43:30.359 INFO:tasks.workunit.client.0.smithi112.stderr:set-quota max_objects = 100 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 2021-10-08T19:43:30.363 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 186766 2021-10-08T19:43:30.364 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 0 -ne 0 ']' 2021-10-08T19:43:30.364 INFO:tasks.workunit.client.0.smithi112.stderr:+ true 2021-10-08T19:43:30.364 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put twomore /etc/passwd 2021-10-08T19:43:30.393 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool set-quota c4948540-7f5b-41ca-ab7e-9986a908a571 max_bytes 100 2021-10-08T19:43:30.492 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- 172.21.15.112:0/1979604944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 msgr2=0x7f06340f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:30.493 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 --2- 172.21.15.112:0/1979604944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 0x7f06340f7ca0 secure :-1 s=READY pgs=2725 cs=0 l=1 rev1=1 crypto rx=0x7f0630009ab0 tx=0x7f0630004c50 comp rx=0 tx=0).stop 2021-10-08T19:43:30.493 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- 172.21.15.112:0/1979604944 shutdown_connections 2021-10-08T19:43:30.493 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 --2- 172.21.15.112:0/1979604944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06340f97c0 0x7f06341043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.493 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 --2- 172.21.15.112:0/1979604944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 0x7f06340f7ca0 unknown :-1 s=CLOSED pgs=2725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 --2- 172.21.15.112:0/1979604944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06340f81e0 0x7f06340f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- 172.21.15.112:0/1979604944 >> 172.21.15.112:0/1979604944 conn(0x7f063406d1f0 msgr2=0x7f06340f5650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:30.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- 172.21.15.112:0/1979604944 shutdown_connections 2021-10-08T19:43:30.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- 172.21.15.112:0/1979604944 wait complete. 2021-10-08T19:43:30.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 Processor -- start 2021-10-08T19:43:30.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- start start 2021-10-08T19:43:30.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 0x7f0634109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:30.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06340f97c0 0x7f0634109f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:30.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f063410a4f0 0x7f0634114aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:30.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06341150b0 con 0x7f063410a4f0 2021-10-08T19:43:30.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634115220 con 0x7f06340f97c0 2021-10-08T19:43:30.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.488+0000 7f063b816700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06341153e0 con 0x7f06340f78d0 2021-10-08T19:43:30.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 0x7f0634109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:30.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 0x7f0634109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37866/0 (socket says 172.21.15.112:37866) 2021-10-08T19:43:30.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 -- 172.21.15.112:0/2187835009 learned_addr learned my addr 172.21.15.112:0/2187835009 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:43:30.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f0639db3700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f063410a4f0 0x7f0634114aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:30.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f0638db1700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06340f97c0 0x7f0634109f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:30.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 -- 172.21.15.112:0/2187835009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06340f97c0 msgr2=0x7f0634109f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:30.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06340f97c0 0x7f0634109f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 -- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f063410a4f0 msgr2=0x7f0634114aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:30.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f063410a4f0 0x7f0634114aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:30.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 -- 172.21.15.112:0/2187835009 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0624005040 con 0x7f06340f78d0 2021-10-08T19:43:30.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f0639db3700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f063410a4f0 0x7f0634114aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:43:30.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f0638db1700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06340f97c0 0x7f0634109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:43:30.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f06395b2700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 0x7f0634109a20 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 crypto rx=0x7f0630004ea0 tx=0x7f0630004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:30.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f0629ffb700 1 -- 172.21.15.112:0/2187835009 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000e030 con 0x7f06340f78d0 2021-10-08T19:43:30.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f0629ffb700 1 -- 172.21.15.112:0/2187835009 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f0630007a70 con 0x7f06340f78d0 2021-10-08T19:43:30.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0630009640 con 0x7f06340f78d0 2021-10-08T19:43:30.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f0629ffb700 1 -- 172.21.15.112:0/2187835009 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063001ca60 con 0x7f06340f78d0 2021-10-08T19:43:30.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.489+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0634115a00 con 0x7f06340f78d0 2021-10-08T19:43:30.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.490+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0634060900 con 0x7f06340f78d0 2021-10-08T19:43:30.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.490+0000 7f0629ffb700 1 -- 172.21.15.112:0/2187835009 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f063002c070 con 0x7f06340f78d0 2021-10-08T19:43:30.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.491+0000 7f0629ffb700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0620063530 0x7f06200659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:43:30.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.491+0000 7f0629ffb700 1 -- 172.21.15.112:0/2187835009 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(747..747 src has 1..747) v4 ==== 8881+0+0 (secure 0 0 0) 0x7f0630082730 con 0x7f06340f78d0 2021-10-08T19:43:30.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.491+0000 7f0638db1700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0620063530 0x7f06200659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:43:30.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.491+0000 7f0638db1700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0620063530 0x7f06200659e0 secure :-1 s=READY pgs=3313 cs=0 l=1 rev1=1 crypto rx=0x7f0624009fd0 tx=0x7f0624009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:43:30.503 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.495+0000 7f0629ffb700 1 -- 172.21.15.112:0/2187835009 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f06300547b0 con 0x7f06340f78d0 2021-10-08T19:43:30.661 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:30.661+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f0634062120 con 0x7f06340f78d0 2021-10-08T19:43:31.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:43:31.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: osdmap e746: 8 total, 8 up, 8 in 2021-10-08T19:43:31.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:43:31.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:43:31.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:43:31.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:43:31.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: osdmap e747: 8 total, 8 up, 8 in 2021-10-08T19:43:31.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2187835009' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:31.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:31 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:31.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:43:31.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: osdmap e746: 8 total, 8 up, 8 in 2021-10-08T19:43:31.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:43:31.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:43:31.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:43:31.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:43:31.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: osdmap e747: 8 total, 8 up, 8 in 2021-10-08T19:43:31.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2187835009' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:31.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:31.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:43:31.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: osdmap e746: 8 total, 8 up, 8 in 2021-10-08T19:43:31.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]: dispatch 2021-10-08T19:43:31.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:43:31.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:43:31.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1907524397' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "100"}]': finished 2021-10-08T19:43:31.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: osdmap e747: 8 total, 8 up, 8 in 2021-10-08T19:43:31.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2187835009' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:31.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:31 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:31.362 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:31.360+0000 7f0629ffb700 1 -- 172.21.15.112:0/2187835009 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v748) v1 ==== 221+0+0 (secure 0 0 0) 0x7f06300170d0 con 0x7f06340f78d0 2021-10-08T19:43:31.470 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:31.469+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f06340f81e0 con 0x7f06340f78d0 2021-10-08T19:43:32.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:32 smithi142 ceph-mon[33432]: pgmap v1197: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:32.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:43:32.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:32 smithi142 ceph-mon[33432]: osdmap e748: 8 total, 8 up, 8 in 2021-10-08T19:43:32.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:32 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2187835009' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:32.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:32 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:32.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[40655]: pgmap v1197: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:32.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:43:32.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[40655]: osdmap e748: 8 total, 8 up, 8 in 2021-10-08T19:43:32.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2187835009' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:32.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:32.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[31694]: pgmap v1197: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:32.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:43:32.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[31694]: osdmap e748: 8 total, 8 up, 8 in 2021-10-08T19:43:32.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2187835009' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:32.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:32 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]: dispatch 2021-10-08T19:43:32.364 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.363+0000 7f0629ffb700 1 -- 172.21.15.112:0/2187835009 <== mon.1 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v749) v1 ==== 221+0+0 (secure 0 0 0) 0x7f0630020020 con 0x7f06340f78d0 2021-10-08T19:43:32.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0620063530 msgr2=0x7f06200659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:32.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0620063530 0x7f06200659e0 secure :-1 s=READY pgs=3313 cs=0 l=1 rev1=1 crypto rx=0x7f0624009fd0 tx=0x7f0624009b30 comp rx=0 tx=0).stop 2021-10-08T19:43:32.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 msgr2=0x7f0634109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:43:32.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 0x7f0634109a20 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 crypto rx=0x7f0630004ea0 tx=0x7f0630004c50 comp rx=0 tx=0).stop 2021-10-08T19:43:32.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 shutdown_connections 2021-10-08T19:43:32.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f0620063530 0x7f06200659e0 unknown :-1 s=CLOSED pgs=3313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:32.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f063410a4f0 0x7f0634114aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:32.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f06340f78d0 0x7f0634109a20 unknown :-1 s=CLOSED pgs=2726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:32.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 --2- 172.21.15.112:0/2187835009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06340f97c0 0x7f0634109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:43:32.369 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 >> 172.21.15.112:0/2187835009 conn(0x7f063406d1f0 msgr2=0x7f063406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:43:32.369 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 shutdown_connections 2021-10-08T19:43:32.369 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:43:32.366+0000 7f063b816700 1 -- 172.21.15.112:0/2187835009 wait complete. 2021-10-08T19:43:32.370 INFO:tasks.workunit.client.0.smithi112.stderr:set-quota max_bytes = 100 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 2021-10-08T19:43:32.379 INFO:tasks.workunit.client.0.smithi112.stderr:+ sleep 30 2021-10-08T19:43:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:43:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:33.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:33 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:43:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:33 smithi142 ceph-mon[33432]: osdmap e749: 8 total, 8 up, 8 in 2021-10-08T19:43:33.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:33 smithi142 ceph-mon[33432]: pgmap v1200: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:43:33.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:33 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:43:33.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:33 smithi112 ceph-mon[31694]: osdmap e749: 8 total, 8 up, 8 in 2021-10-08T19:43:33.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:33 smithi112 ceph-mon[31694]: pgmap v1200: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:43:33.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:33 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "100"}]': finished 2021-10-08T19:43:33.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:33 smithi112 ceph-mon[40655]: osdmap e749: 8 total, 8 up, 8 in 2021-10-08T19:43:33.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:33 smithi112 ceph-mon[40655]: pgmap v1200: 176 pgs: 176 active+clean; 670 KiB data, 515 MiB used, 715 GiB / 715 GiB avail 2021-10-08T19:43:33.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:33.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:33.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:33.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:33.825 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:33.532Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:43:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:35] "GET /metrics HTTP/1.1" 200 156590 "" "Prometheus/2.18.1" 2021-10-08T19:43:36.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:36 smithi142 ceph-mon[33432]: pgmap v1201: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 3.6 KiB/s wr, 1 op/s 2021-10-08T19:43:36.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:36 smithi142 ceph-mon[33432]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' is full (reached quota's max_bytes: 100 B) 2021-10-08T19:43:36.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:36 smithi142 ceph-mon[33432]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:36.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:36 smithi142 ceph-mon[33432]: osdmap e750: 8 total, 8 up, 8 in 2021-10-08T19:43:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:36 smithi112 ceph-mon[40655]: pgmap v1201: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 3.6 KiB/s wr, 1 op/s 2021-10-08T19:43:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:36 smithi112 ceph-mon[40655]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' is full (reached quota's max_bytes: 100 B) 2021-10-08T19:43:36.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:36 smithi112 ceph-mon[40655]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:36.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:36 smithi112 ceph-mon[40655]: osdmap e750: 8 total, 8 up, 8 in 2021-10-08T19:43:36.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:36 smithi112 ceph-mon[31694]: pgmap v1201: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 3.6 KiB/s wr, 1 op/s 2021-10-08T19:43:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:36 smithi112 ceph-mon[31694]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' is full (reached quota's max_bytes: 100 B) 2021-10-08T19:43:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:36 smithi112 ceph-mon[31694]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:43:36.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:36 smithi112 ceph-mon[31694]: osdmap e750: 8 total, 8 up, 8 in 2021-10-08T19:43:37.522 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:43:37 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:43:38.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:38 smithi142 ceph-mon[33432]: pgmap v1203: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 3.0 KiB/s wr, 1 op/s 2021-10-08T19:43:38.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:38.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:38 smithi112 ceph-mon[40655]: pgmap v1203: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 3.0 KiB/s wr, 1 op/s 2021-10-08T19:43:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:38.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:38 smithi112 ceph-mon[31694]: pgmap v1203: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 3.0 KiB/s wr, 1 op/s 2021-10-08T19:43:38.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:40.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:40 smithi142 ceph-mon[33432]: pgmap v1204: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 1 op/s 2021-10-08T19:43:40.320 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:40 smithi112 ceph-mon[40655]: pgmap v1204: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 1 op/s 2021-10-08T19:43:40.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:40 smithi112 ceph-mon[31694]: pgmap v1204: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 1 op/s 2021-10-08T19:43:41.656 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:41 smithi112 ceph-mon[40655]: pgmap v1205: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2021-10-08T19:43:41.657 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:41 smithi112 ceph-mon[31694]: pgmap v1205: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2021-10-08T19:43:41.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:41 smithi142 ceph-mon[33432]: pgmap v1205: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.1 KiB/s wr, 1 op/s 2021-10-08T19:43:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:43:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:43.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:43.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:43.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:43.532Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:43:44.253 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:44 smithi142 ceph-mon[33432]: pgmap v1206: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.8 KiB/s wr, 1 op/s 2021-10-08T19:43:44.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:44 smithi112 ceph-mon[40655]: pgmap v1206: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.8 KiB/s wr, 1 op/s 2021-10-08T19:43:44.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:44 smithi112 ceph-mon[31694]: pgmap v1206: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.8 KiB/s wr, 1 op/s 2021-10-08T19:43:45.504 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:45] "GET /metrics HTTP/1.1" 200 156607 "" "Prometheus/2.18.1" 2021-10-08T19:43:45.505 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:45 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:43:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:46.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:46 smithi142 ceph-mon[33432]: pgmap v1207: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:46.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:46 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:46.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:46 smithi112 ceph-mon[31694]: pgmap v1207: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:46.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:46 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:46 smithi112 ceph-mon[40655]: pgmap v1207: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:43:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:46 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:47.273 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:43:47 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:43:47.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:47 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:43:47.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:47 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:43:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:47.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:47 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:43:47.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:47 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:43:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:47.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:47 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:43:47.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:47 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:43:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:48.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:48 smithi142 ceph-mon[33432]: pgmap v1208: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2021-10-08T19:43:48.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:48.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:48 smithi112 ceph-mon[40655]: pgmap v1208: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2021-10-08T19:43:48.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:48.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:48 smithi112 ceph-mon[31694]: pgmap v1208: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 0 op/s 2021-10-08T19:43:48.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:50.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:50 smithi112 ceph-mon[40655]: pgmap v1209: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:50.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:50 smithi112 ceph-mon[31694]: pgmap v1209: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:50.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:50 smithi142 ceph-mon[33432]: pgmap v1209: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:51.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:50 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:43:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:52.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:51 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:52.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:51 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:43:52.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:51 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:43:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:52.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:51 smithi142 ceph-mon[33432]: pgmap v1210: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:52.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:51 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:52.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:51 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:43:52.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:51 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:43:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:52.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:51 smithi112 ceph-mon[31694]: pgmap v1210: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:52.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:51 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:43:52.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:51 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:43:52.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:51 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:43:50] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:43:52.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:51 smithi112 ceph-mon[40655]: pgmap v1210: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:53.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:43:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:43:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:53.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:53.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:53.532Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:43:53.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:43:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:43:53.532Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:43:54.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:54 smithi142 ceph-mon[33432]: pgmap v1211: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:54.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:54 smithi112 ceph-mon[31694]: pgmap v1211: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:54.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:54 smithi112 ceph-mon[40655]: pgmap v1211: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:55.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:43:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:43:55] "GET /metrics HTTP/1.1" 200 156597 "" "Prometheus/2.18.1" 2021-10-08T19:43:56.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:56 smithi142 ceph-mon[33432]: pgmap v1212: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:56.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:56 smithi112 ceph-mon[40655]: pgmap v1212: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:56.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:56 smithi112 ceph-mon[31694]: pgmap v1212: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:43:57.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:43:57 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:43:58.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:58 smithi142 ceph-mon[33432]: pgmap v1213: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:58.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:43:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:58 smithi112 ceph-mon[40655]: pgmap v1213: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:43:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:43:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:58 smithi112 ceph-mon[31694]: pgmap v1213: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:43:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:43:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:00.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:00 smithi142 ceph-mon[33432]: pgmap v1214: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:00.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:00 smithi112 ceph-mon[40655]: pgmap v1214: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:00.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:00 smithi112 ceph-mon[31694]: pgmap v1214: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:01.772 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:01 smithi142 ceph-mon[33432]: pgmap v1215: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:01.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:01 smithi112 ceph-mon[40655]: pgmap v1215: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:01.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:01 smithi112 ceph-mon[31694]: pgmap v1215: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:02.381 INFO:tasks.workunit.client.0.smithi112.stderr:+ pid=187999 2021-10-08T19:44:02.382 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool set-quota c4948540-7f5b-41ca-ab7e-9986a908a571 max_bytes 0 2021-10-08T19:44:02.382 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put two /etc/passwd 2021-10-08T19:44:02.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 -- 172.21.15.112:0/882206749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c40f9800 msgr2=0x7f68c40f9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:02.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/882206749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c40f9800 0x7f68c40f9bd0 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f68c0004620 tx=0x7f68c0009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:02.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 -- 172.21.15.112:0/882206749 shutdown_connections 2021-10-08T19:44:02.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/882206749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c4102bf0 0x7f68c4104ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:02.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/882206749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c40f9800 0x7f68c40f9bd0 unknown :-1 s=CLOSED pgs=2613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:02.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/882206749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68c40fa110 0x7f68c41026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:02.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 -- 172.21.15.112:0/882206749 >> 172.21.15.112:0/882206749 conn(0x7f68c406d1f0 msgr2=0x7f68c40f5650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:02.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 -- 172.21.15.112:0/882206749 shutdown_connections 2021-10-08T19:44:02.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 -- 172.21.15.112:0/882206749 wait complete. 2021-10-08T19:44:02.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 Processor -- start 2021-10-08T19:44:02.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.490+0000 7f68cb0e5700 1 -- start start 2021-10-08T19:44:02.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68cb0e5700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40f9800 0x7f68c40f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:02.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68cb0e5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68c40fa110 0x7f68c40f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:02.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68cb0e5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c4102bf0 0x7f68c40f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:02.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68cb0e5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c41170e0 con 0x7f68c4102bf0 2021-10-08T19:44:02.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68cb0e5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4117250 con 0x7f68c40fa110 2021-10-08T19:44:02.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68cb0e5700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4117410 con 0x7f68c40f9800 2021-10-08T19:44:02.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40f9800 0x7f68c40f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:02.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40f9800 0x7f68c40f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37982/0 (socket says 172.21.15.112:37982) 2021-10-08T19:44:02.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 -- 172.21.15.112:0/664790430 learned_addr learned my addr 172.21.15.112:0/664790430 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:44:02.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c9682700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c4102bf0 0x7f68c40f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:02.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68bbfff700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68c40fa110 0x7f68c40f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:02.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 -- 172.21.15.112:0/664790430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68c40fa110 msgr2=0x7f68c40f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:02.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68c40fa110 0x7f68c40f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:02.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 -- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c4102bf0 msgr2=0x7f68c40f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:02.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c4102bf0 0x7f68c40f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:02.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc009640 con 0x7f68c40f9800 2021-10-08T19:44:02.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c9682700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c4102bf0 0x7f68c40f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:44:02.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68bbfff700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68c40fa110 0x7f68c40f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:44:02.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68c8e81700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40f9800 0x7f68c40f7500 secure :-1 s=READY pgs=2730 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009650 tx=0x7f68c0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:02.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.491+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0019070 con 0x7f68c40f9800 2021-10-08T19:44:02.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.492+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f68c0007c00 con 0x7f68c40f9800 2021-10-08T19:44:02.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.492+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c0005040 con 0x7f68c40f9800 2021-10-08T19:44:02.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.492+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c001edf0 con 0x7f68c40f9800 2021-10-08T19:44:02.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.492+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c41178b0 con 0x7f68c40f9800 2021-10-08T19:44:02.503 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.493+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c4060900 con 0x7f68c40f9800 2021-10-08T19:44:02.503 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.493+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f68c001e420 con 0x7f68c40f9800 2021-10-08T19:44:02.504 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.493+0000 7f68b97fa700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f68ac063530 0x7f68ac0659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:02.504 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.493+0000 7f68bbfff700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f68ac063530 0x7f68ac0659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:02.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.493+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(750..750 src has 1..750) v4 ==== 8881+0+0 (secure 0 0 0) 0x7f68c0081b80 con 0x7f68c40f9800 2021-10-08T19:44:02.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.494+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=751}) v3 -- 0x7f68ac06eca0 con 0x7f68c40f9800 2021-10-08T19:44:02.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.494+0000 7f68bbfff700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f68ac063530 0x7f68ac0659e0 secure :-1 s=READY pgs=3315 cs=0 l=1 rev1=1 crypto rx=0x7f68c40f8cf0 tx=0x7f68b400b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:02.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.498+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f68c0053c70 con 0x7f68c40f9800 2021-10-08T19:44:02.662 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.660+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f68c40f8b00 con 0x7f68c40f9800 2021-10-08T19:44:02.721 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.719+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 7 ==== osd_map(751..751 src has 1..751) v4 ==== 620+0+0 (secure 0 0 0) 0x7f68c0054340 con 0x7f68c40f9800 2021-10-08T19:44:02.721 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.719+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=752}) v3 -- 0x7f68ac06f8a0 con 0x7f68c40f9800 2021-10-08T19:44:02.721 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.719+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v751) v1 ==== 217+0+0 (secure 0 0 0) 0x7f68c0009c30 con 0x7f68c40f9800 2021-10-08T19:44:02.829 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:02.828+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f68c40f8aa0 con 0x7f68c40f9800 2021-10-08T19:44:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:02 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/664790430' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:02 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:02 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/664790430' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:02 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.071 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:02 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/664790430' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:02 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:44:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:03.732 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.730+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 9 ==== osd_map(752..752 src has 1..752) v4 ==== 620+0+0 (secure 0 0 0) 0x7f68c0059200 con 0x7f68c40f9800 2021-10-08T19:44:03.733 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.730+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=753}) v3 -- 0x7f68ac06f8e0 con 0x7f68c40f9800 2021-10-08T19:44:03.739 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.736+0000 7f68b97fa700 1 -- 172.21.15.112:0/664790430 <== mon.1 v2:172.21.15.112:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v752) v1 ==== 217+0+0 (secure 0 0 0) 0x7f68c0053860 con 0x7f68c40f9800 2021-10-08T19:44:03.743 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f68ac063530 msgr2=0x7f68ac0659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:03.743 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f68ac063530 0x7f68ac0659e0 secure :-1 s=READY pgs=3315 cs=0 l=1 rev1=1 crypto rx=0x7f68c40f8cf0 tx=0x7f68b400b040 comp rx=0 tx=0).stop 2021-10-08T19:44:03.743 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40f9800 msgr2=0x7f68c40f7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:03.744 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40f9800 0x7f68c40f7500 secure :-1 s=READY pgs=2730 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009650 tx=0x7f68c0009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:03.744 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 shutdown_connections 2021-10-08T19:44:03.744 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f68ac063530 0x7f68ac0659e0 unknown :-1 s=CLOSED pgs=3315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.744 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c4102bf0 0x7f68c40f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.745 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68c40f9800 0x7f68c40f7500 unknown :-1 s=CLOSED pgs=2730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.745 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 --2- 172.21.15.112:0/664790430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68c40fa110 0x7f68c40f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.745 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 >> 172.21.15.112:0/664790430 conn(0x7f68c406d1f0 msgr2=0x7f68c4103850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:03.745 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 shutdown_connections 2021-10-08T19:44:03.746 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.741+0000 7f68cb0e5700 1 -- 172.21.15.112:0/664790430 wait complete. 2021-10-08T19:44:03.746 INFO:tasks.workunit.client.0.smithi112.stderr:set-quota max_bytes = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 2021-10-08T19:44:03.755 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool set-quota c4948540-7f5b-41ca-ab7e-9986a908a571 max_objects 0 2021-10-08T19:44:03.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:03.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:03.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:03.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:03.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:03.533Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:44:03.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[31694]: osdmap e751: 8 total, 8 up, 8 in 2021-10-08T19:44:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/664790430' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[31694]: pgmap v1217: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[40655]: osdmap e751: 8 total, 8 up, 8 in 2021-10-08T19:44:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/664790430' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:03.826 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:03 smithi112 ceph-mon[40655]: pgmap v1217: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:03.860 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.854+0000 7f3a43a91700 1 -- 172.21.15.112:0/263818535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f94c0 msgr2=0x7f3a3c0fa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:03.861 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.854+0000 7f3a43a91700 1 --2- 172.21.15.112:0/263818535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f94c0 0x7f3a3c0fa3a0 secure :-1 s=READY pgs=2731 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0046e0 tx=0x7f3a2c009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:03.861 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.854+0000 7f3a43a91700 1 -- 172.21.15.112:0/263818535 shutdown_connections 2021-10-08T19:44:03.861 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.854+0000 7f3a43a91700 1 --2- 172.21.15.112:0/263818535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a3c0faa80 0x7f3a3c105700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.862 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.854+0000 7f3a43a91700 1 --2- 172.21.15.112:0/263818535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a3c0f8bb0 0x7f3a3c0f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.862 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.854+0000 7f3a43a91700 1 --2- 172.21.15.112:0/263818535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f94c0 0x7f3a3c0fa3a0 unknown :-1 s=CLOSED pgs=2731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.862 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.854+0000 7f3a43a91700 1 -- 172.21.15.112:0/263818535 >> 172.21.15.112:0/263818535 conn(0x7f3a3c06e430 msgr2=0x7f3a3c0f6920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:03.863 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 -- 172.21.15.112:0/263818535 shutdown_connections 2021-10-08T19:44:03.863 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 -- 172.21.15.112:0/263818535 wait complete. 2021-10-08T19:44:03.863 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 Processor -- start 2021-10-08T19:44:03.863 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 -- start start 2021-10-08T19:44:03.864 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f8bb0 0x7f3a3c10eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:03.864 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a3c0f94c0 0x7f3a3c10f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:03.864 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a3c0faa80 0x7f3a3c108bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:03.864 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c109150 con 0x7f3a3c0faa80 2021-10-08T19:44:03.865 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c109290 con 0x7f3a3c0f94c0 2021-10-08T19:44:03.865 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a43a91700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c109450 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.865 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a4182d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f8bb0 0x7f3a3c10eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:03.865 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a4182d700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f8bb0 0x7f3a3c10eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:37998/0 (socket says 172.21.15.112:37998) 2021-10-08T19:44:03.866 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a4202e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a3c0faa80 0x7f3a3c108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:03.866 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.855+0000 7f3a4182d700 1 -- 172.21.15.112:0/151866502 learned_addr learned my addr 172.21.15.112:0/151866502 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:44:03.866 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a4102c700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a3c0f94c0 0x7f3a3c10f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:03.866 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a4182d700 1 -- 172.21.15.112:0/151866502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a3c0f94c0 msgr2=0x7f3a3c10f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:03.867 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a4182d700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a3c0f94c0 0x7f3a3c10f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.867 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a4182d700 1 -- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a3c0faa80 msgr2=0x7f3a3c108bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:03.869 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a4182d700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a3c0faa80 0x7f3a3c108bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:03.869 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a4182d700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34009640 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.869 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a4202e700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a3c0faa80 0x7f3a3c108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:44:03.870 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a4182d700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f8bb0 0x7f3a3c10eb10 secure :-1 s=READY pgs=2732 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800c5b0 tx=0x7f3a38007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:03.870 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38016070 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.870 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3a38007e90 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.870 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c005040 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.871 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38012850 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.871 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.856+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c115940 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.872 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.857+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c060900 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.872 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.857+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f3a38010050 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.872 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.858+0000 7f3a327fc700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f3a28063530 0x7f3a280659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:03.872 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.858+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(752..752 src has 1..752) v4 ==== 8881+0+0 (secure 0 0 0) 0x7f3a380802d0 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.873 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.858+0000 7f3a4102c700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f3a28063530 0x7f3a280659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:03.873 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.858+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=753}) v3 -- 0x7f3a2806eca0 con 0x7f3a3c0f8bb0 2021-10-08T19:44:03.873 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.858+0000 7f3a4102c700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f3a28063530 0x7f3a280659e0 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c10a3b0 tx=0x7f3a2c009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:03.874 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:03.862+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f3a38052270 con 0x7f3a3c0f8bb0 2021-10-08T19:44:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:03 smithi142 ceph-mon[33432]: osdmap e751: 8 total, 8 up, 8 in 2021-10-08T19:44:04.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:03 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/664790430' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:04.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:03 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:44:04.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:03 smithi142 ceph-mon[33432]: pgmap v1217: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:04.033 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:04.031+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f3a3c05ff00 con 0x7f3a3c0f8bb0 2021-10-08T19:44:04.741 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:04.736+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 7 ==== osd_map(753..753 src has 1..753) v4 ==== 620+0+0 (secure 0 0 0) 0x7f3a3804e020 con 0x7f3a3c0f8bb0 2021-10-08T19:44:04.741 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:04.736+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=754}) v3 -- 0x7f3a2806f8a0 con 0x7f3a3c0f8bb0 2021-10-08T19:44:04.742 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:04.740+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v753) v1 ==== 221+0+0 (secure 0 0 0) 0x7f3a3806c060 con 0x7f3a3c0f8bb0 2021-10-08T19:44:04.852 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:04.850+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f3a3c05ff00 con 0x7f3a3c0f8bb0 2021-10-08T19:44:05.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:05.023 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:04 smithi142 ceph-mon[33432]: osdmap e752: 8 total, 8 up, 8 in 2021-10-08T19:44:05.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:04 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/151866502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:05.024 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:04 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:05.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:05.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:04 smithi112 ceph-mon[40655]: osdmap e752: 8 total, 8 up, 8 in 2021-10-08T19:44:05.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:04 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/151866502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:05.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:04 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:05.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:44:05.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:04 smithi112 ceph-mon[31694]: osdmap e752: 8 total, 8 up, 8 in 2021-10-08T19:44:05.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:04 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/151866502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:05.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:04 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:05.365 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.354+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 9 ==== osd_map(754..754 src has 1..754) v4 ==== 620+0+0 (secure 0 0 0) 0x7f3a38052940 con 0x7f3a3c0f8bb0 2021-10-08T19:44:05.366 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.354+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=755}) v3 -- 0x7f3a2806fd70 con 0x7f3a3c0f8bb0 2021-10-08T19:44:05.366 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.358+0000 7f3a327fc700 1 -- 172.21.15.112:0/151866502 <== mon.1 v2:172.21.15.112:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v754) v1 ==== 221+0+0 (secure 0 0 0) 0x7f3a38057060 con 0x7f3a3c0f8bb0 2021-10-08T19:44:05.366 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f3a28063530 msgr2=0x7f3a280659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:05.366 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f3a28063530 0x7f3a280659e0 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c10a3b0 tx=0x7f3a2c009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:05.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f8bb0 msgr2=0x7f3a3c10eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:05.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f8bb0 0x7f3a3c10eb10 secure :-1 s=READY pgs=2732 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800c5b0 tx=0x7f3a38007e20 comp rx=0 tx=0).stop 2021-10-08T19:44:05.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 shutdown_connections 2021-10-08T19:44:05.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f3a28063530 0x7f3a280659e0 unknown :-1 s=CLOSED pgs=3316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a3c0faa80 0x7f3a3c108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3a3c0f8bb0 0x7f3a3c10eb10 unknown :-1 s=CLOSED pgs=2732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 --2- 172.21.15.112:0/151866502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a3c0f94c0 0x7f3a3c10f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 >> 172.21.15.112:0/151866502 conn(0x7f3a3c06e430 msgr2=0x7f3a3c06e860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:05.368 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 shutdown_connections 2021-10-08T19:44:05.369 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.361+0000 7f3a43a91700 1 -- 172.21.15.112:0/151866502 wait complete. 2021-10-08T19:44:05.369 INFO:tasks.workunit.client.0.smithi112.stderr:set-quota max_objects = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 2021-10-08T19:44:05.376 INFO:tasks.workunit.client.0.smithi112.stderr:+ wait 187999 2021-10-08T19:44:05.377 INFO:tasks.workunit.client.0.smithi112.stderr:+ '[' 0 -ne 0 ']' 2021-10-08T19:44:05.378 INFO:tasks.workunit.client.0.smithi112.stderr:+ true 2021-10-08T19:44:05.378 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put three /etc/passwd 2021-10-08T19:44:05.403 INFO:tasks.workunit.client.0.smithi112.stderr:++ uuidgen 2021-10-08T19:44:05.405 INFO:tasks.workunit.client.0.smithi112.stderr:+ pp=1487472f-a27a-4747-95b7-fe9edad11601 2021-10-08T19:44:05.405 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool create 1487472f-a27a-4747-95b7-fe9edad11601 12 2021-10-08T19:44:05.511 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 -- 172.21.15.112:0/1674479121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 msgr2=0x7fda601042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:05.513 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 --2- 172.21.15.112:0/1674479121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 0x7fda601042d0 secure :-1 s=READY pgs=2735 cs=0 l=1 rev1=1 crypto rx=0x7fda58009a60 tx=0x7fda58004d10 comp rx=0 tx=0).stop 2021-10-08T19:44:05.513 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 -- 172.21.15.112:0/1674479121 shutdown_connections 2021-10-08T19:44:05.514 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 --2- 172.21.15.112:0/1674479121 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 0x7fda601042d0 unknown :-1 s=CLOSED pgs=2735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.515 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 --2- 172.21.15.112:0/1674479121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda600fd510 0x7fda600fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.515 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 --2- 172.21.15.112:0/1674479121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600fde20 0x7fda600f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.519 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 -- 172.21.15.112:0/1674479121 >> 172.21.15.112:0/1674479121 conn(0x7fda6006e220 msgr2=0x7fda600f5630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:05.522 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 -- 172.21.15.112:0/1674479121 shutdown_connections 2021-10-08T19:44:05.523 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.498+0000 7fda6757a700 1 -- 172.21.15.112:0/1674479121 wait complete. 2021-10-08T19:44:05.523 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 Processor -- start 2021-10-08T19:44:05.523 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 -- start start 2021-10-08T19:44:05.524 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 0x7fda60109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:05.524 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda600fd510 0x7fda60109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:05.524 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600fde20 0x7fda601146e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:05.524 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6010a380 con 0x7fda600fd510 2021-10-08T19:44:05.525 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6010a4f0 con 0x7fda600fde20 2021-10-08T19:44:05.525 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda60114c70 con 0x7fda600f7c80 2021-10-08T19:44:05.525 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda600fd510 0x7fda60109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:05.525 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda65316700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 0x7fda60109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:05.525 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda600fd510 0x7fda60109ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44320/0 (socket says 172.21.15.112:44320) 2021-10-08T19:44:05.526 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda65316700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 0x7fda60109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:38046/0 (socket says 172.21.15.112:38046) 2021-10-08T19:44:05.526 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 -- 172.21.15.112:0/1861353349 learned_addr learned my addr 172.21.15.112:0/1861353349 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:44:05.526 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda65b17700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600fde20 0x7fda601146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:05.526 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 -- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 msgr2=0x7fda60109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:05.527 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 0x7fda60109660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.527 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 -- 172.21.15.112:0/1861353349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600fde20 msgr2=0x7fda601146e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:05.527 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600fde20 0x7fda601146e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:05.527 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 -- 172.21.15.112:0/1861353349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c005040 con 0x7fda600fd510 2021-10-08T19:44:05.528 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda65316700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 0x7fda60109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:44:05.528 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda64b15700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda600fd510 0x7fda60109ba0 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7fda50002780 tx=0x7fda50009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:05.528 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda55ffb700 1 -- 172.21.15.112:0/1861353349 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda500092e0 con 0x7fda600fd510 2021-10-08T19:44:05.528 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda58009640 con 0x7fda600fd510 2021-10-08T19:44:05.528 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda55ffb700 1 -- 172.21.15.112:0/1861353349 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fda5000f040 con 0x7fda600fd510 2021-10-08T19:44:05.529 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.499+0000 7fda55ffb700 1 -- 172.21.15.112:0/1861353349 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50013660 con 0x7fda600fd510 2021-10-08T19:44:05.529 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.500+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda60115250 con 0x7fda600fd510 2021-10-08T19:44:05.529 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.501+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda60060900 con 0x7fda600fd510 2021-10-08T19:44:05.529 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.501+0000 7fda55ffb700 1 -- 172.21.15.112:0/1861353349 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7fda500077b0 con 0x7fda600fd510 2021-10-08T19:44:05.530 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.501+0000 7fda55ffb700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fda4c063530 0x7fda4c0659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:05.530 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.501+0000 7fda55ffb700 1 -- 172.21.15.112:0/1861353349 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(754..754 src has 1..754) v4 ==== 8881+0+0 (secure 0 0 0) 0x7fda50080560 con 0x7fda600fd510 2021-10-08T19:44:05.530 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.501+0000 7fda65316700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fda4c063530 0x7fda4c0659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:05.533 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.502+0000 7fda65316700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fda4c063530 0x7fda4c0659e0 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 crypto rx=0x7fda5c007fd0 tx=0x7fda5c00b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:05.533 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.505+0000 7fda55ffb700 1 -- 172.21.15.112:0/1861353349 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7fda50052500 con 0x7fda600fd510 2021-10-08T19:44:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:05] "GET /metrics HTTP/1.1" 200 156597 "" "Prometheus/2.18.1" 2021-10-08T19:44:05.691 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:05.685+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12} v 0) v1 -- 0x7fda60106730 con 0x7fda600fd510 2021-10-08T19:44:06.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:06.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: osdmap e753: 8 total, 8 up, 8 in 2021-10-08T19:44:06.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/151866502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:06.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:06.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: pgmap v1220: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:06.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:44:06.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:44:06.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:06.073 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[40655]: osdmap e754: 8 total, 8 up, 8 in 2021-10-08T19:44:06.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:06.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: osdmap e753: 8 total, 8 up, 8 in 2021-10-08T19:44:06.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/151866502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:06.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:06.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: pgmap v1220: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:06.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:44:06.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:44:06.075 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:06.076 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:05 smithi112 ceph-mon[31694]: osdmap e754: 8 total, 8 up, 8 in 2021-10-08T19:44:06.277 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:06.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: osdmap e753: 8 total, 8 up, 8 in 2021-10-08T19:44:06.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/151866502' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:06.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:44:06.278 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: pgmap v1220: 176 pgs: 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:06.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: pool 'c4948540-7f5b-41ca-ab7e-9986a908a571' no longer out of quota; removing NO_QUOTA flag 2021-10-08T19:44:06.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-10-08T19:44:06.279 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:44:06.280 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:05 smithi142 ceph-mon[33432]: osdmap e754: 8 total, 8 up, 8 in 2021-10-08T19:44:06.367 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.365+0000 7fda55ffb700 1 -- 172.21.15.112:0/1861353349 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]=0 pool '1487472f-a27a-4747-95b7-fe9edad11601' created v755) v1 ==== 176+0+0 (secure 0 0 0) 0x7fda60106730 con 0x7fda600fd510 2021-10-08T19:44:06.475 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.473+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12} v 0) v1 -- 0x7fda60106730 con 0x7fda600fd510 2021-10-08T19:44:06.475 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.473+0000 7fda55ffb700 1 -- 172.21.15.112:0/1861353349 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]=0 pool '1487472f-a27a-4747-95b7-fe9edad11601' already exists v755) v1 ==== 183+0+0 (secure 0 0 0) 0x7fda500520f0 con 0x7fda600fd510 2021-10-08T19:44:06.477 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fda4c063530 msgr2=0x7fda4c0659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:06.478 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fda4c063530 0x7fda4c0659e0 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 crypto rx=0x7fda5c007fd0 tx=0x7fda5c00b040 comp rx=0 tx=0).stop 2021-10-08T19:44:06.478 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda600fd510 msgr2=0x7fda60109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:06.478 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda600fd510 0x7fda60109ba0 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7fda50002780 tx=0x7fda50009e00 comp rx=0 tx=0).stop 2021-10-08T19:44:06.478 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 shutdown_connections 2021-10-08T19:44:06.479 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7fda4c063530 0x7fda4c0659e0 unknown :-1 s=CLOSED pgs=3318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.479 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600fde20 0x7fda601146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.479 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda600f7c80 0x7fda60109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.480 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 --2- 172.21.15.112:0/1861353349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda600fd510 0x7fda60109ba0 unknown :-1 s=CLOSED pgs=2615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.480 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 >> 172.21.15.112:0/1861353349 conn(0x7fda6006e220 msgr2=0x7fda6006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:06.480 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 shutdown_connections 2021-10-08T19:44:06.481 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.475+0000 7fda6757a700 1 -- 172.21.15.112:0/1861353349 wait complete. 2021-10-08T19:44:06.481 INFO:tasks.workunit.client.0.smithi112.stderr:pool '1487472f-a27a-4747-95b7-fe9edad11601' already exists 2021-10-08T19:44:06.487 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool application enable 1487472f-a27a-4747-95b7-fe9edad11601 rados 2021-10-08T19:44:06.586 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 -- 172.21.15.112:0/2150057886 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 msgr2=0x7f78b4105700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:06.586 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 --2- 172.21.15.112:0/2150057886 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 0x7f78b4105700 secure :-1 s=READY pgs=2736 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009a60 tx=0x7f78ac004d10 comp rx=0 tx=0).stop 2021-10-08T19:44:06.587 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 -- 172.21.15.112:0/2150057886 shutdown_connections 2021-10-08T19:44:06.587 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 --2- 172.21.15.112:0/2150057886 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 0x7f78b4105700 unknown :-1 s=CLOSED pgs=2736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.587 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 --2- 172.21.15.112:0/2150057886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b40f8bb0 0x7f78b40f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.588 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 --2- 172.21.15.112:0/2150057886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78b40f94c0 0x7f78b40fa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.588 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 -- 172.21.15.112:0/2150057886 >> 172.21.15.112:0/2150057886 conn(0x7f78b406e430 msgr2=0x7f78b40f6920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:06.588 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 -- 172.21.15.112:0/2150057886 shutdown_connections 2021-10-08T19:44:06.589 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 -- 172.21.15.112:0/2150057886 wait complete. 2021-10-08T19:44:06.589 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 Processor -- start 2021-10-08T19:44:06.589 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 -- start start 2021-10-08T19:44:06.589 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.582+0000 7f78b9d86700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b40f8bb0 0x7f78b410e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:06.589 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b9d86700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78b40f94c0 0x7f78b410edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:06.590 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b9d86700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 0x7f78b4108950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:06.591 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b9d86700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4108f20 con 0x7f78b40f94c0 2021-10-08T19:44:06.591 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b9d86700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4109090 con 0x7f78b40f8bb0 2021-10-08T19:44:06.591 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b9d86700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4109250 con 0x7f78b40faa80 2021-10-08T19:44:06.592 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78b40f94c0 0x7f78b410edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:06.592 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 0x7f78b4108950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:06.592 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78b40f94c0 0x7f78b410edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44336/0 (socket says 172.21.15.112:44336) 2021-10-08T19:44:06.592 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b2ffd700 1 -- 172.21.15.112:0/333654727 learned_addr learned my addr 172.21.15.112:0/333654727 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:44:06.593 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b37fe700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b40f8bb0 0x7f78b410e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:06.593 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b3fff700 1 -- 172.21.15.112:0/333654727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b40f8bb0 msgr2=0x7f78b410e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:06.593 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b3fff700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b40f8bb0 0x7f78b410e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.593 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b3fff700 1 -- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78b40f94c0 msgr2=0x7f78b410edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:06.594 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b3fff700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78b40f94c0 0x7f78b410edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:06.594 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b3fff700 1 -- 172.21.15.112:0/333654727 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8005040 con 0x7f78b40faa80 2021-10-08T19:44:06.594 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b37fe700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b40f8bb0 0x7f78b410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:44:06.594 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b2ffd700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78b40f94c0 0x7f78b410edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:44:06.595 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b3fff700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 0x7f78b4108950 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009fd0 tx=0x7f78ac004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:06.595 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f789bfff700 1 -- 172.21.15.112:0/333654727 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00e070 con 0x7f78b40faa80 2021-10-08T19:44:06.595 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ac009640 con 0x7f78b40faa80 2021-10-08T19:44:06.595 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f789bfff700 1 -- 172.21.15.112:0/333654727 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f78ac009450 con 0x7f78b40faa80 2021-10-08T19:44:06.596 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f789bfff700 1 -- 172.21.15.112:0/333654727 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac012d90 con 0x7f78b40faa80 2021-10-08T19:44:06.596 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.583+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b4115680 con 0x7f78b40faa80 2021-10-08T19:44:06.596 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.584+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b4060900 con 0x7f78b40faa80 2021-10-08T19:44:06.596 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.584+0000 7f789bfff700 1 -- 172.21.15.112:0/333654727 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f78ac012410 con 0x7f78b40faa80 2021-10-08T19:44:06.597 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.585+0000 7f789bfff700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f789c063530 0x7f789c0659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:06.598 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.585+0000 7f78b37fe700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f789c063530 0x7f789c0659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:06.598 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.585+0000 7f789bfff700 1 -- 172.21.15.112:0/333654727 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(755..755 src has 1..755) v4 ==== 9256+0+0 (secure 0 0 0) 0x7f78ac082350 con 0x7f78b40faa80 2021-10-08T19:44:06.598 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.585+0000 7f78b37fe700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f789c063530 0x7f789c0659e0 secure :-1 s=READY pgs=3319 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009fd0 tx=0x7f78a400b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:06.599 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.589+0000 7f789bfff700 1 -- 172.21.15.112:0/333654727 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f78ac054270 con 0x7f78b40faa80 2021-10-08T19:44:06.758 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:06.756+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"} v 0) v1 -- 0x7f78b4109f00 con 0x7f78b40faa80 2021-10-08T19:44:07.274 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:44:07 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:44:07.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]: dispatch 2021-10-08T19:44:07.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]': finished 2021-10-08T19:44:07.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:06 smithi142 ceph-mon[33432]: osdmap e755: 8 total, 8 up, 8 in 2021-10-08T19:44:07.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]: dispatch 2021-10-08T19:44:07.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:06 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/333654727' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:07.276 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:06 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:07.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]: dispatch 2021-10-08T19:44:07.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]': finished 2021-10-08T19:44:07.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[40655]: osdmap e755: 8 total, 8 up, 8 in 2021-10-08T19:44:07.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]: dispatch 2021-10-08T19:44:07.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/333654727' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:07.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:07.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]: dispatch 2021-10-08T19:44:07.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]': finished 2021-10-08T19:44:07.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[31694]: osdmap e755: 8 total, 8 up, 8 in 2021-10-08T19:44:07.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/1861353349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "pg_num": 12}]: dispatch 2021-10-08T19:44:07.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/333654727' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:07.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:06 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:07.369 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:07.367+0000 7f789bfff700 1 -- 172.21.15.112:0/333654727 <== mon.1 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]=0 enabled application 'rados' on pool '1487472f-a27a-4747-95b7-fe9edad11601' v756) v1 ==== 213+0+0 (secure 0 0 0) 0x7f78ac017070 con 0x7f78b40faa80 2021-10-08T19:44:07.489 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:07.482+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"} v 0) v1 -- 0x7f78b4107be0 con 0x7f78b40faa80 2021-10-08T19:44:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[40655]: pgmap v1223: 188 pgs: 12 unknown, 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:08.071 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]': finished 2021-10-08T19:44:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[40655]: osdmap e756: 8 total, 8 up, 8 in 2021-10-08T19:44:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/333654727' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:08.072 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:08.072 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[31694]: pgmap v1223: 188 pgs: 12 unknown, 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:08.073 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]': finished 2021-10-08T19:44:08.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[31694]: osdmap e756: 8 total, 8 up, 8 in 2021-10-08T19:44:08.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/333654727' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:08.074 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:07 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:08.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:07 smithi142 ceph-mon[33432]: pgmap v1223: 188 pgs: 12 unknown, 176 active+clean; 688 KiB data, 516 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:08.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:07 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:08.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]': finished 2021-10-08T19:44:08.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:07 smithi142 ceph-mon[33432]: osdmap e756: 8 total, 8 up, 8 in 2021-10-08T19:44:08.274 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:07 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/333654727' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:08.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:07 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]: dispatch 2021-10-08T19:44:08.376 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.368+0000 7f789bfff700 1 -- 172.21.15.112:0/333654727 <== mon.1 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]=0 enabled application 'rados' on pool '1487472f-a27a-4747-95b7-fe9edad11601' v757) v1 ==== 213+0+0 (secure 0 0 0) 0x7f78ac053e60 con 0x7f78b40faa80 2021-10-08T19:44:08.376 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f789c063530 msgr2=0x7f789c0659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:08.376 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f789c063530 0x7f789c0659e0 secure :-1 s=READY pgs=3319 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009fd0 tx=0x7f78a400b040 comp rx=0 tx=0).stop 2021-10-08T19:44:08.376 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 msgr2=0x7f78b4108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:08.377 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 0x7f78b4108950 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009fd0 tx=0x7f78ac004d10 comp rx=0 tx=0).stop 2021-10-08T19:44:08.377 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 shutdown_connections 2021-10-08T19:44:08.377 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f789c063530 0x7f789c0659e0 unknown :-1 s=CLOSED pgs=3319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.377 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78b40faa80 0x7f78b4108950 unknown :-1 s=CLOSED pgs=2737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.378 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b40f8bb0 0x7f78b410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.378 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 --2- 172.21.15.112:0/333654727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78b40f94c0 0x7f78b410edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.378 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 >> 172.21.15.112:0/333654727 conn(0x7f78b406e430 msgr2=0x7f78b406e800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:08.378 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 shutdown_connections 2021-10-08T19:44:08.379 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.371+0000 7f78b9d86700 1 -- 172.21.15.112:0/333654727 wait complete. 2021-10-08T19:44:08.379 INFO:tasks.workunit.client.0.smithi112.stderr:enabled application 'rados' on pool '1487472f-a27a-4747-95b7-fe9edad11601' 2021-10-08T19:44:08.387 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool set-quota 1487472f-a27a-4747-95b7-fe9edad11601 max_objects 10 2021-10-08T19:44:08.488 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 -- 172.21.15.112:0/3965413114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7fd0 msgr2=0x7f5ae41043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:08.488 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/3965413114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7fd0 0x7f5ae41043e0 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009ae0 tx=0x7f5adc004c50 comp rx=0 tx=0).stop 2021-10-08T19:44:08.489 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 -- 172.21.15.112:0/3965413114 shutdown_connections 2021-10-08T19:44:08.489 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/3965413114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7fd0 0x7f5ae41043e0 unknown :-1 s=CLOSED pgs=2616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.490 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/3965413114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ae40f93f0 0x7f5ae40f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.490 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/3965413114 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ae40f7620 0x7f5ae40f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.491 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 -- 172.21.15.112:0/3965413114 >> 172.21.15.112:0/3965413114 conn(0x7f5ae406e340 msgr2=0x7f5ae406e740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:08.491 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 -- 172.21.15.112:0/3965413114 shutdown_connections 2021-10-08T19:44:08.491 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.480+0000 7f5aea8e9700 1 -- 172.21.15.112:0/3965413114 wait complete. 2021-10-08T19:44:08.491 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5aea8e9700 1 Processor -- start 2021-10-08T19:44:08.492 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5aea8e9700 1 -- start start 2021-10-08T19:44:08.492 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5aea8e9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7620 0x7f5ae410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:08.492 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5aea8e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ae40f7fd0 0x7f5ae410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:08.492 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5aea8e9700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ae40f93f0 0x7f5ae4107590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:08.492 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5aea8e9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4107b60 con 0x7f5ae40f7620 2021-10-08T19:44:08.493 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5aea8e9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4107cd0 con 0x7f5ae40f7fd0 2021-10-08T19:44:08.493 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5aea8e9700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4107e90 con 0x7f5ae40f93f0 2021-10-08T19:44:08.493 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5ae3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7620 0x7f5ae410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:08.493 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5ae8e86700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ae40f93f0 0x7f5ae4107590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:08.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5ae3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7620 0x7f5ae410d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44352/0 (socket says 172.21.15.112:44352) 2021-10-08T19:44:08.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5ae8e86700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ae40f93f0 0x7f5ae4107590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:38082/0 (socket says 172.21.15.112:38082) 2021-10-08T19:44:08.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5ae3fff700 1 -- 172.21.15.112:0/2853407657 learned_addr learned my addr 172.21.15.112:0/2853407657 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:44:08.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5ae37fe700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ae40f7fd0 0x7f5ae410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:08.494 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.481+0000 7f5ae3fff700 1 -- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ae40f93f0 msgr2=0x7f5ae4107590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:08.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae3fff700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ae40f93f0 0x7f5ae4107590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae3fff700 1 -- 172.21.15.112:0/2853407657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ae40f7fd0 msgr2=0x7f5ae410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:08.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae3fff700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ae40f7fd0 0x7f5ae410da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:08.495 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae3fff700 1 -- 172.21.15.112:0/2853407657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8005040 con 0x7f5ae40f7620 2021-10-08T19:44:08.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae37fe700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ae40f7fd0 0x7f5ae410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-08T19:44:08.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae8e86700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ae40f93f0 0x7f5ae4107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:44:08.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae3fff700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7620 0x7f5ae410d4c0 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4004fa0 tx=0x7f5ad400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:08.496 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae0ff9700 1 -- 172.21.15.112:0/2853407657 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40093b0 con 0x7f5ae40f7620 2021-10-08T19:44:08.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc009640 con 0x7f5ae40f7620 2021-10-08T19:44:08.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae0ff9700 1 -- 172.21.15.112:0/2853407657 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5ad400f040 con 0x7f5ae40f7620 2021-10-08T19:44:08.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5ae0ff9700 1 -- 172.21.15.112:0/2853407657 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4012770 con 0x7f5ae40f7620 2021-10-08T19:44:08.497 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.482+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae4061a80 con 0x7f5ae40f7620 2021-10-08T19:44:08.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.483+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae4060900 con 0x7f5ae40f7620 2021-10-08T19:44:08.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.483+0000 7f5ae0ff9700 1 -- 172.21.15.112:0/2853407657 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f5ad4022070 con 0x7f5ae40f7620 2021-10-08T19:44:08.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.483+0000 7f5ae0ff9700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f5acc063530 0x7f5acc0659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:44:08.498 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.484+0000 7f5ae0ff9700 1 -- 172.21.15.112:0/2853407657 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(757..757 src has 1..757) v4 ==== 9269+0+0 (secure 0 0 0) 0x7f5ad4016070 con 0x7f5ae40f7620 2021-10-08T19:44:08.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.484+0000 7f5ae37fe700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f5acc063530 0x7f5acc0659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:44:08.499 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.484+0000 7f5ae37fe700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f5acc063530 0x7f5acc0659e0 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4108d60 tx=0x7f5ad8009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:44:08.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.488+0000 7f5ae0ff9700 1 -- 172.21.15.112:0/2853407657 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f5ad4054590 con 0x7f5ae40f7620 2021-10-08T19:44:08.663 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:08.661+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f5ae4108aa0 con 0x7f5ae40f7620 2021-10-08T19:44:09.377 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:09.375+0000 7f5ae0ff9700 1 -- 172.21.15.112:0/2853407657 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 1487472f-a27a-4747-95b7-fe9edad11601 v758) v1 ==== 223+0+0 (secure 0 0 0) 0x7f5ad4020020 con 0x7f5ae40f7620 2021-10-08T19:44:09.492 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:09.490+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f5ae4061ca0 con 0x7f5ae40f7620 2021-10-08T19:44:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:09 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]': finished 2021-10-08T19:44:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:09 smithi142 ceph-mon[33432]: osdmap e757: 8 total, 8 up, 8 in 2021-10-08T19:44:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:09 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:44:09.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:09 smithi142 ceph-mon[33432]: pgmap v1226: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:44:09.820 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:09 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]': finished 2021-10-08T19:44:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:09 smithi112 ceph-mon[40655]: osdmap e757: 8 total, 8 up, 8 in 2021-10-08T19:44:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:09 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:44:09.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:09 smithi112 ceph-mon[40655]: pgmap v1226: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:44:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:09 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "app": "rados"}]': finished 2021-10-08T19:44:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:09 smithi112 ceph-mon[31694]: osdmap e757: 8 total, 8 up, 8 in 2021-10-08T19:44:09.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:09 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:44:09.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:09 smithi112 ceph-mon[31694]: pgmap v1226: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:44:10.379 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.377+0000 7f5ae0ff9700 1 -- 172.21.15.112:0/2853407657 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 1487472f-a27a-4747-95b7-fe9edad11601 v759) v1 ==== 223+0+0 (secure 0 0 0) 0x7f5ad4020030 con 0x7f5ae40f7620 2021-10-08T19:44:10.381 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f5acc063530 msgr2=0x7f5acc0659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:10.381 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f5acc063530 0x7f5acc0659e0 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4108d60 tx=0x7f5ad8009b30 comp rx=0 tx=0).stop 2021-10-08T19:44:10.381 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7620 msgr2=0x7f5ae410d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:44:10.381 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7620 0x7f5ae410d4c0 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4004fa0 tx=0x7f5ad400b040 comp rx=0 tx=0).stop 2021-10-08T19:44:10.382 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 shutdown_connections 2021-10-08T19:44:10.383 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f5acc063530 0x7f5acc0659e0 unknown :-1 s=CLOSED pgs=3320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:10.383 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5ae40f93f0 0x7f5ae4107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:10.383 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ae40f7620 0x7f5ae410d4c0 unknown :-1 s=CLOSED pgs=2617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:10.383 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 --2- 172.21.15.112:0/2853407657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ae40f7fd0 0x7f5ae410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:44:10.384 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.379+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 >> 172.21.15.112:0/2853407657 conn(0x7f5ae406e340 msgr2=0x7f5ae40f5610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:44:10.384 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.380+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 shutdown_connections 2021-10-08T19:44:10.384 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:44:10.380+0000 7f5aea8e9700 1 -- 172.21.15.112:0/2853407657 wait complete. 2021-10-08T19:44:10.384 INFO:tasks.workunit.client.0.smithi112.stderr:set-quota max_objects = 10 for pool 1487472f-a27a-4747-95b7-fe9edad11601 2021-10-08T19:44:10.392 INFO:tasks.workunit.client.0.smithi112.stderr:+ sleep 30 2021-10-08T19:44:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:44:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:10 smithi142 ceph-mon[33432]: osdmap e758: 8 total, 8 up, 8 in 2021-10-08T19:44:10.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:10 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:44:10.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:44:10.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:10 smithi112 ceph-mon[40655]: osdmap e758: 8 total, 8 up, 8 in 2021-10-08T19:44:10.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:10 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:44:10.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:44:10.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:10 smithi112 ceph-mon[31694]: osdmap e758: 8 total, 8 up, 8 in 2021-10-08T19:44:10.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:10 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]: dispatch 2021-10-08T19:44:11.390 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:44:11.391 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:11 smithi142 ceph-mon[33432]: osdmap e759: 8 total, 8 up, 8 in 2021-10-08T19:44:11.391 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:11 smithi142 ceph-mon[33432]: pgmap v1229: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:44:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:44:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:11 smithi112 ceph-mon[40655]: osdmap e759: 8 total, 8 up, 8 in 2021-10-08T19:44:11.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:11 smithi112 ceph-mon[40655]: pgmap v1229: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:44:11.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/2853407657' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "1487472f-a27a-4747-95b7-fe9edad11601", "field": "max_objects", "val": "10"}]': finished 2021-10-08T19:44:11.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:11 smithi112 ceph-mon[31694]: osdmap e759: 8 total, 8 up, 8 in 2021-10-08T19:44:11.825 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:11 smithi112 ceph-mon[31694]: pgmap v1229: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2021-10-08T19:44:12.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:11 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:44:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:13.239 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:12 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:13.240 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:12 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:44:13.240 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:12 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:44:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:13.241 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:44:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:13.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:12 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:13.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:12 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:44:13.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:12 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:44:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:13.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:12 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:13.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:12 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:44:13.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:12 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:44:11] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:13.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:13.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:13.533Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:44:14.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:13 smithi142 ceph-mon[33432]: pgmap v1230: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 915 B/s rd, 3.2 KiB/s wr, 1 op/s 2021-10-08T19:44:14.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:13 smithi112 ceph-mon[40655]: pgmap v1230: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 915 B/s rd, 3.2 KiB/s wr, 1 op/s 2021-10-08T19:44:14.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:13 smithi112 ceph-mon[31694]: pgmap v1230: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 915 B/s rd, 3.2 KiB/s wr, 1 op/s 2021-10-08T19:44:15.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:15] "GET /metrics HTTP/1.1" 200 157686 "" "Prometheus/2.18.1" 2021-10-08T19:44:16.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:16 smithi142 ceph-mon[33432]: pgmap v1231: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2021-10-08T19:44:16.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:16 smithi112 ceph-mon[40655]: pgmap v1231: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2021-10-08T19:44:16.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:16 smithi112 ceph-mon[31694]: pgmap v1231: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.7 KiB/s wr, 1 op/s 2021-10-08T19:44:17.522 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:44:17 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:44:18.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:18 smithi142 ceph-mon[33432]: pgmap v1232: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:18.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:18 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:18.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:18 smithi112 ceph-mon[31694]: pgmap v1232: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:18.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:18 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:18.321 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:18 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:44:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:18 smithi112 ceph-mon[40655]: pgmap v1232: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:44:18.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:18 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:19.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:19 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:19 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:44:19.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:19 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:44:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:19 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:19 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:44:19.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:19 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:44:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:19 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:19 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:44:19.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:19 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:44:18] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:20.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:20 smithi142 ceph-mon[33432]: pgmap v1233: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:44:20.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:20 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[40655]: pgmap v1233: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:44:20.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:20.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:20.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[31694]: pgmap v1233: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2021-10-08T19:44:20.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:44:20.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:44:20.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:44:20.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:20 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:21.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:21 smithi142 ceph-mon[33432]: pgmap v1234: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 967 B/s rd, 0 op/s 2021-10-08T19:44:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:21 smithi112 ceph-mon[40655]: pgmap v1234: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 967 B/s rd, 0 op/s 2021-10-08T19:44:21.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:21 smithi112 ceph-mon[31694]: pgmap v1234: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 967 B/s rd, 0 op/s 2021-10-08T19:44:23.173 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:23.173 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:23.174 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:23.174 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:23.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:23.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:23.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:23.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:23.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:23.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:23.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:44:23.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:44:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:44:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:23.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:23.533Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:23.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:23.533Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:44:24.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:23 smithi142 ceph-mon[33432]: pgmap v1235: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:24.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:23 smithi112 ceph-mon[40655]: pgmap v1235: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:24.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:23 smithi112 ceph-mon[31694]: pgmap v1235: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:25.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:25] "GET /metrics HTTP/1.1" 200 157718 "" "Prometheus/2.18.1" 2021-10-08T19:44:26.272 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:26 smithi142 ceph-mon[33432]: pgmap v1236: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:26.326 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:26 smithi112 ceph-mon[40655]: pgmap v1236: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:26.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:26 smithi112 ceph-mon[31694]: pgmap v1236: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:27.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:44:27 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:44:28.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:28 smithi142 ceph-mon[33432]: pgmap v1237: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:28.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:28.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:28 smithi112 ceph-mon[40655]: pgmap v1237: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:28.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:28.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:28 smithi112 ceph-mon[31694]: pgmap v1237: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:28.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:30.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:30 smithi112 ceph-mon[40655]: pgmap v1238: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:30.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:30 smithi112 ceph-mon[31694]: pgmap v1238: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:30 smithi142 ceph-mon[33432]: pgmap v1238: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:31.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:31 smithi142 ceph-mon[33432]: pgmap v1239: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:44:31.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:31 smithi112 ceph-mon[40655]: pgmap v1239: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:44:31.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:31 smithi112 ceph-mon[31694]: pgmap v1239: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-10-08T19:44:33.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:44:33 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:33.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:33.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:33.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:33.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:33 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:33.534Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:44:34.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:34 smithi142 ceph-mon[33432]: pgmap v1240: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:34.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:34 smithi112 ceph-mon[40655]: pgmap v1240: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:34.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:34 smithi112 ceph-mon[31694]: pgmap v1240: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:35.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:35 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:35] "GET /metrics HTTP/1.1" 200 157718 "" "Prometheus/2.18.1" 2021-10-08T19:44:36.275 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:36 smithi142 ceph-mon[33432]: pgmap v1241: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:36.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:36 smithi112 ceph-mon[40655]: pgmap v1241: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:36.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:36 smithi112 ceph-mon[31694]: pgmap v1241: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:37.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:44:37 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:44:38.318 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:38 smithi142 ceph-mon[33432]: pgmap v1242: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:38.318 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:38 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:38.320 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:38 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:44:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:38.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:38 smithi112 ceph-mon[31694]: pgmap v1242: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:38.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:38 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:38 smithi112 ceph-mon[40655]: pgmap v1242: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:38.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:38 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:39.458 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:39 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:39.458 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:39 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:44:39.459 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:39 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:44:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:39 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:39 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:44:39.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:39 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:44:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:39 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:39 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:44:39.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:39 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:44:38] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:40.394 INFO:tasks.workunit.client.0.smithi112.stderr:++ seq 1 10 2021-10-08T19:44:40.395 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.396 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj1 /etc/passwd 2021-10-08T19:44:40.431 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.432 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj2 /etc/passwd 2021-10-08T19:44:40.463 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.464 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj3 /etc/passwd 2021-10-08T19:44:40.494 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.494 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj4 /etc/passwd 2021-10-08T19:44:40.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:40 smithi142 ceph-mon[33432]: pgmap v1243: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:40.524 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.524 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj5 /etc/passwd 2021-10-08T19:44:40.554 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.554 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj6 /etc/passwd 2021-10-08T19:44:40.570 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:40 smithi112 ceph-mon[40655]: pgmap v1243: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:40.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:40 smithi112 ceph-mon[31694]: pgmap v1243: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:44:40.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:40 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:40.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:40.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:40 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:40.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:40.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:40 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:40.140Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:44:40.582 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.582 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj7 /etc/passwd 2021-10-08T19:44:40.611 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.612 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj8 /etc/passwd 2021-10-08T19:44:40.641 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.641 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj9 /etc/passwd 2021-10-08T19:44:40.670 INFO:tasks.workunit.client.0.smithi112.stderr:+ for f in `seq 1 10` 2021-10-08T19:44:40.671 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p 1487472f-a27a-4747-95b7-fe9edad11601 put obj10 /etc/passwd 2021-10-08T19:44:40.698 INFO:tasks.workunit.client.0.smithi112.stderr:+ sleep 30 2021-10-08T19:44:41.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:41 smithi142 ceph-mon[33432]: pgmap v1244: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:41.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:41 smithi112 ceph-mon[40655]: pgmap v1244: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:41.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:41 smithi112 ceph-mon[31694]: pgmap v1244: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:43.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:44:43 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:43.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:43.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:43.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:43.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:43.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:43 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:43.534Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:44:44.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:44 smithi112 ceph-mon[40655]: pgmap v1245: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:44.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:44 smithi112 ceph-mon[31694]: pgmap v1245: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:44.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:44 smithi142 ceph-mon[33432]: pgmap v1245: 188 pgs: 188 active+clean; 705 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:44:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:45 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:44:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:45.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:45 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:45] "GET /metrics HTTP/1.1" 200 157716 "" "Prometheus/2.18.1" 2021-10-08T19:44:46.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[40655]: pgmap v1246: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 2 op/s 2021-10-08T19:44:46.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:46.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:44:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:44:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[40655]: pool '1487472f-a27a-4747-95b7-fe9edad11601' is full (reached quota's max_objects: 10) 2021-10-08T19:44:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[40655]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:44:46.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[40655]: osdmap e760: 8 total, 8 up, 8 in 2021-10-08T19:44:46.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[31694]: pgmap v1246: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 2 op/s 2021-10-08T19:44:46.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:46.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:44:46.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:44:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:46.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[31694]: pool '1487472f-a27a-4747-95b7-fe9edad11601' is full (reached quota's max_objects: 10) 2021-10-08T19:44:46.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[31694]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:44:46.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:46 smithi112 ceph-mon[31694]: osdmap e760: 8 total, 8 up, 8 in 2021-10-08T19:44:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:46 smithi142 ceph-mon[33432]: pgmap v1246: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 2 op/s 2021-10-08T19:44:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:46 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:44:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:46 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:44:46.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:46 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:44:45] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:44:46.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:46 smithi142 ceph-mon[33432]: pool '1487472f-a27a-4747-95b7-fe9edad11601' is full (reached quota's max_objects: 10) 2021-10-08T19:44:46.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:46 smithi142 ceph-mon[33432]: Health check failed: 1 pool(s) full (POOL_FULL) 2021-10-08T19:44:46.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:46 smithi142 ceph-mon[33432]: osdmap e760: 8 total, 8 up, 8 in 2021-10-08T19:44:47.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:44:47 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:44:48.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:48 smithi112 ceph-mon[31694]: pgmap v1248: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:48.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:48 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:48.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:48 smithi112 ceph-mon[40655]: pgmap v1248: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:48.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:48 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:48 smithi142 ceph-mon[33432]: pgmap v1248: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:48.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:48 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:50.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:50 smithi142 ceph-mon[33432]: pgmap v1249: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:50.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:50 smithi112 ceph-mon[40655]: pgmap v1249: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:50.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:50 smithi112 ceph-mon[31694]: pgmap v1249: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:50.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:50 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:50.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:50.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:50 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:50.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:50.573 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:50 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:50.140Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:44:51.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:51 smithi142 ceph-mon[33432]: pgmap v1250: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:51.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:51 smithi112 ceph-mon[40655]: pgmap v1250: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:51.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:51 smithi112 ceph-mon[31694]: pgmap v1250: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:53.522 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:44:53 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:44:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:53.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:53.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:53.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:44:53.824 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:44:53 smithi112 conmon[81261]: level=error ts=2021-10-08T19:44:53.534Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:44:54.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:54 smithi112 ceph-mon[40655]: pgmap v1251: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:54.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:54 smithi112 ceph-mon[31694]: pgmap v1251: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:54.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:54 smithi142 ceph-mon[33432]: pgmap v1251: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 9.0 KiB/s wr, 1 op/s 2021-10-08T19:44:55.572 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:44:55 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:44:55] "GET /metrics HTTP/1.1" 200 157747 "" "Prometheus/2.18.1" 2021-10-08T19:44:56.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:56 smithi112 ceph-mon[31694]: pgmap v1252: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:56.347 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:56 smithi112 ceph-mon[40655]: pgmap v1252: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:56.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:56 smithi142 ceph-mon[33432]: pgmap v1252: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-10-08T19:44:57.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:44:57 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:44:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:58 smithi112 ceph-mon[40655]: pgmap v1253: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2021-10-08T19:44:58.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:44:58 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:58 smithi112 ceph-mon[31694]: pgmap v1253: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2021-10-08T19:44:58.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:44:58 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:44:58.522 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:58 smithi142 ceph-mon[33432]: pgmap v1253: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2021-10-08T19:44:58.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:44:58 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:00.312 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:00 smithi112 ceph-mon[40655]: pgmap v1254: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:00.312 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:00 smithi112 ceph-mon[31694]: pgmap v1254: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:00.313 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:00 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:00.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:00.313 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:00 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:00.140Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:00.313 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:00 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:00.140Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:45:00.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:00 smithi142 ceph-mon[33432]: pgmap v1254: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:01.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:01 smithi142 ceph-mon[33432]: pgmap v1255: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:01.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:01 smithi112 ceph-mon[31694]: pgmap v1255: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:01.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:01 smithi112 ceph-mon[40655]: pgmap v1255: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:03.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:45:03 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:45:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:45:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:03.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:03.534Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:03.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:03 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:03.534Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs; Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" 2021-10-08T19:45:04.304 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:04 smithi112 ceph-mon[40655]: pgmap v1256: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:04.305 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:04 smithi112 ceph-mon[31694]: pgmap v1256: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:04.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:04 smithi142 ceph-mon[33432]: pgmap v1256: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:04.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:45:04 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:45:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:05 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:05 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:45:05.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:05 smithi142 ceph-mon[33432]: 172.21.15.112 - - [08/Oct/2021:19:45:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:05.571 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:45:05 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:45:05] "GET /metrics HTTP/1.1" 200 157747 "" "Prometheus/2.18.1" 2021-10-08T19:45:05.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:05 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:05.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:05 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:45:05.573 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:05 smithi112 ceph-mon[31694]: 172.21.15.112 - - [08/Oct/2021:19:45:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:05.573 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:05 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:05.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:05 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi112. 2021-10-08T19:45:05.574 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:05 smithi112 ceph-mon[40655]: 172.21.15.112 - - [08/Oct/2021:19:45:04] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:06.572 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:06 smithi112 ceph-mon[40655]: pgmap v1257: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:06.574 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:06 smithi112 ceph-mon[31694]: pgmap v1257: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:06.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:06 smithi142 ceph-mon[33432]: pgmap v1257: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:07.523 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:45:07 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:45:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:08 smithi112 ceph-mon[40655]: pgmap v1258: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:08.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:08 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:08 smithi112 ceph-mon[31694]: pgmap v1258: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:08.572 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:08 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:08.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:08 smithi142 ceph-mon[33432]: pgmap v1258: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:08.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:08 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:10.571 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:10 smithi112 ceph-mon[40655]: pgmap v1259: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:10.571 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:10 smithi112 ceph-mon[31694]: pgmap v1259: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:10.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:10 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:10.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:10.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:10 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:10.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:10.572 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:10 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:10.141Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:45:10.699 INFO:tasks.workunit.client.0.smithi112.stderr:+ rados -p c4948540-7f5b-41ca-ab7e-9986a908a571 put threemore /etc/passwd 2021-10-08T19:45:10.736 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool set-quota c4948540-7f5b-41ca-ab7e-9986a908a571 max_bytes 0 2021-10-08T19:45:10.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:10 smithi142 ceph-mon[33432]: pgmap v1259: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:10.843 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.838+0000 7f1f07050700 1 -- 172.21.15.112:0/3384534254 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f8bb0 msgr2=0x7f1f000f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:10.844 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.838+0000 7f1f07050700 1 --2- 172.21.15.112:0/3384534254 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f8bb0 0x7f1f000f8f80 secure :-1 s=READY pgs=2755 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40046e0 tx=0x7f1ef4009b30 comp rx=0 tx=0).stop 2021-10-08T19:45:10.844 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.838+0000 7f1f07050700 1 -- 172.21.15.112:0/3384534254 shutdown_connections 2021-10-08T19:45:10.844 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.838+0000 7f1f07050700 1 --2- 172.21.15.112:0/3384534254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f000faa80 0x7f1f00105700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:10.844 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.838+0000 7f1f07050700 1 --2- 172.21.15.112:0/3384534254 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f8bb0 0x7f1f000f8f80 unknown :-1 s=CLOSED pgs=2755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:10.844 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.838+0000 7f1f07050700 1 --2- 172.21.15.112:0/3384534254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f000f94c0 0x7f1f000fa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:10.845 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.838+0000 7f1f07050700 1 -- 172.21.15.112:0/3384534254 >> 172.21.15.112:0/3384534254 conn(0x7f1f0006e430 msgr2=0x7f1f000f6920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:45:10.845 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 -- 172.21.15.112:0/3384534254 shutdown_connections 2021-10-08T19:45:10.845 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 -- 172.21.15.112:0/3384534254 wait complete. 2021-10-08T19:45:10.845 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 Processor -- start 2021-10-08T19:45:10.846 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 -- start start 2021-10-08T19:45:10.846 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f000f8bb0 0x7f1f0010ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:45:10.846 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f94c0 0x7f1f0010efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:45:10.846 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f000faa80 0x7f1f00108b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:45:10.847 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001090d0 con 0x7f1f000f8bb0 2021-10-08T19:45:10.847 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f00109210 con 0x7f1f000faa80 2021-10-08T19:45:10.847 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.839+0000 7f1f07050700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001093d0 con 0x7f1f000f94c0 2021-10-08T19:45:10.847 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f94c0 0x7f1f0010efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:45:10.848 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1f04dec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f000f8bb0 0x7f1f0010ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:45:10.848 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f94c0 0x7f1f0010efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:38606/0 (socket says 172.21.15.112:38606) 2021-10-08T19:45:10.848 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1f04dec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f000f8bb0 0x7f1f0010ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44876/0 (socket says 172.21.15.112:44876) 2021-10-08T19:45:10.848 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 -- 172.21.15.112:0/3068655036 learned_addr learned my addr 172.21.15.112:0/3068655036 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:45:10.848 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1f055ed700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f000faa80 0x7f1f00108b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:45:10.849 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 -- 172.21.15.112:0/3068655036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f000faa80 msgr2=0x7f1f00108b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:10.849 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f000faa80 0x7f1f00108b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:10.850 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 -- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f000f8bb0 msgr2=0x7f1f0010ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:10.851 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f000f8bb0 0x7f1f0010ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:10.851 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef4005040 con 0x7f1f000f94c0 2021-10-08T19:45:10.851 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1f04dec700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f000f8bb0 0x7f1f0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:45:10.851 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1f055ed700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f000faa80 0x7f1f00108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2021-10-08T19:45:10.851 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efffff700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f94c0 0x7f1f0010efd0 secure :-1 s=READY pgs=2756 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00e840 tx=0x7f1eec00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:45:10.852 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec0092e0 con 0x7f1f000f94c0 2021-10-08T19:45:10.852 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1eec00f040 con 0x7f1f000f94c0 2021-10-08T19:45:10.852 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f001096b0 con 0x7f1f000f94c0 2021-10-08T19:45:10.852 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f00115a80 con 0x7f1f000f94c0 2021-10-08T19:45:10.853 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.840+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec014690 con 0x7f1f000f94c0 2021-10-08T19:45:10.853 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.841+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f00060900 con 0x7f1f000f94c0 2021-10-08T19:45:10.853 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.842+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f1eec01b030 con 0x7f1f000f94c0 2021-10-08T19:45:10.853 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.842+0000 7f1efd7fa700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ef0063530 0x7f1ef00659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:45:10.854 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.842+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 5 ==== osd_map(760..760 src has 1..760) v4 ==== 9269+0+0 (secure 0 0 0) 0x7f1eec0800a0 con 0x7f1f000f94c0 2021-10-08T19:45:10.854 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.842+0000 7f1f04dec700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ef0063530 0x7f1ef00659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:45:10.854 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.842+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=761}) v3 -- 0x7f1ef006f4c0 con 0x7f1f000f94c0 2021-10-08T19:45:10.854 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.842+0000 7f1f04dec700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ef0063530 0x7f1ef00659e0 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009c10 tx=0x7f1ef4009b30 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:45:10.855 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:10.846+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f1eec048b00 con 0x7f1f000f94c0 2021-10-08T19:45:11.007 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:11.006+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f1f0010a070 con 0x7f1f000f94c0 2021-10-08T19:45:11.371 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:11.371+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 7 ==== osd_map(761..761 src has 1..761) v4 ==== 620+0+0 (secure 0 0 0) 0x7f1eec007a00 con 0x7f1f000f94c0 2021-10-08T19:45:11.372 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:11.371+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=762}) v3 -- 0x7f1ef0070090 con 0x7f1f000f94c0 2021-10-08T19:45:11.376 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:11.374+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v761) v1 ==== 217+0+0 (secure 0 0 0) 0x7f1eec019020 con 0x7f1f000f94c0 2021-10-08T19:45:11.483 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:11.483+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f1f0005fe70 con 0x7f1f000f94c0 2021-10-08T19:45:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:11 smithi142 ceph-mon[33432]: pgmap v1260: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:11 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3068655036' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:11.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:11 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:11 smithi112 ceph-mon[40655]: pgmap v1260: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:11 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3068655036' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:11.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:11 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:11.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:11 smithi112 ceph-mon[31694]: pgmap v1260: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:11.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:11 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3068655036' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:11.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:11 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:12.323 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:45:12 smithi112 conmon[32108]: 172.21.15.142 - - [08/Oct/2021:19:45:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:12.373 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.373+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 9 ==== osd_map(762..762 src has 1..762) v4 ==== 620+0+0 (secure 0 0 0) 0x7f1eec0077b0 con 0x7f1f000f94c0 2021-10-08T19:45:12.374 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.373+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=763}) v3 -- 0x7f1ef0070560 con 0x7f1f000f94c0 2021-10-08T19:45:12.377 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.377+0000 7f1efd7fa700 1 -- 172.21.15.112:0/3068655036 <== mon.1 v2:172.21.15.112:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v762) v1 ==== 217+0+0 (secure 0 0 0) 0x7f1eec066030 con 0x7f1f000f94c0 2021-10-08T19:45:12.381 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ef0063530 msgr2=0x7f1ef00659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:12.382 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ef0063530 0x7f1ef00659e0 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009c10 tx=0x7f1ef4009b30 comp rx=0 tx=0).stop 2021-10-08T19:45:12.382 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f94c0 msgr2=0x7f1f0010efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:12.382 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f94c0 0x7f1f0010efd0 secure :-1 s=READY pgs=2756 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00e840 tx=0x7f1eec00b040 comp rx=0 tx=0).stop 2021-10-08T19:45:12.383 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 shutdown_connections 2021-10-08T19:45:12.384 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f1ef0063530 0x7f1ef00659e0 unknown :-1 s=CLOSED pgs=3332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.384 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f000faa80 0x7f1f00108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.384 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f000f8bb0 0x7f1f0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.384 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 --2- 172.21.15.112:0/3068655036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f000f94c0 0x7f1f0010efd0 unknown :-1 s=CLOSED pgs=2756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.385 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 >> 172.21.15.112:0/3068655036 conn(0x7f1f0006e430 msgr2=0x7f1f0006f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:45:12.385 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.381+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 shutdown_connections 2021-10-08T19:45:12.385 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.382+0000 7f1f07050700 1 -- 172.21.15.112:0/3068655036 wait complete. 2021-10-08T19:45:12.385 INFO:tasks.workunit.client.0.smithi112.stderr:set-quota max_bytes = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 2021-10-08T19:45:12.396 INFO:tasks.workunit.client.0.smithi112.stderr:+ ceph osd pool set-quota c4948540-7f5b-41ca-ab7e-9986a908a571 max_objects 0 2021-10-08T19:45:12.500 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.495+0000 7f298b0db700 1 -- 172.21.15.112:0/1232432697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f7d40 msgr2=0x7f2984104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:12.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.495+0000 7f298b0db700 1 --2- 172.21.15.112:0/1232432697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f7d40 0x7f2984104420 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7f297c009a90 tx=0x7f297c004d10 comp rx=0 tx=0).stop 2021-10-08T19:45:12.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.495+0000 7f298b0db700 1 -- 172.21.15.112:0/1232432697 shutdown_connections 2021-10-08T19:45:12.501 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.495+0000 7f298b0db700 1 --2- 172.21.15.112:0/1232432697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f7d40 0x7f2984104420 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.495+0000 7f298b0db700 1 --2- 172.21.15.112:0/1232432697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29840f9360 0x7f29840f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.495+0000 7f298b0db700 1 --2- 172.21.15.112:0/1232432697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29840f9c70 0x7f29840f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.495+0000 7f298b0db700 1 -- 172.21.15.112:0/1232432697 >> 172.21.15.112:0/1232432697 conn(0x7f298406d400 msgr2=0x7f298406d800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:45:12.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.495+0000 7f298b0db700 1 -- 172.21.15.112:0/1232432697 shutdown_connections 2021-10-08T19:45:12.502 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 -- 172.21.15.112:0/1232432697 wait complete. 2021-10-08T19:45:12.503 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 Processor -- start 2021-10-08T19:45:12.503 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 -- start start 2021-10-08T19:45:12.503 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29840f7d40 0x7f29841097d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:45:12.503 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29840f9360 0x7f2984109d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:45:12.504 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f9c70 0x7f2984114850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:45:12.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298410a4f0 con 0x7f29840f9c70 2021-10-08T19:45:12.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298410a660 con 0x7f29840f9360 2021-10-08T19:45:12.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f298b0db700 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2984114de0 con 0x7f29840f7d40 2021-10-08T19:45:12.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f2988e77700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29840f7d40 0x7f29841097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:45:12.506 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f2989678700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f9c70 0x7f2984114850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:45:12.506 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f2988e77700 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29840f7d40 0x7f29841097d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:38624/0 (socket says 172.21.15.112:38624) 2021-10-08T19:45:12.508 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.496+0000 7f2988e77700 1 -- 172.21.15.112:0/894812207 learned_addr learned my addr 172.21.15.112:0/894812207 (peer_addr_for_me v2:172.21.15.112:0/0) 2021-10-08T19:45:12.508 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f2983fff700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29840f9360 0x7f2984109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:45:12.508 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f2989678700 1 -- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29840f7d40 msgr2=0x7f29841097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:12.509 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f2989678700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29840f7d40 0x7f29841097d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.509 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f2989678700 1 -- 172.21.15.112:0/894812207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29840f9360 msgr2=0x7f2984109d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:12.509 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f2989678700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29840f9360 0x7f2984109d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:12.509 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f2989678700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978005040 con 0x7f29840f9c70 2021-10-08T19:45:12.510 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f2988e77700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29840f7d40 0x7f29841097d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2021-10-08T19:45:12.510 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f2989678700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f9c70 0x7f2984114850 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f297c015040 tx=0x7f297c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:45:12.510 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00e070 con 0x7f29840f9c70 2021-10-08T19:45:12.510 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(23 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f297c009450 con 0x7f29840f9c70 2021-10-08T19:45:12.511 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c009640 con 0x7f29840f9c70 2021-10-08T19:45:12.511 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c01ce60 con 0x7f29840f9c70 2021-10-08T19:45:12.511 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.497+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2984115330 con 0x7f29840f9c70 2021-10-08T19:45:12.511 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.498+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2984060900 con 0x7f29840f9c70 2021-10-08T19:45:12.511 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.498+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) v1 ==== 80863+0+0 (secure 0 0 0) 0x7f297c01c440 con 0x7f29840f9c70 2021-10-08T19:45:12.512 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.499+0000 7f29817fa700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2974063530 0x7f29740659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2021-10-08T19:45:12.512 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.499+0000 7f2988e77700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2974063530 0x7f29740659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2021-10-08T19:45:12.512 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.499+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(762..762 src has 1..762) v4 ==== 9269+0+0 (secure 0 0 0) 0x7f297c082550 con 0x7f29840f9c70 2021-10-08T19:45:12.512 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.499+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=763}) v3 -- 0x7f297406f540 con 0x7f29840f9c70 2021-10-08T19:45:12.513 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.499+0000 7f2988e77700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2974063530 0x7f29740659e0 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7f2978009fd0 tx=0x7f297800b040 comp rx=0 tx=0).ready entity=mgr.14532 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-08T19:45:12.517 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.503+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+154344 (secure 0 0 0) 0x7f297c017070 con 0x7f29840f9c70 2021-10-08T19:45:12.665 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:12.665+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f29840621c0 con 0x7f29840f9c70 2021-10-08T19:45:12.775 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:45:12.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:12 smithi142 ceph-mon[33432]: osdmap e761: 8 total, 8 up, 8 in 2021-10-08T19:45:12.776 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:12 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/3068655036' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:12.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:12 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:12.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:12 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:12.777 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:12 smithi142 ceph-mon[33432]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:45:12.778 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:12 smithi142 ceph-mon[33432]: 172.21.15.142 - - [08/Oct/2021:19:45:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:12.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:45:12.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[31694]: osdmap e761: 8 total, 8 up, 8 in 2021-10-08T19:45:12.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/3068655036' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:12.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:12.822 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:12.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[31694]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:45:12.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[31694]: 172.21.15.142 - - [08/Oct/2021:19:45:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:12.823 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:45:12.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[40655]: osdmap e761: 8 total, 8 up, 8 in 2021-10-08T19:45:12.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/3068655036' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:12.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]: dispatch 2021-10-08T19:45:12.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:12.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[40655]: Received up-to-date metadata from agent on host smithi142. 2021-10-08T19:45:12.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:12 smithi112 ceph-mon[40655]: 172.21.15.142 - - [08/Oct/2021:19:45:12] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:13.389 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:13.388+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 7 ==== osd_map(763..763 src has 1..763) v4 ==== 620+0+0 (secure 0 0 0) 0x7f297c004580 con 0x7f29840f9c70 2021-10-08T19:45:13.389 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:13.388+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=764}) v3 -- 0x7f2974070180 con 0x7f29840f9c70 2021-10-08T19:45:13.397 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:13.396+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v763) v1 ==== 221+0+0 (secure 0 0 0) 0x7f297c054540 con 0x7f29840f9c70 2021-10-08T19:45:13.505 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:13.504+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f29840621c0 con 0x7f29840f9c70 2021-10-08T19:45:13.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:45:13 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:45:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:45:13.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:13 smithi142 ceph-mon[33432]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:45:13.526 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:13 smithi142 ceph-mon[33432]: osdmap e762: 8 total, 8 up, 8 in 2021-10-08T19:45:13.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:13 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:45:13.527 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:13 smithi142 ceph-mon[33432]: pgmap v1263: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:45:13.821 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:13.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:13.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:13.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:13.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:13 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:13.535Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:45:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:13 smithi112 ceph-mon[31694]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:45:13.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:13 smithi112 ceph-mon[31694]: osdmap e762: 8 total, 8 up, 8 in 2021-10-08T19:45:13.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:13 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:45:13.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:13 smithi112 ceph-mon[31694]: pgmap v1263: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:45:13.824 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:13 smithi112 ceph-mon[40655]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_bytes", "val": "0"}]': finished 2021-10-08T19:45:13.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:13 smithi112 ceph-mon[40655]: osdmap e762: 8 total, 8 up, 8 in 2021-10-08T19:45:13.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:13 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:45:13.825 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:13 smithi112 ceph-mon[40655]: pgmap v1263: 188 pgs: 188 active+clean; 793 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-10-08T19:45:14.400 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.387+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 9 ==== osd_map(764..764 src has 1..764) v4 ==== 620+0+0 (secure 0 0 0) 0x7f297c054c10 con 0x7f29840f9c70 2021-10-08T19:45:14.401 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.388+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=765}) v3 -- 0x7f2974070650 con 0x7f29840f9c70 2021-10-08T19:45:14.401 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.393+0000 7f29817fa700 1 -- 172.21.15.112:0/894812207 <== mon.0 v2:172.21.15.112:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 v764) v1 ==== 221+0+0 (secure 0 0 0) 0x7f297c054540 con 0x7f29840f9c70 2021-10-08T19:45:14.401 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.396+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2974063530 msgr2=0x7f29740659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:14.402 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.396+0000 7f298b0db700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2974063530 0x7f29740659e0 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7f2978009fd0 tx=0x7f297800b040 comp rx=0 tx=0).stop 2021-10-08T19:45:14.402 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f9c70 msgr2=0x7f2984114850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-08T19:45:14.402 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f9c70 0x7f2984114850 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f297c015040 tx=0x7f297c004d10 comp rx=0 tx=0).stop 2021-10-08T19:45:14.402 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 shutdown_connections 2021-10-08T19:45:14.403 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:6800/471677461,v1:172.21.15.112:6801/471677461] conn(0x7f2974063530 0x7f29740659e0 unknown :-1 s=CLOSED pgs=3333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:14.403 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29840f9c70 0x7f2984114850 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:14.403 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f29840f7d40 0x7f29841097d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:14.403 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 --2- 172.21.15.112:0/894812207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29840f9360 0x7f2984109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2021-10-08T19:45:14.403 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 >> 172.21.15.112:0/894812207 conn(0x7f298406d400 msgr2=0x7f29840f6630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-08T19:45:14.404 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 shutdown_connections 2021-10-08T19:45:14.404 INFO:tasks.workunit.client.0.smithi112.stderr:2021-10-08T19:45:14.397+0000 7f298b0db700 1 -- 172.21.15.112:0/894812207 wait complete. 2021-10-08T19:45:14.404 INFO:tasks.workunit.client.0.smithi112.stderr:set-quota max_objects = 0 for pool c4948540-7f5b-41ca-ab7e-9986a908a571 2021-10-08T19:45:14.411 INFO:tasks.workunit.client.0.smithi112.stderr:+ sleep 30 2021-10-08T19:45:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:45:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:14 smithi142 ceph-mon[33432]: osdmap e763: 8 total, 8 up, 8 in 2021-10-08T19:45:14.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:14 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:45:14.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:45:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:14 smithi112 ceph-mon[40655]: osdmap e763: 8 total, 8 up, 8 in 2021-10-08T19:45:14.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:14 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:45:14.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:45:14.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:14 smithi112 ceph-mon[31694]: osdmap e763: 8 total, 8 up, 8 in 2021-10-08T19:45:14.823 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:14 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]: dispatch 2021-10-08T19:45:15.401 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:45:15 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:45:15] "GET /metrics HTTP/1.1" 200 157754 "" "Prometheus/2.18.1" 2021-10-08T19:45:15.773 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:15 smithi142 ceph-mon[33432]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:45:15.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:15 smithi142 ceph-mon[33432]: osdmap e764: 8 total, 8 up, 8 in 2021-10-08T19:45:15.774 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:15 smithi142 ceph-mon[33432]: pgmap v1266: 188 pgs: 188 active+clean; 802 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:45:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:15 smithi112 ceph-mon[31694]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:45:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:15 smithi112 ceph-mon[31694]: osdmap e764: 8 total, 8 up, 8 in 2021-10-08T19:45:15.821 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:15 smithi112 ceph-mon[31694]: pgmap v1266: 188 pgs: 188 active+clean; 802 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:45:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:15 smithi112 ceph-mon[40655]: from='client.? 172.21.15.112:0/894812207' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "c4948540-7f5b-41ca-ab7e-9986a908a571", "field": "max_objects", "val": "0"}]': finished 2021-10-08T19:45:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:15 smithi112 ceph-mon[40655]: osdmap e764: 8 total, 8 up, 8 in 2021-10-08T19:45:15.822 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:15 smithi112 ceph-mon[40655]: pgmap v1266: 188 pgs: 188 active+clean; 802 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 1 op/s 2021-10-08T19:45:17.524 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:45:17 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:45:18.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:18 smithi112 ceph-mon[40655]: pgmap v1267: 188 pgs: 188 active+clean; 802 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 913 B/s rd, 1.6 KiB/s wr, 1 op/s 2021-10-08T19:45:18.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:18 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:18 smithi112 ceph-mon[31694]: pgmap v1267: 188 pgs: 188 active+clean; 802 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 913 B/s rd, 1.6 KiB/s wr, 1 op/s 2021-10-08T19:45:18.325 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:18 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:18.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:18 smithi142 ceph-mon[33432]: pgmap v1267: 188 pgs: 188 active+clean; 802 KiB data, 519 MiB used, 715 GiB / 715 GiB avail; 913 B/s rd, 1.6 KiB/s wr, 1 op/s 2021-10-08T19:45:18.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:18 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:20.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[40655]: pgmap v1268: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2021-10-08T19:45:20.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:45:20.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:45:20.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:45:20.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:20.324 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[31694]: pgmap v1268: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2021-10-08T19:45:20.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:45:20.330 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:45:20.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:45:20.331 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:20 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:20.331 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:20 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:20.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:20.332 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:20 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:20.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:20.332 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:20 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:20.141Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:45:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:20 smithi142 ceph-mon[33432]: pgmap v1268: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.4 KiB/s wr, 1 op/s 2021-10-08T19:45:20.524 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-10-08T19:45:20.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-10-08T19:45:20.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:20 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-10-08T19:45:20.525 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:20 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' 2021-10-08T19:45:21.793 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:21 smithi142 ceph-mon[33432]: pgmap v1269: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2021-10-08T19:45:21.821 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:21 smithi112 ceph-mon[40655]: pgmap v1269: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2021-10-08T19:45:21.824 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:21 smithi112 ceph-mon[31694]: pgmap v1269: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2021-10-08T19:45:23.174 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:45:23.175 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:22 smithi142 ceph-mon[33432]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:45:23.175 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:45:23.175 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:22 smithi142 ceph-mon[33432]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:45:23.324 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:45:23.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:22 smithi112 ceph-mon[40655]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:45:23.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:45:23.325 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:22 smithi112 ceph-mon[40655]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:45:23.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:45:23.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:22 smithi112 ceph-mon[31694]: from='mgr.14532 172.21.15.112:0/2547144410' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:45:23.326 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-10-08T19:45:23.327 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:22 smithi112 ceph-mon[31694]: from='mgr.14532 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-10-08T19:45:23.523 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Oct 08 19:45:23 smithi142 conmon[35373]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:45:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.18.1" 2021-10-08T19:45:23.822 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:23.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:23.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:23.535Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:23.823 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:23 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:23.535Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:45:24.273 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:23 smithi142 ceph-mon[33432]: pgmap v1270: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 961 B/s wr, 1 op/s 2021-10-08T19:45:24.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:23 smithi112 ceph-mon[40655]: pgmap v1270: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 961 B/s wr, 1 op/s 2021-10-08T19:45:24.323 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:23 smithi112 ceph-mon[31694]: pgmap v1270: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 961 B/s wr, 1 op/s 2021-10-08T19:45:25.323 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:45:25 smithi112 conmon[32108]: ::ffff:172.21.15.142 - - [08/Oct/2021:19:45:25] "GET /metrics HTTP/1.1" 200 157763 "" "Prometheus/2.18.1" 2021-10-08T19:45:26.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:26 smithi112 ceph-mon[31694]: pgmap v1271: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 966 B/s rd, 0 op/s 2021-10-08T19:45:26.322 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:26 smithi112 ceph-mon[40655]: pgmap v1271: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 966 B/s rd, 0 op/s 2021-10-08T19:45:26.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:26 smithi142 ceph-mon[33432]: pgmap v1271: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 966 B/s rd, 0 op/s 2021-10-08T19:45:27.524 INFO:journalctl@ceph.iscsi.iscsi.a.smithi142.stdout:Oct 08 19:45:27 smithi142 conmon[56624]: debug there is no tcmu-runner data available 2021-10-08T19:45:28.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:28 smithi112 ceph-mon[31694]: pgmap v1272: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:28.322 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:28 smithi112 ceph-mon[31694]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:28.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:28 smithi112 ceph-mon[40655]: pgmap v1272: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:28.323 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:28 smithi112 ceph-mon[40655]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:28 smithi142 ceph-mon[33432]: pgmap v1272: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2021-10-08T19:45:28.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:28 smithi142 ceph-mon[33432]: from='client.24434 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2021-10-08T19:45:30.321 INFO:journalctl@ceph.mon.c.smithi112.stdout:Oct 08 19:45:30 smithi112 ceph-mon[40655]: pgmap v1273: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:30.321 INFO:journalctl@ceph.mon.a.smithi112.stdout:Oct 08 19:45:30 smithi112 ceph-mon[31694]: pgmap v1273: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:30.322 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:30 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:30.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:30.322 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:30 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:30.141Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-10-08T19:45:30.322 INFO:journalctl@ceph.alertmanager.a.smithi112.stdout:Oct 08 19:45:30 smithi112 conmon[81261]: level=error ts=2021-10-08T19:45:30.141Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.142:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.142 because it doesn't contain any IP SANs; Post https://172.21.15.112:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.112 because it doesn't contain any IP SANs" 2021-10-08T19:45:30.523 INFO:journalctl@ceph.mon.b.smithi142.stdout:Oct 08 19:45:30 smithi142 ceph-mon[33432]: pgmap v1273: 188 pgs: 188 active+clean; 802 KiB data, 520 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-10-08T19:45:30.821 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Oct 08 19:45:30 smithi112 conmon[32108]: 172.21.15.112 - - [08/Oct/2021:19:45:30] "POST /data HTTP/1.1" 200 - "" "Python-urllib/3.6" 2021-10-08T19:45:31.514 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-10-08T19:45:31.516 DEBUG:teuthology.task.console_log:Killing console logger for smithi112 2021-10-08T19:45:31.517 DEBUG:teuthology.task.console_log:Killing console logger for smithi142 2021-10-08T19:45:31.517 DEBUG:teuthology.exit:Finished running handlers